Maybe he’s holding back because he sees some qualities in you that he’s not comfortable with. Ensure that whenever he is around, you do things a good lover should do- cook for him, give him random trinkets. These things might vary depending on the guy. It is important to know what he likes in women so that you can put your best foot forward.