...It feels better this way. And besides, if this continues we won't have to be concerned about it causing problems at an inopportune moment.

[...and there's the practicality, as always. He hesitate a bit once that's out there, though; he knows he gave you a non-answer before.]

...I'm not certain how you don't mind it; I assume it's something like you were discussing before. Something you put up with because I'm important to you.