It's alright. [And he means that.]

I know you're not really the type, but the best thing you can do in a situation like that is to tell him to mind his own goddamn business or tell him to fuck off. If you haven't even been there yet, he can't fuckin' hold it against you. Hell, it might be a different you. No one here knows how this shit works.