To answer your question, yes it's wrong if it goes directly against the grain of what you want and need. TF is about spiritual growing together so I read not giving in to someone exercising their sexual fantasies that you evidently are worried about. I mean, how far can it go?

My first response (being me and a skeptic) is that he thinks he's getting complete control of you on the mundane. It sounds like his basic nature and as for bringing out this and that of male + female, it's complete carp (misprint) - that's an excuse to get you to submit. If I met a bloke like that I'd kick him out. I'd worry about what next thing he wants to get up to. Tie me to the bed? Go in for those weirder sexual antics that might do real harm...

If this is all happening on the astral then be careful he isn't some incubus entity that you're laying yourself open to. Psychegrl's advice is wise indeed.