A soul connection does not mean that he/she is compatible with you in the physical and emotional levels.

I am not saying that your connection with him is even positive or deep connection. You just have a connection with him and that is it.

When you recognize that maintaining a physical and emotional connection with him is harmful and hurtful to you, you need to dettach yourself from him.
This is a lesson and passage of self love. It is often a painful journey to that peak.
This may be the only purpose of your connection with him, nothing more.

You need to learn that you have everything that you need for love within you. You do not need him.
Choose yourself first.
When you start loving and respecting yourself through dettachments, you would attract your next lesson.