2 Corinthians 6: 14-15 "Do not be bound together with unbelievers; for what partnership have righteousness and lawlessness, or what fellowship has light with darkness? Or what harmony has Christ with Belial, or what has a believer in common with an unbeliever?…"
I hope this verse finally helps you understand why this man was removed from your life. The sooner you let go off the past, the sooner God will start working in your life. As long as you are stuck in the past, you will simply continue to suffer and you will not move forward. Why are you unable to trust God for your future? He knows what is best for you.