This sounds like such fucking BULLSHIT.
Anything this complicated is complete BULLSHIT. Or there's something really criminal going on.
And btw, you feeling like you immediately knew him when you met him - OP, this is the dead giveaway of a con artist.
Predators start by targeting vulnerabilities like loneliness, then they form "friendships" through empathy, it makes their victim feel understood and heard. It's like opium to lonely people. "Nobody gets you like I do." Then the predator isolates you while testing your boundaries - and often they play a looong game, like months/years. Then, when thye've got you all primed, they start to exploit and consume you. And it's all wrapped up in shadows and weird stuff, but because your needs are getting "fed", the cognitive dissonance starts to make you gaslight yourself.
OP, this man is a predatory con artist who has already raped a woman, whose own children don't want to see him, who is telling you absolute fucking BULLSHIT stories. I'm hoping at this stage that all he wants from you is sex, and that he's not setting you up for something worse.
OP, you need to get your head out of the clouds. You're a mother, your children need you to be healthy and safe, not being preyed on and drained.