This thread's actually got me out of bed, I've been fretting and pondering.
I do feel for you Wilde, my father withdrew from me when I was at my worst and I told everyone who'd listen what an unutterable bastard he was (I also gather from your OP he has a wife you're not too keen on - My Dad had one of those too and I'd rail against her frequently - how she'd turned him against me, what a bunch of cunts they were). But the truth was, he'd simply had enough, he didn't know what to do any more and he was weary and tired, and helpless, so the only thing he could do was withdraw.
And looking back, I don't blame him, I hope I NEVER have to see my children in the state he saw me in many times. I remember getting off a plane once, he was picking me up from the airport and I'd been drinking heavily combined with benzos (I'd even lit a fag on the plane and told myself if I blew the smoke into my tonic can no-one would notice - it's amazing what you can get away with if you're vaguely plausible, apologetic and middle class). Anyway, I walked out of arrivals and had NO FUCKING IDEA where I was, I had a brief moment of clarity and saw someone who looked familiar and honed in on them. It was my Father, my Father looked 'familiar'. The next thing I remember was being in the car with my hand on his leg, and him gently removing it, I was so fucked I thought he was my ex-husband and was apologising to him for all my misdemeanours.
He's found me face-down more times than I care to remember.
The poor man.
And I was never a nasty drunk, a violent drunk, I was never a danger to anyone but myself, but I was a self-pitying mess, and I had ALL the excuses lined up and ready to roll. It was never my fault.
I've had a complicated family history, but who hasn't? That one just gets tired after a while. It's ok to blame every fucker but yourself when you're young, then one day you look in the mirror and it's just you staring back, the old crimes against you have suddenly become shit you're perpetrating on others, YOU become the one that's causing pain and people are your victims, you can't play the 'Poor me' card any more because it's 'poor every fucker that comes into contact with me' and that's when you realise it has to stop.
I don't know if you'll get there Wilde, I hope you do, but you HAVE to start taking some responsibility for your own life, you're not helpless, you're not a lost cause unless you choose to be.
I understand that choosing not to be can be very fucking difficult though.