I think my Dad is finally realising now he's in his 60s how badly he's fucked up all his family connections. He had a succession of affairs while we were kids (including with my Mums sister) which we didn't find out about until Mum finally split up with him after one too many affairs. He them promptly decided to spend the next 10 years abroad for 9 months in every 12, dropping himself into mine or my brothers lives for a month at a time whenever it suited him. (He smartly leant us a bunch of cash when we each bought houses, so that we couldn't really tell him he couldn't stay with us)
He now lives in my city, and I see him once or twice a month for a few pints or a walk. DP dislikes him hugely but makes nice for my sake, and DD visibly dreads spending time with him. She's a surly teenager at the best of times at the moment, but it's so much worse with him. I've asked her why and she said "It's just so obvious none of you trust him or like him"
Things are better with my brother I think, but its a long way from the hero worship, he used to feel for him. His kids are a lot younger too, so don't really pick up on any awkwardness. DBs wife absolutely hates him though (stems from the fact that he just dropped in on their honeymoon for a week, because he happened to be in the same country)
His relationship with his sister was also fairly damaged when he split up with my Mum, because they'd become very good friends over the years
He's desperately trying to make up for it now, because I think he's finding himself lonely, but honestly we just don't want to spend that much time with him. We've got busy lives, and have done without him for best part of 20 years, so its hard to start slotting time in for him now. And I think we all still feel the "Why won't he just fuck off" from when he'd still be taking up our spare bed 4 weeks after he'd shown up.
He doesn't feel like a father to me, more like a mate from school or uni who turned out to be a bit of a dick, but you still make time for occasionally out of loyalty. I can go for a pint and have a good chat and a bit of a laugh, but I'd never feel able to tell him if me and DP were going through some problems, or if I was having a crisis at work or something.