Sadly, he seems to treat children as nothing more than his golf and tennis trophies.
They sit on a shelf all the time, ready to be photographed or proudly shown to friends, who will be very impressed at how amazingly great a man he is.
Occasionally, it might be nice to take them down and dust and polish them, but only when he really feels like it - and he never has to actually do it at all if he continually finds that he just can't ever quite be bothered.
In fact, even if he could be bothered to do it more than on the odd occasion, he would need to talk himself out of it, because that would be a very boring and miserable thing to find himself doing. Life is for living and for having fun and you can't let obsessing over your trophies keep you from that.
If you DID, your friends would make fun of you when you kept wanting to stay in to polish your trophies instead of going out with them. In fact, you'd probably annoy them so much, constantly turning down their invitations, that you'd have to keep apologising to them for being a bad friend and for choosing the wrong priorities.
All of the above is a perfectly reasonable way to look after your trophies, as they're only possessions.
Something has to change drastically and soon - this can't go on like it is without it destroying your mental health and self-respect. Not just yours, either - that of three children, two of whom are still tiny and one of whom hasn't even been born into this sorry mess yet.