I don't care what you say, but I'm sorry but you are no more in love with this damaged man child than he is with you.
You are BOTH damaged people flogging out your self loathing on each other - you punish yourself every day you stay with this man, it is not love but an addiction, one that from what you write doesn't seem to actually have any highs anymore - did it ever ??
He is damaged, bitter & broken from his marriage breakdown & punishes YOU everyday for that, because you are there, you let him.
YOU let him because deep down, due to whatever childhood or other issue you feel you deserve no better, so you continue to " flog that dead horse" because in reality you flog yourself.
Sorry to be so blunt but you really can do so much, you DESERVE so much better, but you need to believe that at a much deeper level not to just keep on repeating this same pattern of behaviour with the next loser.
You both need counselling to address the deeper issues at play, only then can you truly pick up the pieces & move forward in a truly healthy way - I suspect it won't be with this man, as he sounds so stuck in his man child ways that everyone else will be to blame. If you have any ultimatums to make, this is the one I suggest you start with - he goes to counselling & then maybe once good foundations are laid, you can think about couples counselling - but don't hold your breath, he doesn't sound thevsortvto take real responsibility for anything.
YOU on the other CAN move forward from this, you can also get yourself to a place where you don't fall into this trap again - THEN you will find someone who truly loves & respects you - because you love yourself enough not to accept this crap.