Find your running shoes and run,away from that is.
I wasted years on someone,( thankfully in my early 20's, )met my DH of thirty years in my late 20's, the draw of the other guy was always strong, we lived in totally different parts of the country and only kept in touch sporadically, the chat was never sexual, or even a romantic way, we just knew the same people, thought the same thoughts, but I realised he was a bit feckless and never going to change.
I am in sporadic contact with his brother these days, turns out, he is knocking 60, single, (never ever wanted to commit to any lass he met) doesn't own his own home despite being a HUGE earner at one point, he has ended up in sheltered accommodation having had a massive stroke due to not minding himself and is unable to work.
We on the other hand, worked our arses off, went without, ( looking back he sometimes sneered at us for being so sensible) mortgage paid off, decent pension and decent savings pot behind us.
Not wishing any of the above on your ex, but do yourself a favour and walk away.
Life might be trying to give you a steer.