I think that you were on a different path in the 'relationship' than he was. You clearly invested more heavily in emotion, but he hadn't.
He bailed, as he wasn't into you, was honest about it and ended it, before things went too far, but you clearly had got further down that 'Far' path than him.
You needed to have this relationship work, for whatever reason personal to you, but he wasn't yet there. He did have some things going on in the background, but it perhaps appears that you were pinning hopes, perhaps too many of them, on him being The One.
It is possible to have people get under your skin, and if they don't care as much about you, as you think you do about them, anything less than glass slippers and a happy ending is going to hurt.
The feelings you have for him are merely surprise, disappointment that it ended sooner than you hoped it would. You perhaps did too much future planning in your head, made it a done deal, and when it didn't turn out like that you got hurt. With LDR it's very easy to imagine the relationship the way you want it to be, they are perfect partners, never burp, fart or have annoying habits, they are perfect in our heads every way.
Your friends think he's a bastard. Perhaps he is, but perhaps he just didn't care as much about you as you/they had hoped. Perhaps he knew he wasn't really over his ex and that you deserved better from him. We'll never know.
Whatever the reason, had you hung around waiting for him, you would not be with the guy you are now, and you would not know how nice it is to be loved and valued.
This LDR did you a favour. He wasn't good enough for you, he didn't see your immediate value, more fool him.