Without sounding too harsh Op, you do need to get a grip and wash this man right out of your hair. He sounds vile and seems to get his kicks putting you down, this type of man can destroy your self worth, if you allow him to.
He may of left you for a better looking woman, but the pain would still be there if she was ugly as sin, you'd then spend hours turning over why he preferred her to you.
She gets less attention than you, he's just verbally sniping at you, no normal boyfriend would mention things like this.
You're divorced, he knew that when he met you, his family won't accept you etc he's making you question what you are, just another way of putting the knife in and messing with your head.
Block all contact, forget dating for a while, come off social media so that you don't see what he's upto.Be good to yourself, surround yourself with your friends, good food, exercise.Anything to avoid giving this excuse for a man any headspace.Youll see the day of him and you'll probably be feeling good about yourself and he'll reappear and that will be your test.
I wish you well.