No, if he cared about them he wouldn’t have gone off with you and also forced the relationship on them despite them repeatedly asking him not to.
They are not repeating what they’ve heard at home, they have been betrayed by their father independently of his betrayal of their mother. He has hurt them, deeply, and he needs to recognise that.
I also find your determination to paint his wife as bitter, unreasonable, unfair to the children and angry very distasteful. Given that your man has no regard for his children, is putting a relationship with you over their happiness and thinks it’s worth putting a partner above them in terms of his priorities you have an absolute cheek to insinuate that she is a poor parent. I also don’t believe a word of what you’re saying about her, that’s you trying to justify your disgusting behaviour.
So you carry on as you are not that you would do anything else because you’re both selfish beyond belief, but don’t expect these children to fall in line and join your ridiculous fantasy. Because they deserve to be heard, their feelings matter and are important, and they have the right to an actively involved father, not some kind of cardboard cut out pretend dad.
It’s also worth bearing in mind while dismissing the very real distress you’ve both caused his children, that they won’t be small forever. One day they may choose to let you both know the impact of your actions, and it won’t be so easy to just dismiss an adult. So think on that.