But there wasn't a "how we were", was there?
When you first met he was drunk and abusive and terrifying.
You had to defend him to family and friends and kept his abuse secret.
He manipulated and groomed you from a young age, then kept you pregnant and vulnerable so you couldn't easily leave him.
He continues to be regularly abusive, with a violent temper, to you and the kids.
He manipulates, gaslights, financially controls you and humiliates you in front of his friends.
Even ignoring all his appalling sexual abuse, this is not a good relationship.