You sound quite young OP - but apologies in advance if I am mistaken.
This is a man who has no respect for women - never mind you - and, it will only get worse. I can PROMISE you this. At the moment, your self-esteem and bar are on the floor and that's a really hard starting point. I know it's overwhelming when people say "just leave" when things are that low.
Instead, take some smaller steps with a view to trying to reframe this whole 'relationship' in your head until you are strong enough to leave.
Refuse sex if you don't want it. If he pesters you, tell him what he is - a sex pest who is making unwanted advances.
If he STILL thinks it's ok to engage in sexual behaviour with you, when you have either clearly said you don't want to or are passive/asleep, tell him what he is doing which is sexually assaulting you. Actually tell him.
Start building bridges with your mum. She is not wrong about him.
Talk to friends if you can. This is NOT NORMAL
Read the Lundy book and see if you can find some support groups to help you feel stronger.
He is repulsive.
He doesn't like women
He doesn't respect women
He doesn't respect you
He is a sex pest
He is a terrible role model for your child.
Keep reminding yourself that.