OK, back to basics then for you young lady!
Here is your OP and I'll identify the ways you are being subjected to abuse. OK?
My partner keeps on at me about small things, like asking me why I have kept 4 magazines in a drawer instead of throwing them away (!), and when I defend myself he blows up, acting hostile and aggressive and telling me to move out (he is not violent to me, or anyone else).
He is threatening you, The BULLY with a touch of the PERSUADER in the Freedom Programme
Then he will ignore me for days, saying that I am the one in the wrong and I should apologise. He changes what I said, making it worse, and calls me a liar when I deny saying those things.
He's gaslighting you, telling you have done/said things you clearly haven't The BULLY with a touch of HEADWORKER
This has happened a few times this year and I feel quite anxious and stressed as we have a baby, and also because my ex-h was controlling and I am scared things are going the same way. We have been together for five years and I think he's been worse since I stopped working to look after our baby.
The JAILER
Things ARE the same as your EX. Sorry but they are.
www.freedomprogramme.co.uk/resources.php will show you what I mean.
You need to get away from this one too.
Can I suggest you enrol in the Freedom Programme? It'll help you recognise the signs and help you protect yourself from being attracted to or falling victim of another abuser.
Remember that this is NOTHING you did. These men CHOSE to target you. You were vulnerable. The freedom programme can close down that vilnerability.