I know it seems harsh, because he's sweet and lovely etc when he's not being angry and aggressive, but this is who he is. He's showing you loud and clear.
I spent 5 years with someone like this, I just finished with him and it's the hardest thing I've ever had to do (harder than ending my 14 year marriage) because I truly loved him, but I didn't feel emotionally safe with him.
Even though he insisted he would never physically hurt me, his angry outbursts, swearing, name calling etc hurt me mentally and emotionally. It stunted my growth as a person, because everything I said had to go through a filter. It made me nervous to upset him, it made me overthink everything in case it set him off, I was walking on eggshells, knowing that whenever I had any issue with anything he said or did that I either had to put up and shut up or risk the wrath of an aggressive man. And god forbid I ask something of him, his whole demeanour was like a petulant teenager saying "you're not my mum, you can't make me, what are you going to do about it?"
It was exhausting and unfortunately, even though I could see it coming every time (I used to play dick-head bingo in my head - knowing exactly what he would say next!) I never found a way to stop it happening - it didn't matter what I said, when or how I said it, it was always the wrong time, the wrong tone of voice, the wrong words. It's because the game was rigged - I was never going to get it right.
Having had a violent relationship like you in the past, I am sensitive to conflict, BUT THAT IS A GOOD THING! Being aware that aggression can and often does escalate protects you. Listen to your instincts. A truly good man doesn't want to scare you, he doesn't want you to feel intimidated by him, he would be moving heaven and earth to sort himself out so that he could be a better man for you.
He won't change, deep down. Or if he does, it will take him many years of therapy and reading to try an improve himself, which he can only do off his own back, not steered by you.
My ex DP read the Chimp Paradox by Steve Peters and that did help somewhat to explain why he got so angry (road rage etc) He also went for lots of counselling, but seemed to spend his time there talking about anything other than why he was a nasty aggressive bully at times. And although he was able to stop himself from physically kicking off, the shouting, swearing etc carried on and there was always the threat that if I didn't back off then he could start throwing his weight around - "what are you going to do about it, call the police?" etc. It was awful. And then the next day he was sweetness and light. It fucks with your head/heart.
Please do yourself a favour and don't waste any more time with him. He's not husband material. 