Your partner cannot keep his anger under control.
He probably doesn't want to hurt your baby, but when he is in a rage he does not or cannot control himself. And he does not have the self reflection to recognise that he is a massive risk to your baby. Or maybe he is very selfish and doesn't care. His motives don't matter at this stage.
Babies can be very trying on your patience, fortunately most people have a huge aversion to shouting at their baby or being violent to their baby's property, it is abhorrent to most people.
Your DP does not have that. Maybe he was abused as a child. That is sad. If you didn't have a child it would be your decision whether to stay with him when he has such a temper, and although I would urge you to leave as an adult you would be entitled to make your own choices, however risky. But you absolutely must not keep your baby in a risky situation. Your baby is relying on you to keep him safe from harm. Your baby can't keep himself safe, you need to keep him safe.
Your husband could easily be pushed over the edge. Babies are very vulnerable to injury. Your baby could be killed or severely injured with a few seconds of loss of control. Your partner would be in prison. Maybe he would be very regretful, but the damage would have been done.
My father had violent rages when he lost control of himself. My mum would drag him away from me. I was terrified. Relative to some violent parents he didn't attack me often, the odd punch or push, it was usually shouting and posturing, but he seemed to not be in control of himself and to see him shouting in a rage was terrifying. In between he was pleasant and cheerful. I don't know how old I was when it started. I grew up thinking that was normal, and it was very damaging. Especially the unpredictability, i spent my childhood walking on eggshells. As an adult I realised that he could have easily seriously hurt me and I am so, so angry that my mother never called the police, never even considered leaving. Wtf was she thinking?! I would never, ever put my baby in that situation.
One of the saddest things is that my DH is lovely and gentle and trustworthy, but sometimes when he raises his arm- to stroke my hair for example- I automatically flinch away. My DH is so upset by this. This pattern of expecting violence is still there, decades later, after therapy, in a good relationship. Please don't let this happen to your baby.