He actually has on occasion asked me if I need someone to take me out (is do I need a carer) as I'm obviously not fit to go out myself and also called me paranoid, crazy
That is some high level, sinister gas lighting there.
He wants you to think there's something wrong with you, that you're crazy, lacking, incompetent, dysfunctional etc.
He wants your self confidence as low as it can possibly be.
As per the wall punching ... He's a text book abuser. Nasty piece of work.
(Convincing their partner they're crazy seems to be abusive man 101 - it's a later thing usually, they'll not do it in the early part of a relationship, only when they feel established enough ...
There is a case in the Don Hennessy book on abusers where the abusive h used his wife's Mum's dementia diagnosis to start on her; she was a mad woman or she would end up one, it ran in her family, she'd end up buried in the lunatic plot of the cemetery etc etc. (not sure that even exists). This was in rural Ireland where church and everything related were very important.
I can only presume they fixate on convincing their partners they're crazy because a. It makes them feel superior and they enjoy/feel secure thinking she's insecure and anxious and self doubting. And b. They presumably think they can manipulate her and get away with whatever they want and keep her in weak position by convincing her she's crazy and her judgement isn't sound and making sure she doesn't trust her own judgement. Then his judgement and his will holds sway.
The important thing about abusive men is to realise that they want a little domestic autocracy/dictatorship, they need to stamp out democracy. You don't get equal rights. That's not the type of relationship or household they want.
(They often do the "you're crazy/incompetent) thing in front of kids too, to make sure the dynamic of crazy, incompetent, silly, lesser Mum is established throughout the household.
That could be your future if you make the mistake of procreating with this creature.
He's perfectly comfortable trying to gas light you into believing you're insane, paranoid, incompetent and abnormal ..... He'll do the same even if you're in a family/have kids).