@noodlewoo
He’s a good dad I can’t fault him for that and I get on with them really well
The first mark of a 'good dad' is that he treats his children's mother with respect, and with love if they're together. This man does neither. His comments were abhorrent, and honestly I think he says those things with the specific intent to hurt you because he enjoys seeing you in pain.
By any chance was your first child unplanned? Could he feel he was 'trapped'? I really hate men who feel like that because if anyone is 'trapped' by an unintended pregnancy, it's the woman.
I do think that you should get back into the job market asap and get away from him, but you know your situation better than I. So what you should do, since you have a year to go, is start NOW planning to make your exit. Start stashing money away, get some kind of training if you need it to reenter the job market at a decent wage. Start exploring resources for your child and what childcare you may need. And remember that this prick will have to pay CMS. Easy enough if he's a wage earner, but if he's self employed or could easily go cash in hand, you'll need to plan for that.
Also, and I'm sorry to say it, but a man like that is very susceptible to cheating. This is another reason why you need to stash money away, starting immediately. He's as much as said that he wouldn't be there if it weren't for DC. Believe him and plan that he may very well walk out someday. Don't be blindsided.
Seek support from family and friends. If you have ONE friend or relative that you can lean on who will keep your confidences during this 'planning time', can help you keep your 'fuck you fund' securely stashed, and who will have a sympathetic ear when you need to vent, seek them out and confide.
And investigate the lease on your place. I'm not in the UK so I know very little about social/council housing in the UK. But you want to be sure that your name is on that lease and if it is not, GET IT ADDED. You cannot be sure that this man will 'go quietly' when the time comes so you need to be educated as to what, if anything, can be done. There was a recent thread (may still be active) in which an OP found out her name wasn't on the lease and she was forced to leave.
Don't sit around hoping that the future will be better because he will never change and likely will get worse. So make your own future a better one without him. You deserve it.