I agree whole heartedly with @MoirasSaggyBundles
He thinks he has all the power.
He expects you to give up your job, demand that you still pay for your share of the bills. He will then refuse to parent his child, so you can get an evening/weekend job.
He has shown you who he is.
Do not keep this to yourself. Rally around your support.
IMO, I would ask him to leave. Get CMS and any benefits you are entitled to.
He will probably threaten to go for “full custody” to scare you into submission, but he won’t want to.
Think about it, he calls/texts you constantly when he is parenting his child alone.
Please, please listen to what everyone is saying.
Do not give up your job and kick him out.