Yes, OP, you would be better of on your own. He sounds like a real nasty piece or work. He has no concept of what childbirth means. Clearly he had nothing at all to do with his previous children as babies as he seems to not have a single clue what a big deal this is. And most proud fathers to be WANT to buy nice new things for their baby, it's part of preparing and part of the joy. He seems to think children are something we are expected to have, but he doesn't seem to really want this child. Wanting you to go straight back to work shows he is on a whole self-absorbed planet of his own.
He doesn't see you as equal. By your own admission and his admission, he doesn't trust you (red 'neon flashing light sign' flag there) see 'his' home as your marital home. He sees you as a flatmate. You are not his equal, he feels no manly or fatherly urge to provide for you and his child. I don't believe he truly wants this child (I suspect he just thinks, as I said, that it's the done thing to have children, but he seems so distant and remote from what that means for you and for the child, like as if it's all for show/image, the practicalities don't concern him and are 'your responsibility'), and he doesn't seem to want a marriage. He wants a flatmate with benefits deal where you act as basically a single mum who pays your own way and pays everything for the baby. Basically you are living two separate lives.
He does not see you as a family unit. That is what it boils down too.
I'd leave him, I truly would. You are basically living as flatmates anyway at least financially, and you will definitely all but certain be a single mum in terms of finance and care. He truly doesn't seem to give a damn about you, the affects of childbirth (and what if you need a c-section, and/or a vaginal tear, possibly prolapse - he expects you to just.....go back to work, like that? And while bleeding heavily? He is not husband material. He is not father material. He is just a cold, insensitive, self-serving pig. If you can, leave now. Unless you seek serious couple counselling as soon as possible.