Personally, I think you have enough red flags here, to make some bunting.
His excessive stingyness at the start, about meals out etc, calculating things to the penny. Really? Plus his recent comments are not funny.
I would urge you, for your own well being, to please not have a baby with this man, without the protection of marriage. That way, if it all goes tits up, a few years from now, you have the complete protection of the law, in so much as you will have a 50% claim of any assets amassed during the period of the marriage (including his pension), no matter who paid for it.
What if you return to work Part time? Will he still expect you to pay 50% of the bills, thus having virtually nothing left over (whilst he has loads left over)?
Does he understand that he will have to pay 50% of any Nursery fees?
There was a lady on here recently, whose Partner expected her to still pay for half of everything, when she was on Mat Leave (and later once she was working part time), plus he demanded that she pay 100% of nursery fees. She was totally trapped.
My long marriage of 20 years went horribly wrong, when I found out that he'd been shagging multiple other women. At that point, my husband had worked continually, and had worked his way up the career ladder and was earning almost £100k, and had a nice fat Pension Pot. I, on the other hand, was working part time around the children, on a very low wage and with a small pension pot. The protection of marriage, meant that I walked away with over 50% of the assets and was able to start again. Had I simply been living with him, I would have had no option to leave.
It's all very well, being all hearts and flowers now, when things seem exciting (moving in and having a baby), but think with your head and not your heart. You have no idea what state your relationship could be in, in 10 years time. Do not sacrifice your financial stability for any man. They can change overnight, and fuck you over like you wouldn't believe. Don't risk it for yourself, and for your existing child and the roof over his head.