I find it very hard to believe that he thinks marriage is bad because it is a relic from when men had ownership over women - yet was happy to give the children his surname. Did he suggest double-barrelling their names or giving them your surname? Is he normally a staunch feminist in his day-to-day life?
He just doesn't want to get married. And he doesn't care that it is important to you. I know everyone on Mumsnet seems to think that marriage is solely about the legal benefits that go along with it and sneer at the romantic side. However, for many people, it is a sign of commitment. It is a public pledge to 'forsake all others' and to sacrifice future romantic partners.
I always feel that if someone doesn't want to get married, they're not prepared to make that pledge. They want the door to remain open. If someone better comes along, they're not breaking any public promises. (Obviously married people cheat too and leave their spouses, but there is an extra element of breaking a vow, which is absent when an unmarried partner does it).
So, my view is that actions speak louder than words. This guy doesn't want to be married. Never intends to be married. Doesn't care enough about your feelings to marry for your sake. Will stay with you until someone better comes along (it's just happy circumstance that there hasn't been anyone better in 28 years). Am I wrong? Well, maybe, but what evidence do you have to suggest that I am wrong (apart from his words, and words are cheap)?
Should you leave him? Not necessarily. I don't advocate breaking up families. However, you need to concentrate on yourself and your needs now. He's had things his way for the entire relationship and strung you along. You need to decide what you want and what you are prepared to put up with.