No, he is wrong. Very wrong.
So many women go on to have deeply loving, fulfilled relationships with any number of children and any amount of baggage.
What will make you vulnerable is any feeling of inadequacy or low self esteem. Do not let him chip away at your boundaries or your values and DO NOT compromise on what you need or deserve just because he has made you afraid with his horrible words.
I am speaking from painful (and wonderful) experience. I have gone through some horrid relationships because I was afraid I couldn't do better. It was only when I started to value myself I finally found a good one. I am now in a lovely relationship and very happy but only after a lot of heartache.
You know all the stuff about being on your own, liking yourself? Well, news flash, it is right but I didn't understand it for years. What I finally realised is it means get yourself to a place where you are not afraid to walk away. Walk away from anything. Even the most romantic, connected, floaty love affair you have ever had if it suddenly stops and you feel confused and unhappy you need to be brave enough to walk away. It doesn't mean don't try, it just means stop trying if you are being taking for an idiot.
Sorry, I don't think I am explaining that very well. I think basically what I am trying to say is you will not be on your own. There are lots of lovely men brave, loving and capable enough to take on a family (some with children of their own so you might have to do done compromising and accommodating too). There are also some nasty predators who will take advantage of somebody who is a little fragile emotionally. Often the nastier ones can be totally adorable early on then suddenly change and leave you chasing after the dream they spun you and making you feel like it is your fault it has disappeared.
Look for the good ones and try always to be brave enough to walk away from the ones where it isn't working. You don't need to know why or whose fault, just walk.
Sorry, I hope this isn't TOO rambley, it is what I wish somebody had told me years ago. It may not be at all relevant to you so feel free to ignore.
I really hope everything works out and you find somebody lovely. :)