I don't think that's even the point lucky.
Because that assumes that being alone is the worst possible outcome. It default assumes a fear of abandonment if you see what I mean.
If you were to find yourself single tomorrow, would you easily be able to fill the extra free time? Or would you fear the free time? Are you creative, do you read, write, paint? Play an instrument? study? make mosaics, murals, dress make, learn a language!? pot hole? skuba dive? what floats your boat? Do you know?
being single is not necessarily a bad outcome in my book so I wouldn't say you must dump this guy because you could end up with nothing because the 'nothing' referred to there is a relationship with another person. But a Person who has a much stronger sense of herself and her worth and a person who has NO FEAR of filling her free time probably wouldn't want what you have. Do you see the difference? I'm sure you can think of a woman who seems to have it all sewn up and she just wouldn't want this.
Lucky, you should NEVER have put yourself up in the dock and invited others to judge you. That to me shows that you are very conflicted yourself which is the point. It doesn't matter what the rest of us think, this is your conflict. Your cognitive dissonance.
Please read Mr Unavailable and the fall back girl by Natalie Lue. You will enjoy that book. She has a humorous way of writing. It's enlightening and it can do you no harm at all to read it.