Angel63, leave! What are you scared of? It is possible to survive on your own. You deserve so much better.
My last relationship lasted 6 years and was with a man who didn't want me. Like others have said it's a horrible thing to go through. It didn't help that I absolutely adored him and fancied him like mad. It would have been easier to cope with if he'd at least fancied me back even if we couldn't be physical as there are lots of ways to be intimate but he just didn't see me that way.
It nearly destroyed me and what made it worse was that he had several flings during the relationship but I was stupid enough to take him back. I went through a horrendous bout of depression and self harm (have a history of it anyway but that was the worst episode ever) and was just recovering when I discovered he had slept with someone (he'd always denied it before and said the others were just friends). I finally found the strength to end it and he didn't want to stay anyway (I suspect I would have let him stay if he'd asked ) I felt so much better when it was finally over. He just didn't fancy me but he constantly told me that things would get better. I wish he'd been more honest.
Anyway he's now living with someone else (not the one I found out about) but has also cheated/is cheating on her. She doesn't know though.
I'd say if you're not happy then end it. I have DDs (not his) who he was brilliant with and that made me reluctant to end it but it was destroying me which was worse for them than us not being together. You are worth more than that. Don't let yourself be treated badly and don't blame yourself.
I often wished I could switch off my desire and did stifle my feelings to some extent. I used to kid myself that I'd rather sacrifice sex and have him than split up with him and have nothing. But being with him and yet not sharing that side of things was too much to bear in the end. It's so sad that women put up with it for decades.
I'm now on my own with my DDs and my baby DS who is from a relationship I had after I'd split up with the no-sex ex. The sex was fantastic with him but we got on well but he couldn't cope when I got pregnant and so he's not involved at all. I'd rather be on my own after all I've been through and concentrate on my children rather than trying to find a reliable and trustworthy man