OP - it's not 'stupid' or selfish or whatever to leave a relationship where your partner does not care that when you do something that's supposed to be enjoyable for you both, it is only enjoyable for one of you.
It almost doesn't matter what it is. Could be where you lived or what TV you watched or what you takeaway you order from or anything - it just happens to be sex.
And you said:
"I am unhappy with X in our relationship, please can we do Y and Z to change it."
A "yes" would have been doing the things to make it better.
A "no" is refusing to do those things, EVEN THOUGH your partner knows you're unhappy with an element of your relationship. They are showing you that they don't care if you are unhappy with it, as long as they get what they want out of it.
No compromise, refusing to listen to your clearly expressed needs, pretending to care about a relationship issue but refusing to meet you halfway to fix it - bad grounds for a relationship.
Imagine these conversations instead:
"I don't like that when you cook, you only cook foods you like, every single night. If you took out the mushrooms, then we'd both like it."
"I don't care. Having the food I like is more important, so I'm going to keep making what I like and I don't care if you go to bed hungry."
"Can we watch something other than wrestling? Every time we put the TV on, it's wrestling, and I'd like to watch something we both enjoy."
"I want to watch what I enjoy and I don't care if you enjoy it. You have to sit and watch it anyway, though."
"Can we talk about where we live? I can't commute to work from here because it's 100 miles, and your work is round the corner."
"No - I don't care if you can't get to work - I can, so it's fine."
Good sex is not a fantasy. And wanting the bare minimum - a partner who at least TRIES to ensure you orgasm - is not a frivolous reason to end a relationship. It's not putting up with selfish and uncaring and frankly exploitative behaviour - sex is supposed to be something you enjoy and do together, and currently he's doing it at you.