The reason they didn't intellectual disparities didn't evolve if because there was no selection pressure for them to.
I think you're misunderstanding how evolution works a bit. Evolution doesnt tend towards the best traits, it tends towards the traits that don't get us killed before we have a chance to procreate. (Hence why we've still got appendixes. Yeah, they like to kill us sometimes, but not frequently enough or always early enough for them to be a big enough negative to evolve away from having)
There's not really any negative for men being just as intelligent as women. You mention the calorie cost of intelligence, but this isn't really a thing. The calorie cost is based on the mass of the brain, not what we do with it.
And brain size has absolutely nothing to do with intelligence. Crows use tools, but are hugely smaller than albatrosses, which can't even recognise their own chick as a chick if it falls out of the nest. (Intelligence is actually much more about surface area, hence the folds in brains. Generally, the smarter the animal, the more wrinkly its brain. Take a look at a picture of a koala brain, an animal that can't even recognise a leaf as food if its fallen off the tree, it's the very definition of a "Smooth Brain")
So, what are the costs / benefits to intelligence?
Cost - Sometimes instinct wins out. When a lion is running towards you, sometimes freezing while you run all the options through your head isn't a good idea. A strong instinctual response to RUN! would be a much better option.
Benefit - Communication. Generally, the most intelligent animals are the ones who work together. Communication breeds cooperation, and cooperation breeds survival. If you can tell your kids that Dave died when he ate those berries, then your kids are less likely to eat them. You're far more likely to bring down a woolly mammoth if you can strategise with each other. Far more likely to be able to make tools if your parent passes down that knowledge to you. All of the most intelligent animals are ones who live in groups, who live in societies.
And on an individual level, evolution tends towards intelligence. You're far more likely to pass your genes on if you can remember not to eat the red berries, or stand under a tree when there's a thunderstorm, or if you don't get expelled from the tribe because for being a liability during the Woolly Mammoth hunt.
The only time evolution selects away from intelligence is if it can't afford it. Going back to the koalas - They've evolved to fill a very specific niche. They eat exclusively eucalyptus leaves, a food that almost no other animal will bother to eat because it lacks nutrition. This is great for koalas, because there's loads of food for them, but it means that the only calories they can afford to expend are on eating and sleeping. Every moment they're awake they eat, they can't afford to expend calories on anything else, including thinking. A koala that thinks, dies of starvation. So they've evolved to have smaller and smaller, smoother and smoother brains, to the point that they can't even do basic pattern recognition to work out whether this green eucalyptus leaf shaped thing on the ground is actually food.