He sounds pretty awful, OP. He has basically told you clearly that he doesn't care if you're unhappy, he doesn't want to change. Your unhappiness is worth less to him than his inertia. That's not a loving man.
FWIW, we have two under fives, we've been together almost 15 years, and we love each other to bits. We have a lot less sex than we used to, although it's ramping up again now that the youngest is almost sleeping through - probably 1-2 times a week? And we try to have a romantic/sexy evening at least every second Saturday night - nice underwear, wine, chatting, bonking. And we would go out together for dinner and things more often if we had babysitting, we miss that. We work in the same street, so we do have lunch together at least once a week so we have some chatting time without the kids there.
We're very much a team - with two working parents and two small children it's a constant flow of 'I have a project to get done, can you take DD1 to ballet, and I'll pick up your shopping on the way home to save you doing it tomorrow', but very much mutual, very much anticipating each other's tasks and monitoring how burned out we are.
But honestly, it's not really whether you're being unrealistic (you're not, though). It's that you have told him that you are unhappy. Told him. And he has said "I don't care, like it or lump it". I don't know how much clearer that can be, honestly.