I'm surprised that you don't see how abusive this is. He often goes out for the entire evening, leaving you at home doing childcare. He agreed to ONE night where you could go out while he stayed with the kids, and then he reneged on it by staying out late. Then he blamed it on you, that you shouldn't have expected him to come home for the time he had agreed to. From where I sit, he clearly did this deliberately so that you would know that ONLY HE is allowed to go out, that YOU are NOT allowed to go out. That HE will go out and stay out as long as he wants, and that he is under no obligation to stick to his word. That HIS wants are important, and yours are unimportant.
That sort of behavior on his part is extremely manipulative. Getting your hopes up, only to dash them to the rocks. It's incredible that he came home to you at 11:30 pm to you all dressed up in your mascara and then told you it was your fault. I don't understand how you don't see how that is emotional abuse towards you.
He has trained you to accept being treated like dirt, and as if all the world agrees with him that you have somehow done him wrong if you don't applaud his narcissistic behavior.
I'm going to take a wild guess here that when he tells his work buddies about you and "they all agree" that YOU are the problem, that the way he phrases it is, "I offered to stay with the kids so she could go out, but she wouldn't work with me on the schedule, instead she expected me to cancel my plans with my friends and leave them in the lurch, she's completely unreasonable."
I don't want to be the voice of doom, but this man is out with his friends, most nights, until all hours, and for many entire weekends, at "festivals." You are worried that if you break up, he will find someone new, but how do you know that he hasn't already done so? He certainly has the opportunity, and he seems to have zero loyalty to you, so what would hold him back from having one or more affairs, or even a long-term girlfriend?
You seem to be basing your entire self-worth on him loving you. I get that society gives men a lot of room to be total jerks and yet still be validated, whereas women are condemned for any failure to be beautiful, great moms, high flying career women, perfectly adaptable wives who provide amazing intimacy on demand (no matter whether they receive the same in return), etc. But in my estimation, this man isn't worth 1% of what you are worth. You deserve better than him. You really do.