You are probably looking for advice in the wrong place, the age demographic here and the marital status will mean the advice you receive is much more dump him because he is a waste of space than work it out.
Look, only you know whether he is a waste of time, or are you being too sensitive? Just talk to him about it, no pouting or games, just talk about how it made you feel. You’ll be able to tell from whether he is receptive and whether he does it again, if you should be with him.
I do think though, if you are both under 25, that it is also a sign of low emotional maturity, it doesn’t mean he won’t be a good man, or you won’t stop sweating the small stuff, it just means you still need to work out how to be in real, solid relationships. If you are older then it is more likely a sign of the type of person he is.
The only way to work it out is to talk, trust your gut, listen to the red flags, demonstrate and stand by your boundaries, and don’t be with someone unless they improve your life. Hope you work it out.