URGH, some men think they are soooooooo funny. 
It was inappropriate, but sounds like something a few men I know would say. They think they are hilarious, and when they are called out, and someone has a go at them, they come out with the 'you have no sense of humour' line! I have known men say stupid, unfunny, rude things, and be laughing til they cry at how funny they think they are, and everyone around them is just cringing, while they say' you can laugh it's ok, ba ha ha!' They seem oblivious to what a cunt they look like, and how they are embarrassing themselves, and making people around them feel awkward.
Barking at you and saying you need to grow up, along with the rude joke in front of what was a very young woman, makes him seem like an obnoxious, rude twat.
Is he rude and obnoxious normally?
I don't know what to suggest really - except saying 'you are a DICK' very loudly, next time he says something.