OP after your recent updates, it is clear to me anyway that you are not ready for this kind of dating.
You are far too emotionally fragile and your perspective of what is 'rude' or bad behaviour is skewed.
I think he ought to have mentioned that he had another event on later in the evening. BUT I don't think it's the massive deal you make out.
He did give you 5 hours of his time.
You don't seem to be able to see that you are reacting this way as someone did something that messed up the plan in your head.
Your plan to progress to sex.
You were hoping to move things on and he wasn't on the night.
I am sure that he's picked up on your huffy behaviour- not telling him you were safely back home.
Leaving someone worrying you might be NOT home safely is far worse than leaving a date at 11pm to go to some pre-arranged, IMO.
I think you need to step back from men and make new friendships of men and women, get your self esteem and confidence sorted, keep going to your therapist, and wait until someone comes along through a hobby or a group, rather than doing OLD.