Absolutely not your fault OP. Being invited back to someone's house after a date is not a definite 'yes' for sex and even if it was originally a possibility, you can change your mind at any point.
He shouldn't be dating if he as an adult cannot manage his own disappointment. Toddlers throw strops when they're disappointed by someone because they aren't yet able to counterbalance the emotional pull of imminent wish gratification with the consideration that this is an intersubjective operation. The latter just isn't there yet, and that's normal for non-adults. But well-developed adults push the dogged pursuit of their wants to the backs of their minds and prioritise empathetic response automatically when they see that the person they're dealing with has different wants. Wants & empathy should already be balanced, the former shouldn't be given free reign to wholly drive action. Single-mindedness in this context is hugely immature (and for what? let's face it, it's not a drama is it, being denied sex with a virtual stranger!). Picking up on even the slightest hint that someone doesn't want sex should be enough to radically shift the balance so that the possibility of sex is immediately mentally put on hold/nullified & the not having sex therefore does not ellicit any frustration, and so that wish fulfilment is diverted from 'having sex' to 'making sure this person is comfortable'.
For comparison, I went on a first date a while ago where we wound up at mine. The pub was closing, we were in mid-conversation, I live nearby...I did know that she was up for having sex, but all that happened was that we had drinks, talked sitting on my bed and she left at 2am. I just didn't want it in the end. She did not get angry, she looked a little hurt, we hugged goodbye. Yeah I knew that it must have been confusing for her and felt bad, but ultimately I changed my mind and I'm not going to have sex with someone to save their feelings. I also recently had sex on another first date, we went back to hers, I honestly expected nothing because all she'd mentioned was having another drink.
If he did feel disappointed (but he wouldn't really have had the headspace for that in the moment if he'd been prioritising this empathetic response), he should have hid it, you don't expect others to take the emotional hit. At no point during the evening - the invitation back to yours, the taxi ride, the getting in bed - did you enter into a contract where you owed him sex, OP. In this context, I don't think the phrase 'leading someone on' is even very useful, since no one should ever take an indication that someone might later on be up for sex as written in stone. In most situations involving sex (unless you're deliberately being devious) I think it's a pointless use of the term as it's one used specifically to suggest that someone who doesn't follow through on signals they emit has broken a series of concrete promises, whereas re: sex, the slate of expectation should be wiped clean with every second that goes by - what might have been valid 10 mins ago can't be expected to be valid now. You can't hold people accountable to past expression of intention here. I also think to a large degree we can ourselves work to prevent the hurt that goes with 'feeling led on' by adjusting how we read signs and not assuming that XYZ behaviour from our date means that we're definitely in there.
Hope you're ok and sorry it didn't end up being a good night. If you feel up to it, you could (very succinctly) let him know that his behaviour was not on so that he has that in mind for the next person he dates.