So many things...but to answer your question, no it’s not your fault because you ‘led him on’, you wanted to have sex with him. However, you changed your mind and didn’t communicate that with him. Instead of ‘just not feeling it and letting him do it anyway’ you should have told him in the taxi you’d changed your mind, or clearly in bed when you weren’t feeling it anymore.
It was only a second date, it’s not much more than a ONS, from his point of view I don’t blame him for getting a taxi home - you seemed very ‘up for it’, he was asking if you were ok, your idea of ‘rough’ might just have been him trying different things to get you more in the mood. He was probably embarrassed that he couldn’t get you interested.
I don’t think either of you were wrong, just both drunk & pissed off.
Only you know if you want to see him again, if you do (and he does) because you like him & think it could go somewhere, then make it clear sex isn’t on the cards right now, see how it goes and next time make sure neither of you are too drunk - see how it goes. There’s nothing wrong with drunk sex at all, but it’s already gone badly with him in that situation, so I’d avoid it.
Decide what YOU want, then send him a text.