[quote cocavino]@NotresDames yes, i have had a therapist. She thinks I am ready to date, but cautioned me to take things slowly.
My ex systematically withheld affection and it really, really hurt me. It's definitely true that I should not jump into bed with anyone too quickly. I just feel lonely and unattractive[/quote]
I think that your date's behaviour on this occasion was incompatible with your current psychological landscape regarding dating.
It doesn't mean he's done anything wrong. It doesn't mean you've done anything wrong.
You've got 3 options: put this out of your mind and keep seeing him; put this out of your mind and stop seeing him; talk to him about it.
If you can't talk to him about it, your relationship isn't close enough to be ready for sex anyway (assuming you're dating because you'd like a relationship, not a ONS)
Your feelings of loneliness and unattractiveness have nothing to do with this guys actions. He can't 'make something worse' unless it's there already. His actions aren't in charge of your self image.
He's something of an unwitting and innocent bystander to your internal turmoil, it seems. He didn't do anything wrong, he just did something that didn't sit well with you. Don't blame him; look at why it's affecting you.