Nah 100% bin him off regardless of his next move. He might suddenly become affectionate again when he next fancies getting his leg over.
But this is either his post coitus style - which doesn’t suit you. Or he has a general weird view of women once he sleeps with them. Either way it’s a hard no for me.
The first time I slept with my partner (also date # 3) it was afternoon and I was the one who had to get back to my kids. Second time - we arranged a date and I said I’d be able to stay over on a Friday night. He was so happy and said brilliant we can spend Saturday morning in bed. And we did - obviously having more sex but also cuddling, chatting, kissing drinking coffee. It was lovely and we still do that 4 years on.
I am sorry that happened to you. I’d feel really upset too.