I'm really sorry this has happened to you.
I have a close friend who was raped by her husband when he was high on cocaine. It took her about three weeks to tell anyone and then she came to speak to me late and drunk one night and it came out. I knew her ex pretty well and had always got on really well with him and was shocked. He said to her he'd been so out of it he couldn't remember anything and couldn't believe what she was saying was true.
I'm going to say to you what I said to her then. You are not going insane, this did happen. It is not kinky physical sex but rape by the person you need to trust to keep you safe. If you stay with him it might never happen again but you will always be wondering whether it will.
The only thing you have power over in this situation is to make sure it doesn't happen again. If this was a family friend would you be alone with them again? No. The fact it is your husband makes it WORSE than if it was a stranger as he is supposed to protect you from harm.
You need to leave. Not tomorrow or next week, but now. Go to your parents or your best friend. Yes he might be a lovely man and they may be shocked (I was) but remember they know you too and that you would never make anything like this up.
My friend did split up from ExH and said to most people he'd become violent while drunk. That was a way of not revealing the full extent but explaining she didn't feel safe. It's taken a lot of counselling but she is now getting there. She had a new fella and has gone back to uni which has given her a real boost..
You will get there too,but you really do need to take the first step and protect yourself. Really thinking about you Orkward.