I hope I didn't upset you, but you do need to see it for what it is. Sadly, so many of here had already guessed what you have further opened up about; that he has been sexually pushy and demanding (abusive), can be controlling, you walk on eggshells to prevent him from losing his temper, etc., etc. Why would we know this in advance? Because it is all classic Abuser stuff; it's like these men are working from a script. What's also part of their script is making sure everyone outside the relationship thinks he is a wonderful, caring guy and the best dad ever. And of course he is nice sometimes - if he was just awful every day, you would never have got with him or stayed with him. It's part of the brainwashing, because the nice times serve to make you confused and wonder if you're imagining it, being over-sensitive, unreasonable, weird, etc. But you can't be in a relationship where it's only okay if everything is going his way and making him feel superior.
Also, the letting you make the day to day decisions and control all that stuff are not signs that he isn't controlling; it's either laziness or thinking that domestic plans are women's work and therefore beneath him. It's symptomatic of a sexual abuser, IMO.
As for his illness, well, I am disabled due to long term health problems and in chronic, daily pain and I have never been nasty, controlling, raped or abused anyone. It's just not an excuse, full stop.
BTW, the most important thing you need to know is that it doesn't matter what anyone else in RL thinks. YOU know he raped you, YOU know he has destroyed the relationship forever with his abuse and above all - I hope - YOU know you deserve so much better than this. I also bet that when you leave him ( please make it when), people will start opening up about their dislike of him and suspicions. Men like that can't fool everybody all of the time. And no-one who loves you could ever want you to stay with a man who would rape you... and announce his attention to rape you, at that 