DP had sex with me the Sunday before I posted, I'd said no and I'd tried to stop him
That's not having sex with you.

He's agreed to give me some space for now, but I think maybe our versions of space are different as he's still over every day
He's agreed to give you space after he raped you, but is still violating your boundaries, getting in your space when you've asked him not to.
There's been other things that can come across as maybe a bit emotionally/mentally unkind
Feel free to tell us about these incidents if you feel able.
any time I get upset at something he tells me that I'm having a depressive episode and I need to go back to the doctor
That's emotional abuse, designed to make you doubt yourself, blame yourself and put up with stuff.
maybe I am just overly anxious and reading too much into everything
No, you're not, you're right. x
maybe speaking to the doctor again would be a good idea too
You could if you like, to tell them your partner is falsely trying to tell you your concerns are because you're mentally ill whenever you question his behaviour, and that he raped you.