You need to do whatever is right for you at the moment.
It's awful. This will be of no comfort to you but it's far worse if you go through the absolute trauma of a trial to hear that 12 of your peers don't think it was rape.
For what it's worth, I don't think it's the Police that are at fault as individuals (some are shit obviously but not all) .The coppers I know (I work in MH) suffer MH problems from the injustice of the way the law works and in your case - they believed you. But they also know a lot more about the legal system than you do.
When I was a community MH nurse I worked with a young man accused of rape. His solicitor advised him not to give a Police interview when he was in custody. He had mild LD and acting as his advocate I rang her to ask why she'd suggested that and she said ' because he'd incriminate himself'. When I asked if that was because of his LD and would be inaccurate? She said no, she practiced giving the statement with him and he made it clear he knew the victim didn't want to have sex. I admit I pressed her quite a lot before she said all this, as MH professional I'm used to asking the right questions to get to what is really happening.
He was eventually charged a year later and was convicted but my interactions with his solicitor fucked me up for a long time because it made me question everything about our legal system.
I believe that everyone is entitled to a legal defence and should be protected in law but not when the legal system (Courts, barristers, solicitors) bloody know the person is guilty (by their own admission).
But then it's hard. Many people have confessed to crimes they didn't commit due to pressure or MH issues. It's difficult to know where the line is (i've just talked myself round in a circle, I know).
Sorry OP. You will get through this. I sound glib but I've BEEN there. It's not about him any more, it's about you and your future.
Stay here with us. We believe you. We'll support you as much as we can.