Yes, have been there. It's truly awful. In my case, I used to do a job which involved being responsible for a team of staff and this one particular team member caused multiple issues among a large number of colleagues, and on one particular occasion, I walked into the room where he was working to find him being aggressive with body language and verbal language towards another staff member.
I spoke with both members of staff, and the one who was (not for the first time being aggressive), didn't like he had been caught out so lodged a complaint, alleging that I was racist. The next month was both ridiculous and incredibly stressful.
He then embarked on a smear campaign which involved making up lies about my sex life and spreading these rumours around. I just had to tolerate it, couldn't respond, and spent time at the end of each shift writing a report of how the day had gone! I can't bring myself to re-live it all right now, and go into the details, but whilst no action was taken against me, I ultimately left, albeit over a year later after this incident. I never felt like I fully moved past it, and felt incredibly ineffective leading a team of staff from that point on. Quite frankly, it was incredibly embarrassing.
Never again will I take on a role where I'm responsible for staff. It's not worth the shit pay, stress or humiliation. In short, it was absolutely bullying, and it was not me who was the bully!
I now work in a very menial role at a different company with obviously less pay, but you know what, it's a million times better than leaving work shaking and being filled with anxiety every single day.
OP I really hope for a successful outcome for you. Get your name cleared first, then see how you feel about leaving. You'll get through it. Feel free to PM me if you want any moral support.