I'm really sorry that you are being bullied by your boss OP, is this person the head of your company, or just a departmental boss. If departmental, then I'd be inclined to try making an official complaint to whoever is above him/her, although all too often in these circumstances, things never end well..
However, having been in a similar situation myself, where my DH came home to find me slumped on the floor in the hallway, sobbing my heart out, following a horrendous afternoon in the office, I can totally understand your need to get out. Although I do hate to think that you might be jumping from the frying pan into the fire with this lot.
I was actually really lucky, as having talked it all through with DH and my Mum that night, I went in at 9.00am the next day, and put my written notice on the boss' desk, having decided that as I had several irons in the fire, with other job interviews either under my belt, or upcoming, there was a good chance I'd get offered something before my notice period was over.
To my surprise, I received a phone call only half an hour later, from an agency, who offered me a job which I'd interviewed for a couple of days previously, and while it was less money, it proved to be the best move of my life! As you can probably imagine, I did a very happy jig all around the office, 😂 and needless to say, accepted with a very grateful heart!! So whatever you decide, I understand, and truly wish you all the very best. Do come back and let us know how the 'Trial' goes.