Questioning everything you do is the part that takes a long time to undo once it's properly set in, and from what you've described it sounds like it's already setting in, which is the bit that would concern me more than the management problems themselves. You can leave a bad manager. The habit of second-guessing your own judgment is harder to shake, because it follows you out the door.
The "dream company" thing is worth sitting with, though, because I think it can skew how you're weighing this up, it gives you a reason to keep reframing what's happening as a problem you should be able to solve, rather than a situation that might just be what it is. I stayed too long in a job once for roughly the same reason, not dream company exactly but a manager I kept thinking would eventually be consistent if I could just get the communication right, and she never was, not because she was awful but because she genuinely couldn't see what she was doing. The framing of you as "difficult" when you push back is a specific thing worth noticing, because that one tends not to shift.
I dont know if you're actually asking whether to leave or whether you've already made the decision and want someone to tell you it's not mad, and I think the answer to what you should do next is pretty different depending on which one it is. If you haven't decided yet, the mental health piece is real and it shouldn't be the last thing on the list. If you have decided, then you probably already know.
Whether it's mad, no, I dont think so at all, leaving a job that's doing this to you isn't mad just because the company looked good from outside.