It doesn't matter what anyone else thinks as long a single you've made the right decision for you.
I think people who go on about the 'buzz' all the time don't really help because the reality isn't like that in any job. It's not all educating Essex rewarding moments and in your training year it's really tough at times.
Teaching is a mixed bag but I do think it makes a different what you school is like.
E.g. My last week looks like this (middle leader):
Filling in more data for SLT
Safeguarding concerns
Dealing with a child wandering the site
Marking marking and more marking
Keeping notes on intervention without writing 'child doesn't need intervention. They just need to bloody work'
But, it also includes:
A couple of really meaningful pastoral conversatoins
Planning a great visit for ks3
A week to great year 11 lessons where they've made me laugh
Watching y7 'get' a tricky topic
Talking about post 16 with GCSE students
Having a laugh in the staff room (usually about things SLT mention to you on Tuesday that they ideally wanted last Friday!)
You have brilliant days and rubbish days, but that's any job.
As a mentor, I would advise caution dropping out during the first placement. You're new to the job, finding your feet, there's loads to learn so feeling overwhelmed is kind of normal.
But, if you need to and you think that it is the right call for you to make then you absolutely should do what is right for you. Maybe give it some thought for a while and see how you feel.