Give it a go. Return after your baby and see how you feel. I went back part time 3 days a week, secondary school teaching.
For me, I didn't enjoy it after I had had DD - but for various reasons.
The holidays are a bonus but there is little flexibility in term time, so unless you have a very good head you may not be able to go to school plays, sport's days and assemblies, etc.
I found the stress and workload were harder to deal with when I had DD to look after as well, especially the day to day stuff. And I become less willing to put up with certain behaviours from children and management alike.
In the end, I left teaching when DD was about 3yo, after teaching for 10.5 years. I don;t regret the decison.
For about 2-3 years after that I worked in prison ed and qualified as an advice and guidance worker there. Was lecturer's pay so slightly less money than teaching. I was no longer on school holidays but had 12 weeks holiday used when I chose, and more flexibility over changing my days and hours to
be able to see DD in school assemblies, etc.
After that though the commute was getting tiresome - was over an hour each way. So, after chats with DH I left. I was able to do so because my DH was/is earning a much higher wage than I did, or ever will do.
I now work as a year 1 senior TA and I love it. I get paid a relative pittance compared to what I could earn as a teacher, but I get to do all the fun bits, have the holidays, have far less workload and although it can be stressful, it is less so than if i was the teacher. I now have far more energy and quality time with my DD, now aged 8y.
One day, when DD is olderm I may do a return to teaching course and go back as a primary school teacher. But not til I know I can give it my all.
The one thing to remember with teaching is that if you don't want to do it 100% it will be far harder.