I definitely agree you need to change instructor. I had three instructors- the first was horrible, the second was ok but not reliable and not thorough, the third was absolutely amazing.
I was considering learning automatic only. I disagree with everyone on here who is suggesting you will be severely limited if you only do automatic- yes it obviously has limitations but realistically how often are you ever going to hire a car? My parents have been driving for 40+ years and hired a car on holiday once, that is it. It depends on your circumstances and in some ways on your age- I learned recently in my early 30s and to be honest, it is not driving which is completely restricting, not whether you drive an automatic or manual!
In the end I persisted with manual, as certainly in my area it can be incredibly hard to find instructors who teach automatic, and I also found such a wonderful instructor who was reliable, a great teacher, and she was so kind and understanding of my nerves. I somehow passed first time with two minors- I lost track of the lessons it took to get me to that point and it was all worth it.
Keep going OP, you'll be able to do it. If you're in the south west, PM me, I know it's a long shot but my instructor was great, you need someone like her!