My advice for what it's worth (and I am an architect), is to get your planning application submitted and decided, and the part ways. There is so much chemistry involved in the architect client relationship for private residential work. It sounds as though you no longer trust him or her to deliver either what he promised, or what you understood to have been agreed, and the planning process is relatively stress free compared to what lies ahead!
I would also advise not letting this experience put you off architects altogether. They do add value where a plan drawer won't, in terms of design etc. They also (should) hold a level of insurance and will act as Contract Administrator, in a way that a plan drawer will not do.
If you see yourself as designer of this project, and are happy to Project Manage the builder and deal with the contract, by all means, hire a plan drawer to get your information down on paper. But I would warn you that I have picked up the pieces on a number of occasions where the role of the architect (and a decent one who does his or her job properly) is totally underestimated. Project management and/or contract administration are skilled jobs that require experience to get right, so if you are going down that route, I would advise you get someone with the correct skill set in to help you.
In my experience, an architect can save you a great deal of time, money and hassle. The current architect you have doesn't seem to be doing that at present, so I would part ways, but don't give up on the profession altogether.
Hope that helps!