I don't really think so. Data shows that switching agent can decrease your likelihood of selling by something like 30-50%. Excuse me if I can't produce the exact figure; it's from a weekly video produced by an industry chap who does a weekly stats show for EAs.
I think unique properties always take longer to sell than cookie cutter houses because people love them, but have to talk themselves into buying them because of the 'but how can we' and 'what if' questions.
If it's a diamond in the rough, buyers may also be considering resale value, and that could be holding you back in a falling market.
I would say your EA could do better job of vetting viewers. If your buyers gave them an agreement in principle showing they could borrow up to, for example, 650k and your house is for sale at 600k, you should assume the actual amount might be more like 400k, because the 650k has to meet every single set of lending criteria. There are also an awful lot of people out there who think they can borrow far more than they actually can, because they last got an online quote six months ago.
Agreement in Principle - I am referring to the generic ones you can get generated instanly by an online broker. However, if a buyer produces a decision in principle which is produced by a lender (that can also be done via a broker who plugs the info into the lenders systems), some of that initial advanced affordability criteria will have already been done. So, if they have a DIP from July, it should be taken less seriously than a more recent one, because lending criteria change from month to month.
NB: sometimes, they are called the same bleeding thing!!
Agents should also be checking proceedability. If they say they have sold their house, where is the proof? If they say they are living in a rental, where is the lease showing one month's notice? If they say they have no chain, does the EA have proof or believe them?
The EA needs to handle your future buyers as though you are about to hand over your firstborn, and it sounds as though they are letting any old Joe through the door who claims to be Mary Poppins.
Serious buyers should not mind being asked to provide proof.
If there are any major weird quirks the house doesn't show or describe on the ad, the EA should be warning them during their enquiry call. I know someone buying at the moment who was warned by the EA 'it is cheap but you should be aware, you are going to have to sort out the electrics.'
It's unorthodox, but they priced up all the work before they even got through the door, and how their offer has been accepted.