We lived in that area of Somerset (we lived in Wells) for about 3 years about 40 years ago. At that time Frome had some social problems & was rather run down, I have no reason to think that things have changed. It's also rather isolated (as is much of Somerset) in that there is not much public transport. I would think that people would prefer to pay for a holiday let somewhere more accessible & more aesthetically pleasing.
If you are 'wedded' to moving to Somerset, you might prefer to spend a bit more and go for the Taunton area. If you're looking for a holiday rental, I'd go for somewhere closer to the coast in Devon.