I currently live in a little village called Greenfield in Saddleworth. It would be some people's dream but I HATE it. It's lifeless, boring, isolating, inconvenient, I have to get a TRAIN to go to the local supermarket. The train goes every hour. I live on top of a hill. I'm miserable. Absolutely miserable and can honestly say I've never ever felt more lonely. I can't go anywhere without a big hill and feel trapped. Almost like I'm in prison here with my Son. I'm desperate to move nearer my work (South Manchester) so that I don't have such a long commute, we can travel to places by walking and bus, can feel less trapped and isolated and can make a life somewhere I don't feel like I'm suffocating.
Of course I'd love to be in a desirable area but so far I've had no interest from anyone in a nice area (council homeswap) so I've accepted I will be looking at a central but slightly rougher area.
Greenfield is boring as hell (to me, sorry to those from Greenfield) but it is safe. Very low crime rate.
The places I would be moving to would be anything but.
I have had interest from people living in Gorton, Hulme and Rusholme among others. All areas considered rough.
Most people have told me not to do it. That greenfield is nice, quiet and safe. Good schools for my Son and once I can drive I won't feel so isolated. But I honestly think I will. I live so far out from Manchester. Hate living semi-rurally and want to live in the city. If I wanted to live in the countryside I'd be back home in the hills with my Parents. 
AIBU to move from a 'nice' rural area, to a rougher city location for the vibrancy, amenities and transport links?