This is a wwyd really. What would be more important to you?
Family with 2 dc. Options are, live in large ex council house (didn't buy it from council before I get flamed), nice house, ideal size, suited to families needs, could potentially completely refurbish and pay off the mortgage in the next few years meaning being mortgage free before 40s. The area is not the best but not the worst, on a busyish road, schools reflect the area as in a couple of good rated schools and a couple of really bad, inadequate schools. Crime rate is probably quite high. Although you don't generally have any problems and it's not far from nicer places.
Or, move to naice area, probably similar sized house but in a quiet cul de sac, prettier houses, potentially better schools, just a generally more scenic, quieter place to live, but would mean taking on a large mortgage, 25 year term, less disposable income and the house wouldn't be any better inside.