It sounds gorgeous! 

As someone who felt a bit like you did a few months ago and still do on and off I think you will be alright.
Yes the road sounds crappy but you'll adjust to it.
We have a Victorian house too and it's only got a few features left - one fireplace, sash windows (this matters to me - it's one of the few we viewed that did!) and some nice tiles downstairs.
The street is lovely and the neighbours are lovely but it's in a pretty run down area and a long way, like you, from schools and what we are used to.
We found a place at a school not too far away at Easter and then ds1 got into a school a few miles away, last week - all works out Ok. I miss the old house, the old town, but we have so much more room here and I feel Ok as long as I don't think about it too much - but we did buy a pig in a poke, really, didn't look carefully enough at viewing, we have surface flooding in the garden too, had a whole rewire, replumb, roof repairs, etc.
It is exhausting and we still have no kitchen or proper bathroom...I get depressed but then we make a little progress and I cheer up slightly.
I am very envious of your established garden. We had two small trees and a privet bush, plus some nice flowers here and there but it still looks like a new build - have stuck 20 or so trees in now but a long wait till it grows.
I would LOVE to get my hands on a proper, established garden. The joy of clearing away the weeds and finding trees and flowers you never knew were there.