We're 3 mile from nearest village, at least 10 from nearest town.
Love it. No major issues bar those flagged up in building survey.
Our septic tank is in someone else's field - originally all one plot but fields sold off over the years so we had to make sure there was an easement in place so we had right of access to empty, etc. No problem. Solicitor sorted prior to purchase.
Get a survey and good solicitor so there's no surprises with property, boundaries, access, etc. Eg. Does anyone else have a right to use your lane? Septic tank accessible?
Our other main issue was school transport. Luckily the bus to daughter's school (10 miles away) stops right outside our house. It would have been a major pain in the backside if it didn't.
The road isn't gritted so in bad weather it's really not accessible - school buses won't even attempt to drive it - so we've been housebound a time or two. (I consider that a plus point. 
)
Unless you know you'll always be taking kids to and from school check out bus services and transport options for them. It's definitely not handy here. If daughter misses her bus (there's only one) we have to take her/collect her which isn't always easy.
Feel very very safe. Our youngest was a bit freaked out at just how dark it got at night. You can't see past end of your nose! A good outside light helps if you need to go out to bins or car or whatever.
We definitely found living in a residential area handier but I don't regret the move. Being out on your own in the country offsets any slight inconvenience. And you're only a mile from town so not out in sticks so your petrol costs shouldn't go up too much.