If it's any consolation OP DH and I were in a similar situation many years ago.
We offered asking price on a property and all was proceeding well - until the surveyor rang to say he couldn't gain access to the property.
The sellers weren't in despite it all being pre-arranged.
Cut a long story short they took the property of the market, dumped us and the EA only to re-list 6 months later at a higher price.
It was a shitty time, but 2 months after the sale fell through we found another property that we fell in love with and has in hindsight turned out to be a much better fit for us in terms of location for work/schools and general village amenities. The vendors were also lovely. No fuss over the sale and when we moved in the house was not only spotless but they'd left a treasure hunt for the kids to find moving in gifts to get to know the house and a bottle of champagne in the fridge.
The original house took another 6months to sell after it was re-listed and then went for only 5k over our offer by which time we were settled in our lovely new home.
The other upside is that our home has risen much faster in value than the original house due to location so it's been a better investment as well and is now worth considerably more than the other property.
As horrific as it was at the time I'm now glad it happened.
Buying a home is an emotional decision but I think you have to harden your heart and realise that there are many perfect properties out there for your family and that you will find one of them (minus the shitty vendors).