I can tell you this for one thing. I was in an infants school up until I was 7 with my brother who was 2 years younger. My DM suddenly decided that we weren't going to the junior school where all our friends were going because she was a bit of a snob and thought it wasn't a good school, which she was probably partly correct about.
So we went to the local other primary school which was 5-10 minutes away from the infants school, saw it and started. My brother did well as he's always made friends easily and had only been a year or so at the infants school before he moved. I on the other hand found it hard to make friends, though I did make 2 new best/close friends and I was friendly with other children in the class, a few of who I had playdates with. But then something happened, I won't put it here, but it rocked my world and was one of the reasons why I wanted to leave, it involved a boy in the year above me. My class teacher on leaving said I was an unhappy little girl, I'm not surprised though, because one of my best friends could be quite mean, a Jekyll and Hyde character. I'd stayed best friends with my 2 best friends from my old junior school and saw them a lot.
I returned to my old junior school at the start of their second year and we were treated like heroes and welcomed with open arms, and our education was actually fine.
So, I would not move your children from this school unless you really really have to. One might be resilient and cope well but the other might not. Don't think they'll be like you and cope, children have to learn to be resilient in these situations, it's not something that's inbuilt into their psyche. You'll find another way to cope. My brother's ex-wife when she had to work nights, employed an au pair to look after her 2 girls both under 10, it worked out really well for them.