I've thought about this too, OP. I'm an antisocial person and no longer enjoy city nightlife now I'm nearing 50.
I live in Liverpool which is getting bigger each year with lots of city centre high rises being built. This has meant the population is way more than what it used to be years ago. I lived in London for 4 years and always felt claustrophobic because of the population density, noise and pollution so I moved back home as I liked having the convenience of the city nearby but one which wasn't as big and overpopulated as London.
However, there has been a massive expansion in building in the city centre, with multiple high rises etc. I live in the suburbs but even here the population is growing as any disused buildings are converted to flats, and older larger family houses are also knocked down and replaced with boxy tiny badly designed flats. It means that what I enjoyed about the city has gone. I generally don't relish it anymore, there are people EVERYWHERE, especially in the summer when there are a lot of tourists.
Traffic flow used to be much easier than London and you could always get a seat on the train if you commuted into the city centre (and park either in the station car park or on the road outside for free). Now, you struggle to park anywhere near the station. The roads are really busy, I'm sure it's stressing people out more as drivers seem more aggressive and selfish.
During lockdown the parks were literally swarming with people whose usual weekend haunts were closed. It really opened my eyes to how overpopulated the city is now. One side of our city ends in the river so it's not even as it can grow outwards in a circular fashion. It feels hemmed in now. Don't get me wrong, it's still way less populated than London, but I just find that people irritate me more now, and there is more antisocial behaviour.
So, I dream of moving somewhere quieter and calmer. Yet I stop to think about what I like about here: 10 mins from a leading children's hospital, 15 mins from a proper A&E and leading specialists in all fields for outpatient appointments. 2 mins from a large 24 hr supermarket which stocks a wide range of more exotic foods. Multiple late night opening shops. 10 mins from an out of town retail store, cinema etc. 3 universities. etc etc.
While the noise from some of my less thoughtful neighbours drives me mad, I like having the comfort of hearing someone nearby, especially if there was an emergency - I know any of them would help out.
Rural living is lovely, I'm sure, if you can find the perfect set up so that you've got peace and quiet with nice neighbours at just the right distance to provide support and a community feel without feeling hemmed in, but also have good access to decent shops and medical facilities. I'm way past nightclub age now but I also appreciate having decent restaurants here. Pub food is lovely in a rural community but if it's your only choice and the menu doesn't change it can get a bit samey, and is often quite traditional food.
I've thought about buying a caravan somewhere rural but not sure we would have the time to use it often enough to get the benefit.
I know exactly how you feel though. You just want a quiet life.