DH and I retired in our early 50s OP and live a very contented but extremely frugal life. No mortgage here either. We downsized to release some capital and now live what feels like a very rich life on about £20k a year between us.
We're early 60s now and our days are filled with volunteering, gardening (we grow our own fruit and veg and keep hens), art, craft, walking the dog miles each day, camping in the UK, wild swimming, charity shop and vintage market clothes and furniture, books from the library, mending things. Our biggest expenditure is food.
We live in a part of the world where lots of people come to live a life like we do. There's a lot of trading of skills/labour and bartering. We help a farmer with various seasonal tasks in exchange for our winter logs. We have to chop and transport them.
Things are expensive and you have to be resourceful, learn new skills (UTube). Happier now than I ever was and that moment a PP mentioned about wanting a 'decent holiday' (??) has never kicked in. A cruise or long haul or anywhere we can't take the dog would be our idea of a nightmare. Days out are with a picnic and flask, we are NT members so one expense a year buys a lot of days out. Our van is decrepit but DH has learned to fix it.
We can't keep up with the Joneses....but we don't want to. I can't tell you how key that is to being able to do this.
Could you work out what you spend now, then make any cuts you can. Build in a fund for things like your oven blowing up and see what you need and what you'll have.
We both have trades so for a few months a year we do a little work to make ends meet - we never make enough to pay tax but it keeps us solvent. That might be a halfway house from where you are now to where you want to be. Good luck - in my opinion it's worth the effort.