Unless you're lucky enough to have a job you're passionate about, the idea that work is a source of fulfilment or the purpose in life is very toxic. Most people work to earn the money they need to do the things they enjoy outside work. Work to live, not live to work and all that.
I'm child-free, and if I didn't have to work I'd never be bored or directionless. I wouldn't spend my time doing any more housework than I currently do, either (a slatternly bare minimum). I'd read more books, see friends more, exercise more, I'd get back into organising activist campaigns rather than just showing up randomly when I'm free. I'd be a more interesting person who contributed more to the world than I was when I was pushing paper around in an office job.
That said I've made a conscious effort to get a career in a field I'm passionate about, and even if I didn't have this job it'd be something I invested a lot of time in.
And ultimately the thing I couldn't hack isn't the "life of leisure", which is idyllic and certainly not something to look down on, but doing it on my partner's dime. That would feel a bit like taking the piss out of him while also putting myself in a precarious position.
As for people I've known who have done or are doing this - they range from people who make the most of it in terms of changing the world and living their best, most fulfilling lives - those women I respect a lot. And then there are the ones who have all the time in the world and yet still don't know enough to hold an interesting conversation or talk about anything except their outfits and their housekeepers. Mind-numbing company and not people I choose to have in my life.