There are things you can control in life and things you can't. It makes no sense to envy the stuff you can't control. And if you can control it, change, then you won't envy it any more.
I have friends in a better position than me and friends in a worse position, but it doesn't seem to have much bearing on their happiness either way.
As an example: one friend owns a Spanish restaurant. It is tiny and cute and moderately successful. She runs the restaurant, husband cooks and they are also both artists and when it's quiet they do art and run classes. It is honestly my dream to own such a place. But she CONSTANTLY complains that her parents nag her about her life because they're the ones funding the restaurant and who gave her the capital to start it. She is beholden to them and she has no sense of achievement. She is one of the unhappiest people I know (to the point where I keep my distance these days). So I could be jealous cos she is living my dream, but you know, it's not how it looks.
As for me - I have friends who are always saying they are jel of this or that, but they do nothing to achieve things or they don't see that it's a compromise. eg My husband and I cycle a lot - we usually cycle, bring our tent etc, camp, then cycle back next day. The number of friends who are WELL JEL and WOULD LOVE to do such a trip is huge. But when I say 'ok, then next time, come with us, we leave at 5AM and cycle for 25km-50km and then the same on the way back', that's 'too early', 'too far' etc. Well, then you wouldn't LOVE it, then! Part of the trip is that you have to sacrifice going out that night, you have to get up before sunrise and you have to cycle a lot!
Or I have friends who are SO JEL that I can speak another language fluently. Yes, I am proud that I can, but it took months and months of never going out, getting up before work every day to study for an hour, not drinking, not watching TV etc because I wanted to be able to be fluent. I didn't just wake up fluent one day. But they don't want to sacrifice their lie in, their Friday night out, chilling on the sofa. If you're happy doing that, that's fine, but don't be surprised when you're not suddenly fluent in a language.
It's the same for you OP. If you want to bake bread, bake it. And if you don't have time or energy or whatever, then either make time or accept it. But if you go through life always wanting something else, you will always be miserable.
What amazes me is how many people say yes to shit they don't want to do. I don't give a shit about offending anyone by saying no to them. That's their problem not mine, I'm not doing stuff I don't enjoy to make someone else happy. I don't give a shit if someone else thinks my lifestyle is shit or boring or whatever.
And I think that's a massive part of it. People don't WANT to be in the ratrace, but they're SO scared of what everyone else will think if they drop out and become a cleaner. They don't want to go to that party, but they're scared they'll never be invited to anything else again if they say no. They don't want to pay for a massive mortgage, but if they downsize, they think everyone will judge them. I honestly pity people like that. It's so childish to worry about that kind of stuff to any kind of excessive level. You're born, you live, you die, and no one is going to remember that you had a massive house and a BMW so you might as well stop getting into debt to buy all that crap.
EVERYTHING in life is a choice and every choice has ups and downs. There is shit we just can't change - I wasn't born in a rich or even middle class family and that put me at a massive disadvantage, but I can't change that. I could look at my posher friends and envy them, but what would that achieve? It's not going to change and half of them are miserable anyway.
Besides which, I would no sooner waft about baking bread and making candles while my husband works his ass off than dance naked in the high street. I find that a really horrible way to live and imo the husband ALWAYS ends up resenting you, even if he says he won't. I think there's something dehumanising about spending someone else's money.