I think everyone could get what they want here. Boys go downstairs and watch TV or play XBox etc with the volume at a reasonable level, DH and DD get a lie in, if OP wants a weekend lie in then take it in turns with DH.
My DDs are 18 and 14 now and started wanting a bit of a lie in at the weekends (hurrah!) when they each got to Y6 (so age 10) and certainly by Y7. DD2 was ery much going through puberty in Y6 and was 5'1 in September and 5'7" a year later, so she certainly needed a lot of sleep as her body was working overtime doing all that growing!
Personally I get up 5.30am three days a week and 6am two days, and earn a six figure salary as CEO of a small organisation, so while I love the job it has its demands, and I really appreciate waking up naturally at about 8.30am on a Saturday then sometimes lounging around and dozing and dreaming a bit more. I find it really helps my mental health and I ached for that ten years ago at 38 when I had far less energy, mental & physical, than now. DH often gets up just after me, sometimes before. I still get laundry, hoovering and bathrooms done and go to the gym on a Saturday, and usually watch the afternoon football game on Sky, so I think it's pretty productive & relaxing, personally.
I also go to the gym a further two times in the week and do a yoga class, so I don't think I'm exactly lazy or "wasteful" of my time. Personally I think plenty of downtime is productive, and lack of it is counterproductive, and I often dream up or think of work solutions on a Saturday morning while ostensibly I'm lazing about in bed. I'm also writing a novel and get loads of ideas when dreaming or dozing.