I haven't read all the messages, but I so agree with you OP.
We usually travel on our own and have explored a whole bunch of countries across the globe. The only time we went AI, was to a 5* resort in Jamaica. We were bored after two days and moved to a charming very small hotel with a private beach. Got bored with that too, and decided to out and see the real Jamaica. It was quite an experience, and I remember that part of the trip the most fondly, not the £700 a night rooms we stayed in!
I actually feel a secret snobbishness at the people who lie around the pool, drinking. It seems a bit uncouth and like they are trying to ape a 1970s Hollywood movie depiction of a 'good life'. It is all a bit icky, although I am fully aware that I am being judgey and unreasonable here 
As someone said up thread, I love to explore the local food markets, the street side stalls, the cafes and just sitting and soaking the local atmosphere. I engage with the beggars, the shoe shine boys, the people selling trinkets. I go on the local buses, if I can. Go to untouristy spots and have been rewarded with some heart stopping moments, but also some absolutely amazing experiences.
We usually end the holiday with just a night or two of luxury. But that has never been the highlight of any of our holidays.