I think if you're putting a 'really noticeable' amount of plastic bottles in the recycling, you could probably also think about how much product you're using.
I use what seems to me like the right amount, but then I see people on here talking about what sounds like to me huge amounts of cleaning and laundry products, toiletries etc, eg they're buying these things every week.
To me they last a couple of months at least so to get through a bottle of anything in a week or two a lot must be uselessly going down the drain or you must be cleaning things that don’t need it.
Also a lot of these 'greener' solutions like glass and paper are very energy intensive to produce and recycle and are heavier so take more energy to transport.
So it's not always a case that alternatives to plastic are a better option, it could well be that, as long as its not dumped in the sea, plastic is the most sustainable choice.
I think there's a lot more that big business can do to reduce waste, rather than rely on the public to responsibly deal with things they never wanted in the first place, for example if you buy a single item from a lot of online retailers you have to try really hard to avoid being sent multiple brochures forever more.
Likewise junk mail through the door, all printed on high quality paper and all totally unnecessary. Plus you only need to look at a website to then receive endless marketing emails even if you never bought anything. They all require storage and internet traffic which again uses lots of energy.