Petrochemicals are a finite resource, anyhow. That's why fracking is such a global concern, at the moment. All the easy to get at oil deposits are almost depleted.
Even the cotton industry is far from spotless. Conditions for workers are horrendous.
It's probably safe to say, in any industry, where manufacturers want lots of it and want it as cheaply as possibly, there's going to be an ethical or environmental cost.