We buy as much organic, free range food as possible, but sometimes for reasons of availability/cost, it just not possible to get everything, so you need to work out what your priorities are, and a few strategies.
Firstly, regarding food safety, many additives/pesticides/hormone treatments used in the USA are banned in the EU so you need to read up on what you are avoiding (and why), and work out if it's actually an issue in the UK (if that's where you are), under current legislation. Look at country of origin on everything.
For dry goods, sauces etc, amazon and other online retailers are great, you'll find many things you just won't get in the shops because they are too niche.
Aldi always has a few organic veg (not a great range but usually potatoes, onions and carrots and broccoli at a bare minimum), at really good prices, so I go there on my way to the big supermarket, and get what I can. Aldi also have cheap organic eggs but they are not free range iirc.
Of the big supermarkets, Tesco ime is miles ahead with organic meat, fruit and veg, they have a really good range. Some things (onions, mushrooms, currently), are pretty much the same price as non organic depending on what's in season - some times organic is cheaper if there's an offer on, some things tho, and very much more expensive, so a bit of flexibility with recipes is good to make the most of what's in season/cheap.
Organic free range chicken is expensive, we have it as an occasional treat. Organic beef, lamb and pork are better choices (cheaper cuts, long slow cook), but there are other options. New Zealand lamb. Scottish lamb and beef (I'm in Scotland), as it's mostly raised outdoors even if it's "grain finished".
Farm shops can be a good source of quality meat (ask around), some do online meat shopping, can be cheaper to buy in bulk and freeze if you have the space.