We get veg from a local orgnic farm and eggs too. The veg is good value, we pay up front for a year and it works out a £7 a week. in summer you get alot of veg (though we eat more between the two of us and BLW ds) but we eat a lot of veg.
There is a farm near my folks that sell eggs, you can see the girls running around, They are in a barn but have access to out doors iyswim. The eggs are really cheep and fresh, £1.60 a doz and obv they keep for a month or so so we stock up there often.
I don't eat meat but Dh has the occasional bit. As it's rare we can afford organic etc and wouldn't buy it if we couldn't
Asian shops and chineese supermnarkets etc are great for lentils, rice, couscous, spices etc Some are also good for past and some canned goods
you may not get fair trade there etc if that's what you're after but at least you are lining the pockets of someone other than the supermarkets
I figure you have to decide what your priorities are. For us that is cruelty free, not battery etc. Even if you then occasionally nip in to tesco for milk or a ready meal you have a bare min you'll accept
At the end of the day it's better do do what you believe in fifty, ninety or twenty percent of the time, than to sack it off because you can't do it all the time iyswim