I would look into getting an organic fruit and veg box delivery rather than buying from supermarket (unless you are super fussy about what you have as although they give a variety there's usually minimal opportunity for substitutions) - I use Riverford which I love, but there's also Abel and Cole and Eversfield Organic. I really like how with Riverford what you get is truly fresh, seasonal, grown and packaged really thoughtfully with an eye on the environment, it's very tasty too. You get a big variety, different things every week - before we started the veg boxes we were a bit stuck in a rut of eating the same boring veg week in week out, and although it was a bit daunting to get new things I was less familiar with cooking (particularly in the winter - because they don't use hot houses and as much as possible is UK grown, through the winter you get lots of root and leafy green veg, with apples and pears as fruit with more salady type stuff and soft fruits in the summer), it's actually worked to make our diet much more imaginative and healthy, and there's very little we actively dislike... I also buy eggs, butter, bread and some meat from Riverford, it all comes in the same weekly delivery.
Price wise, organic is noticeably more expensive than normal, but the veg boxes compare well with buying the same organic veg from the supermarket. But if you do want to use a supermarket I find Waitrose the best for having a variety of organic products....
BTW I know this wasn't your question, I don't think there's very much scientific evidence that organic veg is better health-wise (including fertility) than non-organic, however certainly eating more fruit and veg, less dairy and meat is better for your body and the planet too, so in that sense a veg box will be a big help!