YABU. For reasons Witsender has outlined. Much higher farming standards, especially if Soil Association certified.
It costs pennies more to get organic milk and not much more for cheese. Meat is more expensive, but so it should be. We should be eating less of it anyway.
I'm less bothered about organic fruit and veg tbh, although I know there are some more likely to contain pesticides than others and keep meaning to look it up!