Eating non-upf food doesn't mean you have to go all organic and fanatical. Im a single parent of two dc, working full time so both time and budget are limited, so i think common sense is the key.
My shopping basket has always looked pretty similar: fruit and veg (cheaper stuff like onions, potatoes, carrots, apples, bananas and some other ones if they are in season and cheap price per kg), milk, plain yoghurt, margarine, pasta, rice, flour, eggs, oats, tinned tomato/passata, beans, lentils, plain nuts and seeds, popcorn, oil, spices and herbs, sugar, minced beef, chicken, salmon if i can afford..
You can cook/bake a lot with a basket like that and it contains a low amount of upfs. I dont think ill ever stop buying bread or pasta or completely swap margarine to butter. Too expensive. Its not a case of all or nothing imo.