It is hard to start with but you soon get used to checking the ingredients. I lost loads of weight, and it improved my digestion a lot. Having said that, it was a relief when I managed to reintroduce wheat and dairy without any problems!
I have a good book called The Single Vegan (I'm not single, you can just multiply up for more - not vegan either, but DH has dairy allergy) that has lots of quick & easy recipes. Also I like that it is set up so that often you can make one recipe, but then there is a recipe that turns the leftovers into something a bit different so you can eat it several days without going mad. Once you have easy vegan food you just avoid anything with wheat in which is pretty simple to do, easier IMO than avoiding dairy. We had to do this for a while as the doctors took a while to sort out if DH was wheat allergic as well as dairy (luckily he isn't, only to cows milk). I've met loads of people who don't eat wheat or dairy (perils of moving in hippy circles) and they all look perfectly well fed!
I would honestly try and ditch the ready meals and make your own food before ditching any major food groups. Ready meals are low in nutrients and high in salt, all likely to make you feel a bit bleurgh.