If you follow some of the breast feeding threads you will find anecdotal accounts of happier/more settled babies if you up the protein, and oats being good for milk (as well as your bowels).
With this in mind, I have switched from a carb heavy cereal to eggs for breakfast, and made flapjack (search recipe board for the condensed milk one) with added ground almonds, pumpkin seeds, chopped up some mixed nuts (lidl do cheaper) and slightly increased the oats/reduced the fat and switched half the butter to rapeseed oil. Protein fills you up more too, which is a bonus.
My baby is coming on for 5 months, and to my eyes I only get to feed her exclusively for a few short months in the great scheme of things and she doesn't give a flying fig if my bum is large or small, as to her eyes I am perfect (this probably won't last?).
In fairness, a protein heavy diet, snacks in moderation and always choose something protein-ey (even peanut m & m 's are better than complete crap) and I am feeling pretty good, and the weight is coming off, albeit gradually. Carbs by contrast give me a spike and a crash, not what you need during crying sessions?
Try more protein? if it doesn't help then fine, go back to what you are doing now
Oh, and I do think YABU your baby needs you to eat more and be as much fun as possible while you remain the centre of the world.