I'm not assuming people who don't see it like that are wrong or ignorant.
I do think that people who don't know what imagery is, or how language works, are ignorant about language and imagery. That's not me being rude, that's me making an observation. I do believe some people think anything they can call 'imagery' is somehow not part of normal, communicative language. And of course it is. Sure, sometimes hackneyed images pass us by, as you say - but that's not because they're figurative rather than literal (imagery cannot be literal). It's because they're hackneyed.
I think, with respect, that you are missing out the crucial point that has bothered people when you concentrate on one half of this phrase, about the 'punch', since the reason I believe people are upset is because this is juxtaposed with the second half of the phrase.
I know food is often described as 'punchy'. No disagreement there.
But to use this phrase is to use another metaphor entirely, and one which isn't a phrase I've heard before in the context of food, so I don't agree it's commonplace, and wouldn't want it to become so.