Yep, you are really are taking shit.
You are one of thise people that seems to think that if ou have had a difficulty with something then everyone else should be able to handle it in exactly the same way as you, which is never going to happen, and it shows you as being more inconsiderate than you are accusing others of being.
My dh has suffered with a food phobia, which has caused all sorts of difficulties for him throughout his life. Thankfully it is no longer the problem that it nice was. But one of the biggest things I have learned from going through this with him is that the people who are undertsanding are generally much nicer people to be around in other ways that have nothing to do with food. They are the people who are kind, and considerate, and thoughtful and are actually fun to spend time with.
Those people who have accused him of being rude, or who have shown no understanding at all, are usually people that are so far up their own arses that not only are they missing out on the wonderful company that my husband can be, but they are also so uptight that they are draining to be around. The sort of people that seem to zap your mental energy after spending half an hour with them and that I, as a non fussy eater, tend to not want to be around anyway.
So actually, maybe there is a benefit to some people having the bollox opinion that you do OP, it acts as an early warning of people to avoid.