It's clear that masks help to protect everyone- it's a collective action for collective protection. I'd ask those who don't wear them, what can be done to help you wear them, at least some of the time?
At work (over 100 staff) nobody has been unable to wear a mask. Some more at risk of getting seriously unwell with covid (including asthma) wear higher grade mask (more difficult to wear) to give them better protection while still protecting others. Some people have tried different brands to find what suits them.
IMO the only objective exclusions are not understanding the request and not being able to put on/take off.
We do need to take the toxicity and judgment out of the discussion because it doesn't help the legitimate goal of promoting mask wearing. We need to help people to wear masks too- better designs, better textiles, better psychological support. Whatever it takes, we should all be supporting that too.