Usually used these days to describe Muslims or sometimes other religions, or rather the rest of societies view of them.
Some religious/cultural practises/views I will never tolerate, FGM, bombing abortion clinics, forced marriage, treating daughters very differently to sons. I will not hold my tongue on these things.
Other stuff, dressing differently, not eating pork, fasting for Ramadan, not having an abortion yourself. Why would I not agree with it or feel it's something I don't like but put up with, I'm completely indifferent to any of that stuff. I don't need to be tolerant of these things because there's nothing to tolerate.
IMO it makes it sound as though some sections of society are doing something we disapprove of, or should disapprove of, and aren't the rest of us great for allowing them this freedom.