This is what it comes down to. Are we expected, as individuals, to assume that anyone being a nuisance, is being so due to difficulties that they can't control and the responsibility is on everyone else to show empathy and therefore cope with the nuisance in our own way?
Or is the responsibility on the person causing the nuisance to accept that the responsibility is on them to do everything to avoid it reduce the level of nuisance on everyone else?
Ultimately, it it the responsibility of say 100 persons to cope and accept the nuisance of 1 person, or the one person to think of the impact on the 100 others. Because it is inevitable that put of the 100, there will also be people who have their own struggle expecting the other 99, including the 1 causing the nuisance, to put their needs first.
There goes the problem. Nobody cares about the impact of their actions or choices on others because they are focused on an the expectation of compassion towards them. This approach turn people into a society that values self-centeredness while proclaiming the value of compassion. We then wonder why are constantly facing with some sort of conflict.
If people saw it their duty to minimise any disturbance on others, we would be much more likely to evolve in a society that is willing to express compassion the the fewer who are genuinely unable to make any arrangement whilst appreciating the efforts made by everyone else.