Everyone is an inconvenience to everyone else! You are being far too sensitive.
When I drive, pedestrians and cyclists are inconvenient. And other drivers, some of the time.
When I walk, drivers are. And other pedestrians, some of the time.
Same when I cycle.
And equally when doing all of those thing I am a nuisance to someone else.