There's a lot of "you shouldn't cycle on the pavement because people cycle inconsiderately on the pavement near me"
The OP isn't going to cycle inconsiderately, she's said so.
The equivalent argument of "some drivers speed/drive drunk so no you shouldn't drive" would rightly be called as false, as would "no you shouldn't have one drink because my friend got beaten up by a drunk guy" etc etc.
Why the grouping of all people on bikes into one group?
Some people are dicks. They will remain so irrespective of their form of transport. Not all people riding bikes are dicks, despite all the anecdata on this thread. Similarly not all car drivers are dicks. Nor all dog walkers, or pedestrians.
When I'm riding on my own, I ride on the road. Luckily roads near me are largely suitable for a competent cyclist, provided you have a thick skin to avoid the inevitable abuse from (some) dickish drivers at some point. When I'm accompanying my 5yo to school, we ride on the pavement. Where there are any pedestrians we are at walking speed or below, and give them full priority. I can honestly say I've never "whizzed" past anyone or wobbled near anyone or scared anyone. If coming up behind someone who hasn't heard me (usually the free wheel ticking frantically as I stop pedaling attracts attention - if not I say "excuse me", pedestrian looks around, moves slightly over, I say thank you and smile, and ride on), I come to a complete stop if needed. I certainly wouldn't be yelling at anyone to get out my way, that's just bloody rude.
It doesn't have to be an us Vs them battle, we're all people.