I haven't read every post on this thread, so apologies in advance if this has already been said.
Riding on the pavement, even in a quiet street, is dangerous and illegal. You may say you are careful, but that's no guarantee of not hurting a pedestrian.
Some years ago, my DS, who was 6 at the time, was knocked down by a cyclist on the pavement on a quiet estate road. He was with my DH at the time, holding his hand, yet the cyclist came round the corner and knocked him down in a moment.
This resulted in a 999 call, 2 days in hospital, plastic surgery, and finally a permanent scar on his face, which 15 years later is still visible. The police did go and have a 'friendly chat' with the cyclist, but that was all.
The cyclist did come round and apologise, and I think he was very sorry to see the damage he caused. I'm pretty sure he won't have cycled on the pavement since.
From the other point of view, my DD cycles daily in city conditions, and of course there are dangers in riding on the roads. I worry about her safety. But the answer is not to endanger pedestrians.