Here is a challenge for you, to accept or ignore just as you like.
Next time someone asks you to do something, say "I would have loved to but, sorry, no can do"
Then observe very, very closely what happens. The sun will continue to rise and set. Nothing will actually change.
Some people may not react well, just be very clear that that is more about the sort of person they are. It will have nothing to do with what you have done or not done.
It's really useful to know how people react. Really good, decent people will accept it with no problem.
Like anything else, the more you do it, say no, the easier it gets.
I'd love to know how you get on.
P.s. there are exceptions, tax inspectors and customs / immigration officials are not good places to try out your skills. Start with the trivial like window cleaners and move up from there. Good luck.