The biggest frustration for me is running. I just cannot run, I've tried so many times. It's just too hard, too uncomfortable and boring boring boring. Yet running clubs seem like such a good way to interact with a community.
Cycling, same as above. I HATE it.
Gardening. What a lovely way to spend a sunny afternoon, pottering about planting flowers and growing your own vegetables in your very own garden. Unfortunately I hate gardening. It gives me backache and my hands aren't strong enough.
Feel free to add on...