OK if they're those great big ones, I'd peel them, especially if the skin was looking a bit manky. But if they're just normal sized, fairly fresh mushrooms, then I'd just give them a rinse, maybe cut of a bit of the stem and use them.
My mother thinks this is disgusting practice, especially as mushrooms are grown in horse manure.