Because the oil from your skin helps show their lustre.
When I bought some in Hatton Garden from a pearl specialist he polished them with fish oil first, and it made a huge difference.
Oh, and NEVER spray perfume onto them, ruins them.
Didn't realise I was such an expert