I was always taught to have a special sponge / cloth which only gets used to wash / wipe the toilet.
The sink and shower etc are wiped down with a different cloth.
MIL uses the same cloth for the entire bathroom.
I find that strange. How do you do it ?