I always do. I often have a whole portfolio of examples of work I've done under each of the person spec criteria. I ask if it's OK to refer to my notes and I've never had anyone say no.
I've recently interviewed a young man who was very nervous and lost his thread. I suggested he refer to his notes which he hadn't opened until then. He had a beautifully presented folder with everthing he needed and once prompted was able to talk easily about the content - I.e. it was clear he did know his stuff, he wasn't just reading the notes. I was impressed he had done so much prep and thought it showed how interested he was in the job.
A colleague was shocked I "let" him use the notes.
WWYD?