I'm an idiot. I chopped up the little Green chillis, washed my hands thoroughly, but forgot that even if you wash your hands your fingers still have chilli residue on them for ages, so you shouldn't rub your eyes...or elsewhere.
Very unpleasant experience.