I would always use the former, but I saw "publically" used in a very formal setting. Can it be right? Which do you say? Is there a difference in meaning?