its lime juice, zest plus double cream and condensed milk on a base it says set for 1-2 hrs in fridge, I was going to leave it over night, will the lime juice make the cream go all wrong if I do?