I've been soaking fruit for the last two weeks waiting for the time to bake. Halfway through cooking I've realised I've forgotten the chopped almonds. Have I just ruined them?