I read a blog post awhile ago about what happens when you eat sugar after being on lchf - it broke down the effects over the next few days, what to expect etc and the general tone was ok this is what will happen e.g. you'll feel hungrier but don't sabotage yourself further etc. Just ate a large slice of lemon drizzle cake 
and would like to re-read it