Hang on, when we are talking about sweets and pudding etc - what exactly ARE we talking about.
We have pudding most nights after tea, though sometimes this is some yoghurt with honey, sometimes some fruit, sometimes a pudding pudding, sometimes ice cream etc. These things are dependant on tea being finished (though to be fair I do give quite small servings of both tea and pudding).
Sweets as in chockies/skittles type things? I don't keep them in the house (because I would scoff the whole damn lot), but if we are in the shops and he asks for them then I will usually let him (lots of things go into this decision though like whether he has been good, where we are going next and so on).
I find it best not to make a big deal out of it.
Though I do have a jar of rather old fashioned boiled sweets that if he picks up ALL of his toys in the lounge he can have one of. I may be giving him eating issues, but I feel confident I can afford the therapy (and in any case with US as his parents this will be the least of his worries)