We do it when we get in from the day usually.
Well, we kind of straighten and pull back the duvet and the put the window open (even if just a crack) during the day. so as to "air" the bedding.
But, apparently I'm odd and should put duvet on properly etc do as soon as I get up or near after?