I'd be up at 11.30 at night, but I would do my best not to make noise at that time that will disturb my neighbours because I have enough awareness that many people will be trying to sleep at that time.
It is about consideration for other people around you.