I initially thought it might be some sort of awful spider chrysalis but thankfully googling suggests its just wasps!
Nothing buzzing around - but could there be a queen hibernating inside? Its pretty tiny.
Should we spray it with something to kill the queen then bash it to bits? I would quite like to get it out intact to show kids / school who are doing a "homes and animals" topic. Any ideas? Thanks!