I would have an exterminator remove, you risk them coming into the house if you leave the windows open.
I got stung by one last week, i cane home late, opened the windows as it was hot in the house, it must have been attracted by the light, it flew in and went crazy, banging itself off the bedroom side light id put on. It was so big at first I thought it was a moth, when I got closer I realised it was a huge hornet.
So I calmly switched the light off, leaving the room, unfortunately I stupidly didn’t shut the door fully and it went into the hall, when I came out the loo it flew into my hair.
i could hear it buzzing close to my head, so bent over and was shaking my head and screaming, my husband came rushing up, it then flew out of my hair and stung me on the back, between my shoulder blades.
We then went downstairs, left the windows open, put the lights off, and about half an hour later I went to go to bed, went upstairs, into the bathroom, put the light on, and shut the door, just in case, and it was in there, came at me again. I heard it before I saw it. Fuck me I ran.
ir eventually left and my back was sore for ages, even now a week later it’s itchy and scabby,
get rid, they are not to be messed with, seriously, get an exterminator in.