Should I be worried about ant damage

[WineWhineWine]

I have a three storey house and there are ants everywhere. I know it is flying ant season so they are leaving, but seriously they are everywhere.
There was one nest above a second floor window. It looked like they had made a hole in the mortar between bricks and made their home in the wall cavity.
Everywhere I look outside my house there are piles of sand they have removed from the brick mortar. I feel like my house is about to fall down!
So should I be worried about the damage they do? If so what can I do?!

Is this a thing?! If so my house is probably about to crumble as I also have ants everywhere

They seem to be spectacularly common this year (various friends and neighbours have complained, and they seem to be coming out of pavement cracks this year too!). We had a ton them on our doorstep that I nuked with boiling water (and followed up with spray). Not the kindest way, but it looked like our doorstep was moving.

Spray all impacted areas- the Raid ant and cockroach spray is good and give 4 weeks protection- and assess any damage.

I have an insecticide spray which is normally effective but I can’t reach above the second floor window!