Where I used to live, there was a byelaw prohibiting bonfires before sunset or 7pm, whichever was earlier.
Until I moved, I had no idea that this wasn't a national thing, but imo ut damn well should be. Where I used to live, a neighbour was bonfire mad and was always having the things. One very hot day in early summer, he lit a bonfire and the whole family fucked off out for the day, leaving it burning. Smoke and bits of burning stuff were blowing into the garden of our flats and in people's open windows. My neighbour in the top flat (which was really hot, as up in the eaves) had to shut all her windows.
We were so pissed off, I called the fire brigade and they came round and put it out. They also came back the following evening and read him the riot act about leaving a bonfire burning unattended in built-up area full of old houses.
That neighbour was also my boss. 
He never believed that I'd have the nerve to call the fire brigade and the Chief Fire Officer and I had many a laugh about it.
Bonfires are very anti-social in urban areas and I think everywhere should have a byelaw like the one above.
If it's a frequent problem OP, you can report it to the council and they can take action under Control of Pollution legislation.