YABU
We live next door to a pub (we rent and werent in a position to be picky). We have people screaming and shouting outside our house at well past midnight on school nights, on weekends it can be 3am. We've had vomit right outside our front door, fights, a coke dealer trying to break in to the pub after hours. A couple of weeks ago we had the drunken louts cheering and singing at the top of their lungs while banging away on the joining wall, this was at 2am in the morning, on a school night. They don't give a single fuck about anyone around them
We used to smoke, yes it smelt, but other than the smell we have not once disturbed anyone through antisocial behaviour, and once our neighbours made us aware it was an issue for them we started taking walks across local fields to smoke instead. We've never started a fight, had a screaming match with anyone, or puked and pissed on the pavement outside people's houses. Nor did we ever move onto other substances.
You know what we did do? We got stoned and binged netflix, or got stoned and did some work, or got right into a documentary, or gamed. And ate a lot of food (which is actually why we quit, I couldn't shift the weight without stopping the munchies)
Legalise it, benefit from the tax money, allow people to open shops and give consumers a good idea of the strain and the strength they are getting.