I stay in a converted building split into houses and flats. There is not much outside space connected to the other units but I have the front corner which has a side and front garden. We do not have any fences or dividers but you can see what goes where.
Every night this week there had been a 10 or 11 yr old boy kicking a ball on our garden space. At this point I would like to point out that I would have absolutely no problem with it if he or his parents had knocked the door and asked if it was ok.
I know this sounds daft but Aibu to think if you want to play in my my garden at least ask.