I don't own a fancy manor, but I do get it. I don't think you need to own a fancy manor to get it.
Anything to do with your house feels oddly personal, because it's your home. I mean, anyone could take pictures of my property and stick them on the internet, and to an extent, they do, because my property often comes up next to ones being sold. However, it's different to take a photo of the property and put the exact address next to it. It feels like there's a line crossed.
It's not hard to work out the exact address without that information, but the fact that the house name is right there, makes the information accessible and the feeling intrusive.
I think in the OP's case, the lack of access to the property adds a level of discomfort in that it feels like there's been an instance of trespass previously. A instance of the private sanctuary being disturbed.
I know it's the outside of the property, not the inside, but I don't think it makes it feel any less disconcerting.
For many people, when you get broken into, the upsetting thing is not the loss of valuable items (especially if insured). It's the feeling that someone has invaded your personal space without your consent. It's awful.
I don't think the OP has any legal rights here, unless they can prove trespass, but I don't think the OP is odd to feel a bit creeped out, without being able to articulate why. I think I'd feel the same.
Anyone who wants to test the theory can buy me a fancy manor and then draw a picture of it.