Normally I would advocate sitting down with your neighbours to sort this out, but I totally understand why you don't want to deal with these people.
They are either
A) complete cretins, so explaining anything to them will be a major challenge or;
B) bloody minded, brassed necked chancers, who will try to get what they want at any cost.
I think let the officials handle as much of this as possible.