I can't believe that he is actually taking a longer route to get into the NDN's house - he's obviously deliberately baiting you. What a twat!
I don't think your husband should manhandle him off the property, though - it may lay him open to charges of assault, and it's not worth getting a police caution, or worse, for the likes of this little toe rag.
Go down the getting on NDN's wick every time, spiky bushes, keeping a bucket of water handy to "accidentally" soak him (you always clean your kitchen floor at that time in the morning, and use the grey water to put on the garden),
Or if you can get any, fox shit....that stuff fucking STINKS.
It does. It really, really does. The problem then is that you don't really want it on your garden.
If you could push some up his exhaust pipe, or even a piece of kipper or some dog poo, so that his car stank of whatever, then that might afford some personal satisfaction.
Do you have children OP? You could ring the police and tell them that he is behaving inappropriately by constantly being on your property despite being told not to, and that your children are anxious about it because he just stands and stares at them. Or indeed, that he makes you anxious because he just stands and stares. When you think about it, this is in some ways quite threatening behaviour - creeping around your property, interfering with your windows etc.
It won't improve your relations with your neighbours, but it looks as though you can kiss them goodbye anyway.
What a horrible man.