DP had this with the boy next door. His folks didn't want any mess/noise in their house/garden, so, come rain or shine, next-door-boy would be hammering and hollering at the door, ready to play. I think DP's parents just started saying "no, not tonight/today".
now, as this boy's parents were a bit fuddy-duddy, DP hardly went round, but you might find that these people suddenly twig that it's a bit one-sided and have your boy over occasionally.