Seriously, MN! All this "aww, he could have LD, be nice, give him a chance"
Absolutely not.
It is not OP job to navigate this man, it is not her job to teach him to navigate life, she absolutely should not take a chance on anyone that makes her feel uncomfortable, its a fine line between being nice and looking after yourself.
If women didn't feel the need to be 'nice and 'understanding' all the time, then the world would be a less dangerous place for us.
It more worried me when I saw Op change of response in her messages, as a direct result of what had been said here, op didn't need to continue the dialogue and tell a grown man it was time to sleep, but "awwww he might have LD"
He might have LD, but also be quite dangerous to op and her family.... he might not, but why risk it without knowing?
Also window cleaner needs to learn that the level and type of communication is not acceptable, and he will only learn that by being shut down, blocked and ignored.
Op, you have done the right thing by ending this communication now. I would advise talking to the other neighbour that had him originally, and I agree that I would be concerned about vulnerable people who might not have the strength or the support to say no to him.
I say all this as a sister of someone with LD who works in a shop, hes had to learn how to integrate and talk to people in a safe environment, his confidence is through the roof now and hes done really well, but he did so in a safe environment, using social ques from others who knew his deal.
This is not for op, or other strangers to do.
If he cannot act appropriately he should not be working alone and dealing with members of the public without guidance.
If he is at this level of LD, he will have people working with him to help him navigate through.
Nobody should feel responsible for anyone else's behaviour, particularly not knowing the full picture. The minute anyone, male or female feels uncomfortable they have just as much right to shut it down, with kindness and understanding if possible, but with firmness and directness if needed.