I'd go with your gut instinct, which is to back off (I have a horrible feeling in my stomach just reading this).
Or you could email him back, say you aren't completely comfortable meeting a bloke on your own (albeit in a public place), could DH come along too (as has been suggested), and then if HE makes excuses ... well you will know for sure he wasn't genuine.