You have my sympathy, I've been there! Okay, calm down! Its not so bad Dizzy, you haven't said anything to humiliate yourself or put yourself in an inextricable position
The most likely thing is, he is all mouth anyway and he isn't actually going to make a move on you and force the issue
I think your best option is to continue as you are, but bring your husband into the conversation
Its valentines day soon, so use that, I dunno, ask what everyone's plans are and go from there
It worked for me, the man concerned and I had a good working relationship, a bit flirty but I didn't mean it and neither did he - but it suddenly dawned on me, that he thought I was serious
so I started talking about DH - I'd say stuff like my shoulders ached and I'd have to get DH to massage them, then add, he's a sweetheart, he'll massage my shoulders for an hour and still iron me a shirt - thats a naff example but hopefully you know what I mean
Anyway, for me, it meant we could continue as we were, but I had made it clear that I didn't actually fancy him, without any embarrassment