A new guy started at work and I got the impression quite quickly that he had a crush on me. I know this sounds big headed, but there were lots of signs. He made a massive effort to be friendly and get to know me, even though we are not in the same department and do not work together. Plus, he gave me some personal compliments about my appearance etc. I am quite a bit older than him, so I did ask myself if I was reading too much into it and maybe he was just a really friendly person trying to fit in, but I still had that vibe from him. Regardless of his feelings, I was always very polite when I spoke to him and not unfriendly, but I didn't encourage him at all or give him any reason to suspect I found him attractive (which I don't).
Anyway, he handed in his notice after a few months and Friday was his last day. During his leaving speech, he said 'it was a real pleasure getting to know you' and looked at me very pointedly, to the point where everyone in the crowd turned to look at me. It was a bit embarrassing, but he then said 'getting to know you all' and kind of covered it up. Before he left the building, I just called over best of luck to him as I was walking past him, and gave him a wave, to be nice. And that was it. However, this weekend he has sent me an email saying what a pleasure it has been getting to know (I don't really know him, we haven't spoken very much) and could he take me out to lunch soon?
So this is my problem now - I don't really know what to say back. I don't want to go out to lunch with him, even as a friend, if I am honest because I value my lunch hour and I don't think we have much in common and I know that he fancies me, and I don't feel the same. But the worst thing is, he is only moving jobs to the office building next door, so if I do say no and make up an excuse, I will probably see him from time to time in the local area anyway. If he had asked me on a 'date' then I would just say, I have a partner and that is it, but because he has only asked me out for lunch, I don't know how to decline without seeming rude. What do you all think is the best approach here? I am a people pleaser and not good at saying no to things I don't want to do!