Early day doubts

Good, OP, I am glad you have binned him. You HAVE binned him, haven’t you?

Lots of red flags already. He is not a nice man at all. If you feel psychologically drained already I strongly suspect you have met a narcissist. Get rid of him. If you find it difficult to get rid of him and can't shake him off, you have definitely got a narcissist on your hands, they hate to lose a potential victim and tend to cling on. Cut off all contact, don't respond to the contact attempts. Good luck, you deserve better.

Dump him, you should be happy and excited, not feeling like you're being gas lighted already.

Run OP, he will use your anxiety against you. He is already trying to erode your self esteem. 'Lucky he's into you - yuck

He told you that you should consider yourself lucky that he is into you!?
I’d be telling him you aren’t into men with unwarranted massive egos and bin him off.

OP I think posting on here is enough of a flag for you. You know his behaviour is negative. It will only get worse. Give this one a miss. there are so many decent people in this world and you will meet one who does not tell you how lucky you are to have him. Oh Lord what a pratt

Thrown in the fact he said I should consider myself " lucky" he is into me

This is an obnoxious, narcissistic comment. It implies he thinks he's somehow better than you. You could bin him for this comment alone, as it's a red flag.

I feel this older mans views of me being crazy, over sensitive

I don't think a 10 year age gap would cause this. What's causing this is him being potentially/already emotionally abusive. He disregards and mocks your feelings, perceptions of what's going on, etc.

He's making you unhappy.

He has to go.