Thanks very much for all the feedback.
Lots of food for thought, and one LTB, which I must admit I thought was a bit harsh!
To answer a couple of questions:
No, dh doesn't know I posted it on MN, he knows I'm on here, but I think what I write about is private and I wouldn't like him reading all my posts.
No, dh would probably not be doing the cooking. I would make him do all the tidying up/ cleaning etc but him cooking would be unadvisable.
I have had a serious think about the advice given, and the whole situation.
I could have lots of other people over to water it down a bit, but it would still, to my mind, be signalling that I wanted to be more than acquaintances with them which is not an impression I want to give.
I also don't really think it is my place to support his wife. Firstly as she seems deeply impressed by him and not needing any support, and secondly as it just isn't something I feel I can cope with emotionally.
I think EuphemiaLennox hit the nail on the head when she said:
"I think you sound deeply uncomfortable about these people and don't want to expose your personal life to them at all. This should not be ignored."
That is it, really.
I've had another think about why I'm so uncomfortable. It is lots of little things, not one big one, so I probably seem petty, but they add up.
I think I'm probably the only person he can tell is not a fan of him, so he spends inordinate amounts of time trying to get me on his side and I feel controlled.
e.g. Last week he volunteered me to do something quite time consuming (12hrs roughly of work) without asking me first.
When I asked him about it (I presumed my name being on the list was a mistake), he said,
'but you'll be so good at it, no-one could do it like you, I couldn't bear it for someone second rate to do it when we've got you'
as if it was some sort of compliment, and then later his wife came up to me and said,
'I think x is a bit upset that you didn't appreciate his confidence in you. Might be worth saying sorry'.
So somehow the whole thing got turned around to being something I had done wrong...I could write down many such examples.
I think I'm trying to justify myself as this isn't a nice way to feel about someone, and it makes me seem petty. But the thing is, he is the only man of my acquaintance I have such a reaction to, and I do trust my instincts about him.
I have had another chat with DH about it. It seems he hasn't given them a firm date but the thing we do together is on hold for 4 sessions (8 weeks) because of the school holiday, so DH mentioned perhaps they would like to come over to us on the night we usually meet up. So I've asked him not to give them a date as to which week.
DH said, 'look i've offered now I can't go back on it', but I really feel he needs to stand up for me now.
I've told him to say that when he checked with me i'd made other plans already.
We shall see whether he does it, but I'm now of the opinion I just will not have them round.