There's a lot to unpack in this thread, but there are so many women with trust issues that I feel you're probably getting unfair advice.
All of my friends are male. I wouldn't think twice before going out for coffee/lunch with one of them. And no, I've never had sex with any of them, nor dated any of them, nor have they ever asked me to. If my partner stopped me from going out with a member of the opposite sex, I would have no friends. I have lost a few friends because their partners have stopped them seeing me. I'm not even pretty/slim/whatever men tend to be interested in. I am no threat!
OP: You obviously have your own reasons for not trusting your husband, and that's up to you to work out. If he's given you reason not to trust him then I'd honestly advise you call it a day, because this paranoia is no way to live. If he hasn't given you reason, then I would advise counselling, because it's still no way to live, but you need to work out why you feel this way. Could it be because of the way you've been treated by someone else in the past?
Generally, there are lots of men who are awful, will cheat, and who are untrustworthy. But on the other hand there are many, many more who are genuine, loyal, and really can go out for lunch with a woman without planning to have an affair with her.