I do not wish to be around people like that
You sound...sanctimonious. And prim, and judgemental, and probably unreasonable too. Like you have a list of types of people you will deign to spend time with or not.
By all means, if you don't like someone, tell your dh that you don't want to spend time with them. Because of them, as an individual...not because in the past they've ticked one of your list of 'unacceptable acts' which means you cannot possibly mix with them. The guy cheated on his wife...unpleasant, but he's not a serial killer. God knows there would be a lot of isolated people if everyone refused to converse with anyone who had ever cheated on someone.
One of my dsis's mates is a (suspected..99% sure) thief. Always getting brilliant goods for 'a great price' followed by a wink....iyswim.
Anyway, I think she's a total bell end. Not someone I wish to spend my time with. So when my sister kept inviting her to tag along with us, I apologised to her and said I really wasn't keen on her friend, i'd rather she wasn't invited to everything. Which my sister gets, and respects. You don't like everyone, usually.
Had I grandly announced 'I do not wish to associate with that sort of person' with no other justification, I would not only have made myself look a twat, but my sister would probably have spent months trying to convince me what a lovely person she really was.