He told you he wasn't attracted to you and had a roving eye ?
What a bastard, he wanted to scare you to continue his friendship. He clearly gave it his best shot at charming this woman and it didn't work, after 5 days he realised and wanted normality to return.
But it's not normal now is it ? you can never un hear those words, no wonder your confidence is on the floor.
Are you still intimate with him? I would tell him I no longer can have sex as he has battered your confidence to such a degree you can't let go.
He's controlling you, until you stand up for yourself he will stamp all over you, the power in the relationship is totally un balanced and you are suffering.
He is not a kind man, in fact he has shown a complete lack of kindness.
If it were me I would stop everything you do for him, in the home, if you work together, that too , he needs to understand your worth and so do you.
I think you do not know your own worth in this relationship, until you are willing to test that, this cunt will continue to hurt you.
He sounds narcisistic.
I am not annoyed with you, far from it, but what I'd like to say to your husband. 