We obviously didn't get a great amount of time for a fun sex life with all the things that go on with everyday lives
He did though, didn't he?
Rather than use that time to visit sex workers he could've helped you at home so you weren't so tired and could have had more time to be together.
Rather than use the money to help you out, with domestic help he put it on his own pleasure.
He's addicted to the dirty thrill and the variety of women, not the quantity of sex with his loving wife.
His distrust over you, is based on his own distrust, because he can go behind your back he thinks it's likely you will also.
Controlling and abusive. How can you love, trust and love everyday freely with a man like this? 
You shouldn't get over it. And you won't -you'll spend everyday in hell. Take it from someone who knows.