Wooooooah nelly, take a step back and take a breath!
Just going to throw out an alternative explanation here that's way more likely....
He's pissed off with you!
You went out the night before without him, fair enough but to him this may well have felt like a rejection of his company.
My guess is he keeps porn on his phone (a lot of men do this as it's the best place to hide it!) and when you went out for the evening, he had a little party for one which wore the battery down streaming videos.. To make sure you didnt find out about his little party, he obliterated the phones history for the last 24 hours which would have cleared not only search history but also location data etc etc. He was then naturally protective over his phone the next day, unsure if it had actually cleared everything properly so took it to the loo with him to check!
This also explains why he took ages during sex the day after...
Next, he's pissed at you for his feeling rejected over your night out (or for something else, who knows!) so is emotionally distant at lunch but still has sex with you because he doesn't want to ruin your birthday by showing his mood too much and sulking. He didn't anticipate that his mrs is ms marple and would sense something was up anyway, By the evening he's tired, pissed off and just needs some time out away from you and out of the house, so he goes out (anywhere he can think of) to get away for a while, hence "coffee" at 9:30pm.
He gets back, his mrs is demanding to see his phone and accusing him of cheating... no wonder the guy is defensive and now even more pissed off!
Only you know your relationship, but my guess is he hasn't cheated and actually this is in your head. However, your reaction says a whole lot about your feelings for him... this isn't really working out for either of you :(