I have written things various times and had to stop myself as this hits a particular nerve with me, and I am still not entirely comfortable sharing it, but it might help give a slightly different perspective. I have been in a similar situation but in reverse (ie I was the one at work, pretty much accused of having an affair - wasn't, hadn't even considered it, would never - work very busy in start up mode, new job (with some vulnerability around the stability of the role around 3 months in), big mortgage, concerned about being able to give the family the best I could and ensure financial stability). There were several issues
- I got too involved in work to the detriment of my home life
- DH wasn't working and didn't have much of a support network around and wasn't doing much else except looking after the boys.
I became his focus, which meant that whenever I was late (which was, admittedly, too often for a while) I would dread walking into the house as I would immediately be got at about being late. Work became a 'safe haven' - somewhere where people wouldn't have a go at me about everything, and where I felt I could relax. Obviously, this had a further detrimental impact on him. We had HUGE arguments most of the time, which impacted our relationship and the boys as well . It all blew up to a point that we had to make the decision about whether we wanted to stay together or not, and as we did, what we could do to make it work as it wasn't an option him getting a salary near mine where we live.
Ultimately the way it worked was for him to start doing things, get involved with things locally and get a part time job - all of which gave him back his self worth and made him much more attractive again. I took a good look at what was important to me, and started laying down the law at work about what I was and wasn't prepared to do. It wasn't easy, but actually people accepted it much more than I expected. Getting that balance is absolutely vital. Now we are very happy and have our lovely addition to the family .
Long way of saying I think what ts & pf have said is spot on and to give a bit of a different perspective on some aspects.