I used to go to church regularly but stopped because I felt it was stealing time from the family. It actually wasn't the service itself that took the majority of the time, though a bitter LOL at the idea that a parent of small children can just decide 'to have a lie in' or 'have a coffee and do the online shopping' - I know my ds is 13 now but I can still vaguely remember what it was like when he was small and neither of those activities featured heavily in my life - it was all that other stuff and indeed the social activism; all of which was handed out at the coffee time after the service. Of course, I'd have missed a large chunk of the service anyway because in a small congregation and having a vagina I was in the Sunday School rota pretty regularly, and because it was spiritually important in some way I was supposed to learn stories by heart and tell them with special demonstrative equipment, rather than playing a game of Boggle or sorting out the Lego Noah's Ark which I was more prepared to do. I was asked to help with the coffee mornings, bake cakes for them, to join the PCC, to help with a survey of the churchyard for the ecological potential, you name it. The only thing I did manage to swerve was being a churchwarden which is essentially a full-time job. I don't blame the congregation for wanting help, religion should result in the social activism that a PP talked about, though it has to be said in a congregation of about 25 the sheer logistics of survival tends to take priority.
dH was very good about it and never complained audibly , he even looked into Christianity and met with the vicar a couple of times, but his heritage is Jewish and he couldn't make the deposit of faith. Ds often came with me but as time went on he increasingly didn't want to. The social events were of limited interest to either of them, especially as there were approximately three and a half other children in the congregation.
This is all for a church that is round the corner, and though I do work full time I am at home by 6 at the latest every night. It still felt like too much time away from the family, not because we are joined at the hip but because being there and your partner knowing you are around makes a big difference when parenthood feels like a long, mystifying slog. The choice NOT to be there feels like quite a big one, and all the more so if the OP's partner is unavoidably not there for HALF THE YEAR 
OP, I do feel that there are some unfortunate currents in your marriage. Only you know whether it is worth studying these in depth - I would rather stick pins in myself than address most of the dysfunction in my own relationship - but I am struck that you apparently told the children they didn't have to go to church, rather than saying to your partner 'The children aren't finding being dumped in Sunday school very inspiring, do you have any suggestions?'
I would agree that the most practical option is for your dh to go to an early service, even if it's not the most spiritually satisfying one, and to ask for recordings of the sermon, or to find someone else's sermons online to listen to preferably not Nicky Gumbel
Or you could bribe your dh's vicar with a massive donation to the parish contribution to preach a sermon about the importance of family life, Sabbath moments as opposed to lengthy Sabbath observance, and the selfishness of those who duck out of their obligations under a flag of religious convenience...