As with some other posters, the use of the word 'hurtful' by your DH leapt out at me. I would have been equally startled if you had been two Christians living harmoniously, then he became a passionate atheist and was 'hurt' that you didn’t want to join him on the Richard Dawkins atheist battle bus!
Your DH’s response seems to suggest a lack of empathy - his thinking is almost solipsistic.
His actions and views may not be of the sort to destabilise other marriages but they have destabilised yours and, if he sincerely wants to make your relationship work, the onus is on him to reassure you that he doesn’t want to change you, that he loves you as you are and isn’t going to pressurise you into doing things that make you feel uncomfortable.
worry how it will impact on us/family in the future
I'm not sure if you are talking about children here but your words reminded me of an interesting – and to my mind somewhat counter-intuitive - snippet of information that I came across a while ago.
Studies show that it is the father rather than the mother who has the greater influence over the religious habits developed by the offspring. (Individual cases can buck the trend of course but this is the more likely scenario.)
One particular study showed that:
www.touchstonemag.com/archives/article.php?id=16-05-024-v#ixzz4bew4ik3I
… if a father does not go to church, no matter how faithful his wife’s devotions, only one child in 50 will become a regular worshipper. If a father does go regularly, regardless of the practice of the mother, between two-thirds and three-quarters of their children will become churchgoers (regular and irregular).
…A non-practicing mother with a regular father will see a minimum of two-thirds of her children ending up at church.
It would seem that a woman desirous of passing on her religious/non-religious stance to her children ought to choose a partner with a similar stance to her own, whilst a man wishing to do the same can cast his net wider because his views are likely to prevail anyway.
I have to say the feminist in me finds this a rather difficult conclusion to accept!
Just to add, though, I do actually think that relationships between believers and non-believers can work but I would not deny that there are potential difficulties.