I may not say what you want to hear now OP but I think your husband is right, and I'll explain why in a minute, but firstly my biggest urge to impress upon you is that you must try to remain a partnership with him and try not to see things as 'I'm right, he's wrong' or 'I've got it harder, he's got it easier'.
I don't want it to sound bossy or dramatic, but you're embarking on a massive project - you've brought twins into the world. Over the next days, weeks and months you'll really need each other. Twins are wonderful wonderful things, and a lot of work that you will need his support to manage. Far, far better to get off to a start thinking like a partnership and not pitted against each other.
I know men don't have the hormone surge that we do and can't understand the need to be with our children (I caught a cold just after mine were born at 31.5 weeks, and for 4 days I literally was not allowed to be in the room with them, in case I gave it to them. That was bloody hard at the same time as milk was coming in, recovering from a section, house full of cards...you know).
Afterwards, when mine were in special care, I visited from 8am to 6pm. I expressed every 3 hours, day and night. Just doing that bit (less than you are currently doing) was exhausting, and my milk supply became insufficient eventually. Rest is ABSOLUTELY essential if you want to b/f even partially, and also it is essential for you to be able to hit the ground running when they come home.
That's why I say I think your husband is right - he genuinely is helping by trying to make you rest! But he is also the father of your children and has their best interests at heart the same as you do. He just thinks differently, as you acknowledge. Try to hear him in this, even if you disagree, because it's only the beginning of their lives and you will want to be able to come to mutual decisions about all sorts of aspects of childcare going forward.
Best of luck. FWIW my twins turned two recently and you would never know in any way that they had been so tiny and premature when they were born. I do think back to the special care days very fondly, because the care we all got was superlative and set us up for everything that followed. It won't last forever, it really will fly by. I know that anything that happened in the world in March 2011 basically passed me by because special care was my whole world for that time!