OP, I'd say you really are worrying unnecessarily, though I can understand why you are.
To put it in perspective, I have over the last three weeks:
Been to supermarkets most days
Seen a friend who is not a member of my household but who needs me to shop for them.
Handled money (I now have no money in my bank account, thanks to Covid, so am using up the cash I have in pockets etc)
Dropped money on the floor in M&S, picked it up, then didn't wash my hands before absent-mindedly eating a Jelly Baby.
Opened my post without a second thought.
Eaten raspberries without washing them (M&S, so I am sure they are virus free
).
Taken out and brought in the bins without a second thought.
Had a plumber here to sort out my leaking kitchen sink.
I still haven't caught this sodding virus yes I know I could be an asymptomatic transmitter, but I have nobody much to transmit it to
So it is perhaps not quite as easy to transmit or catch it as people are saying. That being the case, and given that you are doing so much to keep your DH safe, I'd say that your worries, while understandable, are unnecessary in this case.