I'm seriously hoping that your name doesn't begin with E... 
I LOVE baking and I'm bloody good at it. I have a very stressful life and it is the one thing I regularly do that is just for me. I also have no will power so I can't keep my baking in the house because I'd eat it.
So I bake for work. This week it was brownies (the non-seeping kind) and as I work predominantly with two groups I took a box in for each. DD had one at home, as did DH and I had one at work. Portion control sorted and a lot of happy people.
I do own a cat, but I put it outside before I bake, and I re-clean my kitchen just in case. I have OCD and my kitchen is always cleaned again before I cook/bake anything.
I bake around once a month, I also make birthday cakes for colleagues, instead of putting into the collection. I get asked if I'm doing them. I have also been asked by colleagues to make cakes for their children. As for shop bought cakes... I know exactly what is in mine - butter, sugar, eggs and flour. No preservatives, no trans fats, no palm oil, no chemicals, no E numbers. I know which is healthier.
One of my colleagues sometimes takes his cake home, and I usually tell him to take one for his DW too if he wants to. I'd be a bit
if she felt like you do. Eat it, or don't - it was your dh who CHOSE to bring it home. You may not like it, but he clearly does, and actually that is allowed.
Oh and FWIW - many of the people I work with, including Mr Take Home, are friends, not just colleagues. I spend more time with them than my family. I bake for friends.