What would you think if your DH wore some at home? Are they gender-neutral enough for chaps to wear in the privacy of home? 
The other day when we were both in Schuh, I saw my DH eyeing up some Ugg boots: not the slippers, but the actual boots. I asked him why, warning him not to buy them for me (I don't like the way they look, and I wouldn't wear them outdoors), but he said he liked the idea of wearing them himself at home, to keep his feet warm.
I have to admit that my first thought was
, as I've never seen anyone male wearing them, but what would you think if your DH suddenly wore them indoors, instead of slippers, especially given how expensive they are?