DP hates the responsibility of owning pets. We have a dog and cats and he blames the mess in the house on them but doesn't clean up after them imo. We both look after them but I do it alone when he's at work, I'd do it myself all the time but i say if he lives in this house (my house) that he has to help clean the litter and take the dog out etc so that it's fair. I gave him the option of leaving many times, he doesn't want to go.
Today we had a row because he wants to give them away so we can have "a nice home" but before we got a cat I was very depressed, they help soothe my mental health issues and yes they do rip things up and occasionally pee where they aren't meant to but I think it's worth it. I told him (exact quote) "you will go before a single one of those cats" and his response was "yes and I'll take 6mo DS with me!" I am absolutely furious, can he do that? I think it's a terribly nasty thing to say and if he choses to leave he can't just take my baby away! I'd never restrict access and he works 12 hour shifts where as I'm a SAHM it doesn't make any sense 
He says that I have put them "before" him and it's nice to know he's not even second best
But I think any reasonable person who loves someone else would never ever make them chose.
AIBU or are they "just pets" as DP says. To me they feel like family 