We have 2 children and I used to be fine with whatever
I’d say this was the problem OP, you’ve fell into this routine through no fault on either side, but you’ll only feel worse and worse the longer it goes on and you don’t say anything about how you’re feeling now.
When we’re both in my DD wants to be with me more than her dad, including going to the toilet, but that doesn’t bother me (most the time!) as it’s not his fault, but if I start to feel fed up/overwhelmed I just ask him to watch her for a bit while I go and have half an hour / an hour doing what I want to do.
You don’t have to tell him off or restrict, just explain how you feel, but don’t expect him to solve the problem by being miserable stuck in the house too, as you do sound like you need to get out a bit more, gym, library, hobby group, shopping, lunch date, you need a REASON to go out otherwise you probably won’t, just start small and try and build it up.
then once you’ve got a bit of distance on the situation, if you still feel your DH is doing too much away from the home then have a word. You’ll see pretty soon if your DH really is happy for you to have a life too!
good luck OP.