I agree with a lot of what people are saying on here, drinking isn't always fun and games for the Children in that household, if that's your experience growing up that's probably best case scenario.
I grew up in a house where my mum (eventually) drank every night, she was okay up to a point, but then she would start to act 'off' and then for no reason at all and would start to get moody and try and pick fights over nothing, I learned to stay out the way in the evenings, even if she seemed in a good mood, I was always on edge as I knew how it could go, it's like she wasn't even my mum anymore.
The worst part for me was the next morning when she'd be back to being my lovely mum, I found it really hard to screenwipe and be perfectly fine after the way she'd made me feel the night before, so then I'd feel terribly guilty.. it was a vicious circle. So to me, behaviour/capability while drunk is VERY subjective.
Ultimately, if your partner is questioning the amount your drinking and trying to open a discussion, then there may be something they're seeing that you aren't? And that may mean the kids could see it and be affected by it too, If it was me I'd respect my partner and family unit too much to just gloss over that.