Sounds to me like your husband can be a bit of a dumbass.
I had four planned pregnancies in six years, the 'baby' is now an adult. My lovely husband has never mentioned the state of the poor old very droopy boobs, bless him. There is a very strong history of breast cancer in my family though, so I never planned on messing with them, unless medically necessary. I was worried that any sort of implant might make discovering anything nasty more difficult, so, I resigned myself to being droopy for life (roll em up and pop them in a bra). 😂
A couple of years ago, late 50s, I lost quite a lot of weight as it was really affecting my health. While I never thought I'd be in that position, I ended up going to see a surgeon about a tummy tuck, as all the extra skin was causing issues.
Anyway, lovely surgeon explained everything carefully, but he also mentioned my breasts. He didn't put it in the same words, but effectively said I'd end up with a nice waist, but it would be hidden by the droopy boobs. I explained why I'd never considered touching my breasts, as the family history was a concern.
In the end, right around turning 60, I, the woman who would be voted least likely to get her boobs done, had a breast lift. I don't have implants, they're still small, but, they no longer point at the ground! I also recently had a mammogram and they technician commented on how it was a lot easier to get a much better look at the breast tissue now.
So, while your husband isn't the brightest, your body is yours. Make decisions only based on what you want and your health. My point is though, that IF it was something you did want to look into one day, it can be a looooong way in the future even, there are options and it isn't always big implants.
I'm now so much healthier without the extra weight and I feel like the outside of my body now more closely matches how I feel on the inside. The thing is though, my journey was only ever about my health and it's been the right thing for me. Only you can decide what's right for you, and you don't need to make any decisions while you're in the thick of the baby and toddler years, so don't feel pressured to ever do anything.
Edited to add, does a vasectomy even count as surgery? My DH had his in his lunch break from work, no stitches, just one of those butterfly clips as the incision is so small. He did spend the weekend cuddled up with a frozen bag of peas though.