I've been wearing hearing aids for about 10 years. I'm on my third pair now. They're not a magic bullet and can be uncomfortable and annoying, however much you wear them. It's not always a matter of wearing them more to get used to them.
The first two pairs were NHS ones and really were awful. I went back countless times for "fine tuning" the sound quality, but they never managed to set them correctly for my hearing, so I wore them less and less and they sometimes made my hearing worse rather than better in some settings.
The main problem is that they amplify background noise as well as speech, so, say, if I'm in the kitchen with a "noisy" appliance such as an extractor fan, kettle, microwave, fan oven, etc., it amplifies the "hum", which drowns out voices if the person is further away than the appliance. Same in the lounge - I used to sit close to the TV with OH sat on the other end of the sofa, further away, I couldn't hear him when the TV was on as the hearing aids prioritised the TV. So we swapped places on the sofa, and now his voice takes priority over the TV so I can more easily hear him speak. That applies throughout the house. I can't hear DH if he tries talking to me from another room when there are sounds in the room I'm in, even if a lot quieter.
Until you suffer hearing loss and have to wear hearing aids, you don't realise that hearing aids aren't some kind of magical solution. Yes, they improve hearing in lots of situations, but they don't "cure" hearing loss and don't give you the same kind of hearing that someone without hearing loss experiences. In particular, as I've said, where there are "competing" sounds, the human brain with normal hearing does a better job of being able to separate the sounds than a hearing aid can do!
Because of that, sometimes the wearer will just prefer not to wear them all the time, especially if they don't usually need to hear people. Personally, I'm sat on my own in a small office all day, so don't "need" to wear my hearing aids as there's literally nothing and no one to listen to. Same when I'm at home evenings and weekends, only me and OH, and I don't "need" to wear the hearing aids when I'm online or reading a book, etc. I also don't "need" to wear them to hear my OH when we're, say, sat together in the lounge or having a meal as I can hear him perfectly well if he's speaking directly to me, fairly close together. The problem is when he talks away from me, i.e. in a different direction, i.e. if he's looking out of the window and tells me something outside - I can't hear that without a hearing aid. When I'm not wearing them, it does annoy me that he knows he needs to talk in my direction so I can hear him, but even after several years, he still talks to the window and then gets annoyed if he has to repeat himself.
I do think there's an element of both parties having to compromise. If my ear is sensitive and I've decided not to wear the aids that day, then I don't see it's a biggie to expect OH to actually speak to my face for the odd times he talks, and not to get annoyed when he forgets!