Some other dog owners are about my biggest issue, my on lead dog got attacked by 3 off lead dogs a couple of weeks ago, it's not the first time and won't be the last because there's a few around here that seem allergic to leads and have no control, no matter where they are.
That's stressful, luckily she wasn't injured, but it's set her right back socially again, which makes walking harder.
I genuinely don't mind the walks in all weathers, the mud, hair and general neediness, can see it being frustrating to not have 5 minutes but maybe I'm needy too because I really don't mind, which is good because I just got another one. I don't mind missing holidays or days out, or having to arrange my life around them because they give me so much and I'd rather spend a week off exploring with my dogs, playing, training, relaxing than going on holiday. I have someone who will look after them short term like a weekend/couple of days, but they're a choice I made and that I'm happy to make.
The worse thing is when they're ill or when they go, it's heartbreaking and like others have said, knowing if they're really actually happy with the life you give them.