Some of it is tedious but a lot of it is either an annual or every few years sort of thing.
For the regular stuff - bills, utilities, appointments - direct deposits, standing orders, online banking and bill payments and calendar reminders will have you sorted and those really should take no more than 5 minutes. Also, scheduling your next appointment while at the doctor's, dentist's, vet's and putting in a reminder on your phone takes the work out of that step.
For the annual things - insurance, Christmas, birthdays etc. - I think the key is doing it as far in advance as possible. Everything feels more stressful when you're close to the deadline. I've also found stockpiling things like cards, gift bags, tissue paper and a few small stocking/gift stuffers (to add to the main gift) or buying during a sale and putting away months before the event helps with the stress factor.
For the ad hoc things, general organisation helps. For eg, ensuring that the vet's emergency number is easily accessible so a stressful situation does not become more so. Saving bank account numbers, ID/DP/PP numbers on your phone so you don't have to go digging around to find it everytime. Having scans of your important documents and saving them on OneDrive or the Cloud so you can always access a copy.
There'll always be the annoying, take-all-day tasks like renewing your passport or driver's permit but thankfully, those are not too often. And I say this as the person who lives in a country where these public services do not have an appointment system nor do they use computer database systems so the process is beyond tedious.
I do not have children, so I cannot contribute there. It must be especially hard for parents of kids with special needs or disabilities.