That sounds more like the holiday isn't accommodating of your needs.
For future holidays, you need to ensure that your needs are taken into account.
This means such things as;
Easy access to your accommodation. No traipsing up and down a million stairs.
A comfortable bed.
Walk in shower.
No having to walk a mile to and from transport.
No trying to sleep on the ground in a freezing tent and being expected to leap up and cook bacon and eggs on a calor gas stove.
Activities scheduled with rests - places to sit/things to sit on, stash of snacks in your bag if you need something to tide you over or to go with medication. No long walks followed by grabbing a takeaway followed by a long walk/trailing around a massive site. Any strenuous activity followed by rest, not another one. Or you do some things together and then have the freedom to rest or do something restorative afterwards, such as going to a pool where DH actively looks after the kids and you just float about for a bit.
Not having to do shopping and cooking. This might mean all inclusive, but it could also mean ensuring you're near places where you can have up to three meals a day not cooked by you. If self catering is vital, then somewhere with a dishwasher so you aren't washing up as well as cooking - and DH can cook.
Could you benefit from a mobility scooter hire? If you haven't gone somewhere by car, could you arrange for assistance? Are car journeys planned to give you the opportunity to get out and move, rather than staying stuck in one position for hours?
It's not all about everybody else. It's your holiday, too and you are entitled to make these needs part of the essential conditions of going on holiday.