My husband and I took our toddler on 3 holidays last year when she was between 1 and 2 years old. Here's my recommendation:
Don't do it 😂
Instead, take the week off of work, send your toddler to nursery or grandparents if you can, and spend your holiday money having days out with your partner. Spa days, nice meals, museums, all of the wonderful things you used to do before children.
The packing, travelling, trying to stick to a routine (our toddler doesn't do well out of her sleeping routine), trying to find toddler-friendly food, etc were just not worth it. I came back exhausted and cranky every time.
Lots of people seem to genuinely love holidays with small children, but if you prefer relaxing holidays and want to come back refreshed from time off work, I recommend day trips close to home instead.