It sounds like if you have children, DH & yourself will pretty much be the sole carers. So going out as a couple, or going out at all maybe something that doesn't happen for 15 years, unless you know of people who could look after the child that you trust.
Being a parent is rewarding, when you get a newborn it's day & night possibly 24/7 if you get a baby that doesn't sleep. You have groups you can go to so you'll make friends with other parents. Pretty much your life will be devoted to parenting. You could go on spur of the moment breaks still, you'd have a little one with you, so what you did whilst on holiday might differ to what you do now.
You can still go to fancy restaurants, most make provisions for babies / small children. Personally we've not been away anywhere hot as we considered children on a flight and in a different environment, where you'd have to be more watchful of the children round pools, near the sea etc. So we tend to stick to places around the UK. So you have a base and travel from there.
You can still have friends over, with a bottle of wine / take out. It does put pressure on your relationship as you're often sleep deprived, only one of you can go out. Your time is mainly day excursions, or you could take DC to a pub, but if you like partying, one half may end up resenting the other half for going out and getting wasted, as it pretty much writes off the next day.
How does your husband feel, does he really want children? Is there a reason you're worried about him leaving you with DC to look after alone, like health issues?
I was desperate for DC, I had a few moments where I thought what have I done. But they were usually linked to sleepless nights and frustration over situations.
The best thing to do would be to talk to your DH, he might be having similar reservations, but afraid of saying anything in case it upset you. Just say what you have on here, or sum it up as you know having a baby will mean many lifestyle changes plus IVF can be and usually is a roller coaster journey. Does he like life as it is at the moment, can he imagine adding a baby into the mix?
One thing I would say is take precautions as it's usually times like this that Mother Nature might consider to bless you. So you could go to a clinic and get the pill or something. If they ask why just say your going away and you don't want to get caught because of Zika. That's a fair enough choice.
I'm sorry you're going through this alone, have you looked into any of the fertility websites and forums? They'll have people to talk to going through the same as you. Hopefully you can make some friends to talk to online.
I hope nothing I've said comes across as harsh. It's just things that you're already thinking about. You need to think of in more detail.