The only talk of vaccine passports I've heard is certain people wondering if this might become a thing.
There are a number of counties that you can only visit if you have had certain inoculations, it's not unusual so yes, it's a possibility that at some time in the future a lot of counties will only allow people to visit who have had covid jabs, or if they can't for medical reason, will need to get an all clear.
How is that penalising people like you OP? The government is planning to offer covid jabs to all adults eventually. If you don't take up that offer because you are a healthy 40 year old, or for any other reason then that's your prerogative.
I've recently had my jab because of my age at no point has anyone suggested to me I'm clear to start booking holidays to exotic places. Me, people like me and vulnerable people of all ages are still being told to continue to follow the rules they been following for what amounts to almost a year.
And no, you and your children have not sacrificed everything to protect the elderly and vulnerable. The lockdowns and all the other measures were put in place to stop the NHS from collapsing under the onslaught of sick and dying people.
And yes, that has included a great many elderly and vulnerable people but increasingly it's including more and more, otherwise healthy people under 50.
Clearly, and not just on MN, there seems to be a strong body of opinion that as people are old or vulnerable their lives matter less than younger people, mainly those under 50.
Perhaps now covid seem to be affecting a lot more younger people, perhaps those younger people who feel they're being hard done by will start to take it more seriously and realise that this affects everyone.