I think you fly off the handle too quickly. He asked something which you feel is not respectful, but he may not have known that, he may have intended to be rude. Why couldn't you calmly say "well, to be honest, I think that's a bit much to ask: I will try to keep a low profile, but I won't erase myself, that's not fair to ask"? Why do you have to punish him?
Can't you imagine a situation where you might ask another adult to keep out of the way? They might agree, they might not agree, but would you feel it was so disrespectful you had to cancel a day out?
The other risk is that overreaction now will soon result in him just laughing at you. I very rarely punished my children after they reached puberty: I wanted them to feel that I was not afraid of losing control. Punishment was for deliberate infringement of a clearly stated and known rule.
The aim of the exercise is that in the next few years you will become adults together, if not equals then very close to it. It doesn't happen overnight, but you need to both remember that you are working towards it. In years to come, do you want him to cancel a visit home if you get the tone slightly wrong, maybe make a joke that wasn't quite appropriate, or hurt his feelings unintentionally? Or would you like him to think that adults can actually manage with a quiet but firm
"No, I am not prepared to put up with this; it is not appropriate"?