If you are called Brown, you'll be "the Browns"
But what if you are called something like Vargas, for example? Is it "the Vargas'" or "the Vargases"
I have seen pedants using the former, but have never felt comfortable with it, it just doesnt look right.