I'm not very sociable, so I may be wrong, but if there were no tables free and you saw someone sitting on their own at a 4 seater, would you ask them if you could sit there, or just sit down and pointedly ignore them?
I'd have said yes if they asked......