Yes you have to have rules. Native speakers of English naturally understand the rules of their own language - the pedantic arguments only over cover a very small part of the full euphony of the english language. (see what I did there ;) )
But consider who sets the rules.
A study of the history of almost any word will show you that it existed with multiple spellings for quite sometime.
People used to write as they spoke before standardisation happened! Even our beloved Shakespeare used spellings that would make modern grammar fiends weep.
But then along came some learned men who decided that we needed to standardise everything.
And then lots of people wanted to teach the illiterate and uneducated peoples of the countries of the Great British Empire.
And then the education of the unwashed masses of the poor in England itself.
Where does the power lie in all of these choices? It's almost always change from above and from positions of power.....
Change in language is good, change in language should be embraced. We don't yet know how the modern literature of today will be judged by the future - but I suspect some of it will be as widely appreciated as any 18th C, 19th C classic.
All we have proven is that trying to write down the spelling and rules of English is a bit like trying to stop the world from spinning.
Change happens - get over it.