Of course it matters if they piss off. They’re not just taking their money, but their businesses and their investments in the country. That’s employment, wages, growth, etc. Even if you don’t think they’re paying what they should, a greater number of net contributors will produce more revenue. As it stands, the outflow of wealth is putting a greater burden on those with less.
The ‘piss of then’ attitude isn’t offending or hurting those it’s aimed at, because they’re gladly pissing off and not looking back.