Times tables (and prime numbers) are pretty much essential for all other areas of Maths. Try solving or simplifying an equation without knowing them - much harder and takes a lot longer. I've never understood why people are so against learning them. It's not rocket science to rote-learn them. My only concession would be not to go up to 12 (as we did back in the 70s) at an early age - just go to 9 (9 is a massively important number, especially for looking at "spotting patterns" and also error checking (a transposed number always divides by 9, i.e. if you have a difference of 27, it's almost certainly going to be a number written down wrongly, i.e. 114 instead of 144 - difference 27 and if you know your 9 times table, you can see instantly it divides by 9!
Same with prime numbers, apparently these days you're taught the equation to tell you what the prime numbers are, which is a hard equation (for young pupils) - why not go back to how I was taught which was rote learning the first 10 or so prime numbers - that covers 99% of the times when you need to know them - if you want to know a bigger prime number, then use the equation (or your smart phone!).
All this "anti" times table angst really annoys me. If so many people find it too hard to learn a few numbers, they're being taught wrongly. Are teachers explaining the patterns or why they are useful and giving examples (i.e. being taught tables alongside simple equations) - I suspect not, in which case, I can see why they're boring to learn if there's no context nor use being given. Learning anything with no context/background is always going to be harder and more boring than learning something that means something and where you can see a use.