Red ant and growing fruit/veg

[StarlitTrees]

I have a small section of my lawn that I want to turn into my growing area. I want to take out the lawn and put in raised beds and gravel paths.

The problem I have is that side of the garden is loved by the red ants in the summer. I had numerous ant hills on that part of the lawn and I'm wondering if they're going to scupper my plans.

Before I spend time and money on this, are they going to cause me problems when it comes to growing anything?
I'm planning to grow potatoes, leeks, cucumbers, carrots, tomatoes and strawberries.