I live in the countryside, and I would never walk through the middle of grazing animals, whether that be horses, cattle or even sheep. I'd give goats a wide berth as well
Unless you want to make a huge detour (often miles) you don't have a choice in many areas, though.
Seriously though, I was always taught to stick to the field edge. You not only avoid treading growing crops, but if its a grazing field, the idea is you have a fence to climb over (or through) to escape if necessary. I'd climb the fence if cattle or horses surrounded me. I'd go back the way I came if it wasn't possible or simply not go that way.
A right of way doesn't mean you can go wherever you like in a field, though. You have to (by law) stick to the path, and very often, that path is diagonally through the centre of a field as that's the quickest route to get you from A to B. It's actually illegal to ignore the footpath and skirt round the edge of the field like you describe.
There are a surprisingly high number of deaths and horrible, serious injuries caused by grazing cattle to people walking through their field. And don't act confrontationally - confrontational to grazing animals generally means facing them straight on and looking into their eyes.
According to this article in the guardian: "Between March 2000 and March 2020, 98 people were killed by cattle in the UK, according to the HSE. Of those, 22 were members of the public, with the rest being either farmers or farm workers."
So 22 members of the public in 20 years - barely one person per year. Considering there are over 9 MILLION cows in this country, that's a TINY percentage. Dogs kill more people than that in a year.
www.theguardian.com/uk-news/2020/sep/23/farmers-union-issues-warning-after-teacher-trampled-to-death-by-cows