If they come to understand & to know how people affected feel, then yes it is racist to carry on
Sure, no one disagrees with that, but you actually have to be right about it’s origin to be affected, the point everyone is making is you and the op are not, as in this instance the origin of a pale is absolutely not the English and the Irish, a pale was a very common thing, used in many countries, in many contexts, and well before and after the English Irish. In fact it started well back into the 1300s or before to define settlements I think.
Again, it’s like the Berlin Wall, a wall is also a very common thing, which started well before the Berlin Wall and continues to this day, we all have walls, you can’t say that’s racist to use the word wall, like you can’t say it’s racist to refer to a pale.
And ps to the poster who corrected me on who built it, yes you’re right, my apologies.