I can't think that there is any American phrase, word or accent that I wouldn't understand, but I wonder if an American would understand everything I say.
I remember sitting for a meal with some people from Boston and being acutely aware of needing to edit what I said to remove any British idiom. It was an odd feeling as when watching American films I forget they're a different nationality.