It all depends on your proportions re trousers. I'm 5'11" and still really struggle with trousers as I'm all leg. Non-tall trousers are also not the right proportion between waistband and crotch, IME.
I think 5'9"+ is probably tall.
I normally only get comments these days if I'm sitting down when I first meet somebody, and then stand up, unfolding my legs! Then it's, 'Oh, you're tall!'
My mum is (was!) only 4'10". I look bloody enormous next to her!