Because if they really are a "legume" and not a "nut" how come I have never met anyone allergic to any other legume...but loads of people have other nut allergies.
That and they come in a hard shell. And are quite obviously to any one who can eat/taste/see them nuts.
I am not am I?