Is it likely to be because they look at your profile a lot? The person in question doesn't live near me so we don't frequent the same places and we are not in the same groups etc. he used to have my number but I've made sure Facebook doesn't have my mobile number in there any more.
I know nobody really knows the answer to this but I do think that list must have something to do with who has looked at your profile.