My DH has plenty of food allergies in his family, so when we had DS I did a lot of research about food allergies. The research out there seems to suggest that once you have a food allergy in the family, then the chances of getting another are fairly high. The websites offer very good advice on what foods to avoid up to 1year, 2years, 3years. (I can't remember them all off-hand, but I looked at as many websites as I could and tried to err on the "safe" side).
The point of this is that there may be other foods out there that you need to be avoiding until your child is 3 years old, in order to minimise the risk of any further allergies. (Also something to remember if you have any more children).
This does not guarantee no allergies, but it reduces the risk. So even if you only have a nut allergy, the advice is to avoid all potentially allergenic foods.
One of the foods that it is advised to avoid in the first year is ice-cream (even if DS had no other signs of milk allergy)! Other foods to avoid in year 1 are anything with flour in it. There are several others.
This food avoidance in the first 3 years is a bit of a pain, but can really pay off if it lessens the risk of allergies.
On the positive side, kids do often grow out of childhood allergies.
Good luck! Hopefully you can find a support group in your area.