Mairimac, lactose intolerance/milk allergy manifests in many different ways so the fact that you have one symptom doesn't necessarily mean that milk is the culprit, as it could be anything else (like raspberries )
DS's case is not very conventional, during the time he had dairy products (up to 28 m aprox) he had eczema (very severe in the first months manageable ever since), he had a perennial bloated tummy and chesty cold, he was always heavy breathing (has asthma), constipation was a permanent problem, and was very very placid, so placid that by 2.5 we were worried about his development as he walked and moved like a child one year younger.
Anyways, when he was 2 he had a reaction of peanuts and we ordered an ELISA test (which included testing for many other allergens) that came with such strange results that we decided not to take it very seriously until he had a RAST or Skin Prick test, but decided to remove dairy in the mean time as the test showed him to be very intolerant to it.... so...
within two weeks, DS "chesty cold" was gone, his asthma got much better (no heavy breathing), the permanent bloated tummy and constipation were also gone and DS was full of energy, he is already catching up with movement and looks more like a child of his age. Eczema flares are almost gone, we have only had to use HC once in the last year.
Now, DS's case is a bit extreme, so not a good reference at all. (He is also allergic to fish, egg, nuts, soya, etc. oh bananas included hence him not being able to use Bananadophilus)