I have intolerances due to various health problems, but nothing serious.
I have interstitial cystitis and can't drink anything other than water or milk otherwise I develop uti which hits my kidneys too and makes me very unwell.
I also have severe sinusitis which is incredibly painful when I get flare ups. I'm getting worse and flaring up 2-3 times a week now. The pain was so bad last week I threw up 
In desperation, I've cut milk/dairy out and I feel better and can breathe easier with no sinus pressure.
So now, I can only drink water and bloody coconut milk (I can't stomach other milk substitutes).
I also avoid wheat and other grains otherwise I get stomach ache and bloating and I need to go low carb to lose weight anyway.
I loved milk, cheese and yoghurt 
It's bad enough not being able to have tea, coffee and alcohol, but I've always been a total milk head and this is really upsetting me. As for cheese, well I'm gutted about that too.
Do you get used to a restricted diet eventually?