You need a MUCH better GP.
A good therapist (do you have self referral where you are?) will help you unravel the deep seated reasons.
A genuine friend will understand.
That said - for YOU it would make your life easier to get help. It sounds to me like perhaps a form of agoraphobia (which I also suffer from) people think agoraphobia means not going anywhere but it has levels. When I'm bad I can't leave home - not so bad can go to certain "safe places" within a certain distance of home, doing pretty well - with help can consider new places.
I may be wrong depending on your underlying reasons.
Good luck for sorting this
"The only way to get over this anxiety is to just do it."
"I agree with the poster that said the only way to conquer this is to do it."
Utter nonsense! This is not advisable - it used to be considered one form of possible treatment but has now been discredited as if anything it makes anxieties WORSE. Please if you don't understand mh issues don't comment - you could cause real harm. Do the posters saying this realise it's as ignorant as telling a depressive to "just pull yourself together"

Wow and now people with mh issues shouldn't accept being a bm? Are we supposed to have no life then? Glad my friends are more empathic and understanding
It CERTAINLY doesn't make op a "less dedicated friend" if I found a friend of mine thought that of me due to an ILLNESS It would be ME dropping THEM!