Hi striped - i am sorry that you are going through this, i understand totally as my anxiety does this to me. I was worse in the morning because that is when the cortisol peaks, so i would wake up and be on defcon 9 and not even know why! I am on ADs (citalopram) and they work for me. I am also having counselling.
I think that you should consider ADs as they are not a miracle cure for anxiety actually but they stop that horrid fight or flight feeling that i get for absolutely no reason. That frees my mind up to deal with the other stuff that are the root of the problem. Of course it is up to you, but i think you are making things harder for yourself - if you were diabetic you wouldn't try to manage without insulin. If you get a headache do you take paracetemol? It is just the same with anxiety and depression, whatever the reason you get them, they throw all of your neurotransmitters off kilter - so even if you don't have a labelable condition like bipolar or OCD your hormones can be all over the place. Hormones does not just mean all things gynaecological - insulin is a hormone. Many ADs work on seratonin, another hormone that works in the brain and is involved in many processes. It often gets thrown out of balance during pregnancy and post-natally. Sometimes our bodies need help to put this right. It doesn't have to be forever and ADs do not change your personality. I am more "me" on citalopram than i am off of it. I do not however think i will be on it forever. If you try and look at your illness as just that, taking logical steps to overcome it will seem to make sense.
For instance, if you injure your back you would take painkillers and anti-inflammatory drugs, once you are able you would then undertake physiotherapy/exercise to strengthen it again.
Exercise is fanstastic for anxiety - it helps to stimulate neurotransmitters, running, swimming or cycling. I find running helps me, but it buggers my hip so i cycle. I find that wthout the ADs, if i cycle i have a panic attack, fine with them.
I am not saying you should have ADs, but just putting the other side across. Good luck, i know how damaging anxiety could be - i had health anxiety at one point and was almost suicidal because i was scared of dying - go figure!