I could've written this myself 18 months ago 
If does & I promise get easier, the anxiety does ease off as you become more confident.
I wasn't depressed but totally overcome with pure heart racing anxiety.
I ended up diagnosed with Post Natal Anxiety and Post Natal Trauma.
Thought meeting great people at baby groups & clubs etc, I realised I was not alone.
I also visited GP who advised medication but that didn't work out for me. My HV "questioned my bond with DS" which made me feel worse 
18 Months on, I still treat every week as a milestone. But the anxiety has subsided (yet still there) and believe me those feelings of "I wish I never got pregnant, I want my old life back" fade, they fade because it will all be ok.
I urge you to get some support, be kind to yourself, remember things have to give a bit & have faith you WILL be ok 
Oh and use Mumsnet even if it's to rant! That helped me.
Look after yourself - the fog will clear x