Willow, I was you a few years ago, except I left it even later to buy - I was in my late 40s.
It took me years to pluck up the courage to buy but I kick myself that it took me so long.
I found a great place about three years ago that I could have bought but didn't as I had anxiety issues of the kind that you're having, plus I had reservations (which, looking back, were really stupid) about the flat itself.
Because I dithered, a year later prices went up and I could no longer afford this type of flat - it had a garden, no service charges, a super-long lease and was in a nice, clean, quiet residential street.
I ended up with a smaller, more expensive flat (high service charges and lease that will need extending soon) in a worse area (fly tipping is a problem). I love my little flat but still kick myself thinking about that first place.
Having said that, if I hadn't bought when I did I wouldn't be able to afford to buy now in my area and the flat has increased in value by £60k in less than two years (London).
Wish I'd done it years ago and not wasted tens of thousands of pounds in rent. I do understand how you feel though. It might help to remember this: "Everything you want is on the other side of fear" and "The fear is always worse than the reality".
It has certainly been true for me and I had exactly the same conversations with friends who had mortgages: I was terrified of the commitment and of wiping out my life savings overnight with the down payment.
I always remember one estate agent who told me she hadn't bought and regretted it. She said: "I never liked anything enough, but now I am priced out and still renting. Being fussy got me nowhere."
Take a deep breath and do it - good luck!