I joined one a few years ago as I (also) was incredibly lonely. I saw a facebook post of theirs and joined an Alpha course (alpha.org/) with them, so had ten weeks of lovely supper, videos and discussion, and got to know those people. I liked everyone and everything so much I then joined the church where it had been held.
In terms of social contact, it’s been a Godsend. I now have friends in the area (I had lived here for a decade prior to that!). I’ve met young and old and lots in my peer group (40s). When I knackered my ankle last year, people brought me bags of shopping round.
Yes church is about faith, and I found it, and it is amazing! However no one is going to quiz you, no one is going to push you to convert, everyone is welcome/welcoming, and ultimately what you believe is up to you.
Something like the Alpha course is religious discussion, services are prayers and songs (catchy anyway if there's a good band), but as people have said, some run ‘less churchy’ things, eg mindfulness courses. I once went to a delicious women’s breakfast at one, one locally has just set up a cafe, and the CofE one down the road normally has a beer festival about this time of year.
Your local one sounds like a great place to start. However there are so many different types and sizes of churches and lots of ways to find them.
I thought you had to christened to attend church - definitely not . You have to make a commitment to become a member and vote on eg the new minister, but anyone can walk through the door!