I can empathise with that - when you don't know the people but have either firsthand experience of or information bombarding you about things carried out by people who on some level seem similar to them, it's understandable that there's apprehension there.
Most Muslims I know are pretty ordinary people (although that's from my own perspective, so maybe we're all just weird and I can't tell! (joke)). Given the current climate in the UK, some people may be just as worried about their safety around you as you are around them, but if people can find a way past that, we've far more in common than not. Eg, I may be a Muslim, but I'm also: a mum, a working professional, a borderline coffee addict, a tech nerd, a runner (currently on a bit of hiatus though), an animal lover, a terrible cook, and many other things. Oh, and currently deeply regretting getting my DC into drumming. We probably have at least one thing in common (for your sake, hopefully not the drums!).
As for men, while some practising Muslim men (from certain schools) prefer not to physically touch women to whom they're not related, many men will be fine to speak with you, so you don't need to feel like you can't speak to any Muslim man. Different people will have their own boundaries on what they feel is appropriate for them. My DH, eg, is quite practising but is happy to interact with anyone within professional and social boundaries that feel right for him (eg he doesn't really want to hug anyone but wouldn't ignore or exclude anyone because of their sex or faith).