I think men are more afraid than you'd think, we just aren't allowed to display that fear openly.
Perhaps I view it differently to other men, I don't know, because I was always a "target" in my youth because of my size. Very tall, freakishly tall, but overweight and "soft" looking I guess. Groups of lads would harass me for sport, because a fat guy can't give chase, and they'd only do it when there were at least 3 together. It was mostly verbal harassment, but I got a fair few punches aswell in my time, particularly when someone was trying to impress a girl. A kind of "look how hard I am, I'm gonna fight that big bloke" situation.
As a result, I learnt to be far more observant, both out on the streets and in pubs etc and could spot the ones likely to cause me issues early on. Group of lads smoking outside the co-op? Cross the road and head to a different shop. Some drunk/drugged up guys in a bar keep looking at me across the room and nudging each other, time to leave.
Would I go for a walk right now? Where I live now, yes I would. If I was at my mums house, not a chance because of the area she lives in.
I used to feel relatively safe in my home town, untill a guy I knew (had been at my school, we drank in the same pubs, knew the same people) was beaten to death with a metal bar whilst walking down to the taxis from the bar after getting his kebab, in a mugging gone wrong. It was a route I'd walked myself alone many times and had never given it any thought because I "knew" the area. Makes you look back and see how many stupid risks you took when you were younger and how things could've ended up so much worse aside from luck being on your side at the time.
I can never fully comprehend what the fear must be like for a woman though because, and Im.sorry if this is too blunt, I don't fear being raped. I can be mugged, I can be attacked by someone off their face, or a group of guys are bored and just want a fight, but I'll never be attacked with sex in mind. Maybe that's what makes it so different for men so that they aren't as afraid all the time? You can spot the guys likely to.mug you if you're paying attention, so it narrows the field a bit. For a sexual crime, it could be any man. The taxi driver I've just had a good old chat with on the way home and
I think he's been a sound guy, could pick up a girl on her own next and become a totally different person. The danger isn't focused, its potentially everywhere.