I think most men have not given the issue of the hijaab much thought, I would imagine they go with what they're used to seeing the women in their household dress in.
My husband was completely shocked that I was taking my hijaabed self to India with him (for our first family holiday with the in-laws (shudders at memory). I had to gently explain to him, that ermmm I always wear the bloody thing, how can he have missed it-after 7 years at that???? After much debate (on his part, I wasn't listening it's my body), he accepted that the hijaab was staying (I honestly wonder sometimes whether my husband would notice if another woman was in my place, he's so unobservant at times....must ask him if he knows what colour my eyes are).
Wrt to the terorrist thing, because a muslim woman in a hijaab/veil obviously stands out as a muslimah it does make people think 'terrorist' (imo) mainly because the media is very careful to label only muslims as terorists these days. Take a look at the news, an ex-BNP member was found to have a load of chemicals and rocket launchers, which barely made a ripple in the national papers, a house with a muslim person living in it has been found to contain a barrel of potatoes (or some such), and it's suddenly a ricin plot.
I watched a very interesting American show a while back, an devout christian american man was asked to live as Muslim for thirty days with a muslim family, the outcome was very interesting, as were his experiences at the hands of non-muslim when they thought this man was a muslim.
It's going to have a lot deeper repercussions than the IRA/terorist thing IMHO, as the Muslims as teorrist/Islam as religion of evil is touted by the US, UK , France, Germany, Denmark (who did portray the spiritual leader of Islam as a terrorist) etc.
And Islam is by and large cosidered to be a strange religion followed by people a strange people.
Not so with RC/Protestants. Although I thank God I'm too young to know of the hositlity the Irish must have lived through.
As an aside; interesting fact Hamleys in Oxford street has a bomb proof basement. We were told to make our way there should there be a bomb scare when I was a sales girl.