The term Ground Zero mosque is shorthand that all the media is using. The building, I understand, is already being used for prayer.
I am sure that people of all religions died in that terrible event.
I think the crux of the argument from the people whose knuckles do not rub on the ground is that the fact that the act was done in the name of Islam. How ever misguided this was, it remains a cogent argument.
Nobody is saying that all Muslims are terrorists or are evil but the fact remains that this terrible act was done in its name.
I am sure that there is a fear that perhaps, a year or so down the road, this won't be infiltrated by some fundamentalists who would make this a shrine to the guys who carried out the terrible act.
Perhaps we should sheave our liberal tolerant nature until, after attending morning prayers at our church in down town Riyadh, we can pop across the road for a beer or glass of wine at the local pub. That is our way of life after all.