To have snapped at a charity door knocker

[westonsorganic]

8.50pm, said charity door knocker bangs the door, starts booming into the hallway, dog starts barking...11 month old wakes crying. DH is trying to say, "its not a good time and its late" and the guy is pushing back saying "well I won't take long". I go out into the hallway and I tell him its not on to tap us up so late and if we say it's not convenient then thats how it is.
Anyway, curtly kill the "conversation" and shut the door. I feel rude BUT it's also so invasive and I think it's too late to knock the door. WIBU?

"well I won't take long".

"No, you won't!"

I cannot STAND this. I do try to be polite if possible but I want to scream ....something rude. I'm sorry but there are other jobs, I don't feel that sorry for people that do this.

I'd definitely be annoyed if they called so late.