I think it's against the law to ban anyone from going to a wedding venue...because of the 'just impediment' bit.
I've certainly turned up to colleagues' weddings and either waited outside or gone into the back of the church to see the service...no-one has minded.
Your circumstances are different of course, so I'd let them know, but there's nothing stopping you going outside or to the back of the church.