Let me preface my post by stating that I am a stickler for etiquette (I still wear gloves with ball gowns, and would never attend a church wedding without a proper hat, oh, and I am also under 40), but I think you can definitely wear this if you pair it with a brightly coloured top and accessories.
You need contrast, but I would stay away from black as I find it too harsh. Depending on your colouring, you could pair it with something brown or bronze as you pointed out that it's more ecru than ivory. If it's for a late spring event, I would also consider a coral or peach top and gold shoes, bag, jewellery, etc.
Now, I am assuming that this is an evening wedding, as black tie is inappropriate before 6 o'clock (-->etiquette stickler).