You did the right thing, you had to cancel. My mum's friend's baby was born deaf because of exposure to chicken pox during her pregnancy, and it can also he very serious for adults who never had it as children as well as people who are immunocompromised etc - as others have said it's not safe for others and you don't know who you'll come into contact with or what the risk would be to them. It's no doubt frustrating and upsetting, but there was nothing else you could do.