I think it's pretty frowned on in some quarters if you don't wear one.
I'm fully in favour of remembrance day in its initial peace-promoting purpose, and of commemorating all the thousands of people who lost their lives.
But I worry that poppy day sometimes serves to glorify war, and to raise a kind of patriotism which, to my mind, is definitely not entirely positive.