It depends. There is nothing in the human condition that says that women have to be oppressed. There's nothing inherently oppressive about being a woman. It's just something that lots of modern societies do for convenience.
Some societies in earlier history did not oppress women. For example many Native Americans had equality in gender or even reversed gender roles, and many other indigenous people have multiple genders with multiple roles, and no oppression attached to those genders. Today some indigenous people are trying to bring back the traditional ideas about gender, such as "two-spirit" people who have both male and female genders and play an important spiritual role.
Or for another example, indigenous Australian women traditionally had equality and parity with the men of the tribe and were not oppressed because of their gender, because they had equal rights and responsibilities in the tribe. During colonialisation, their social and gender roles changed and now indigenous Australian women experience lots of gendered violence at the hands of men. The Aboriginal men now argue that this is normal and that women have always been oppressed, and it is traditional/natural to be violent with them. But historical evidence and anthropology says the opposite, and agrees that for most of their history indigenous Australian women were not oppressed. The society just became oppressive after being colonised. This is an interesting summary of research by the government: aifs.gov.au/cfca/publications/child-abuse-and-family-violence-aboriginal-communities/aboriginal-beliefs-about-gender
So while most of the societies we currently experience DO oppress women based on gender, this is not the default state of human societies.
There are still societies in the world today in which women have different gender roles than we would consider normal. For example in rural China there is a matriarchal tribe called the Mosuo who are famously described as "not having husbands or fathers" and they continue to live that traditional lifestyle. Now they have made it into a tourist thing.
I think if you say "all women are oppressed by society" you are maybe only thinking of Britain/America, or maybe the Middle East. But that is not all of the women in the world. And saying it this way suggests that oppressing women is a default state, which is problematic. It isn't natural, it's just common.
Even if there are only tiny minorities of women around the world who live different lifestyles, I think it it is important to recognise them, especially since they give good examples of how gender roles could be different and it makes us respectful of how other cultures live.