Most violations of women's rights don't involve a failure to 'know what a woman is' and to give particular protections to women. They involve (men, generally) being all too aware of what a woman is, and excluding women from the rights given to men.
What you are talking about is really women's safeguarding rather than women's rights. Now, women's safeguarding IS important- no denial there. But it shouldn't be used as an excuse for denying us our rights to equality with men, and to send us back to the kitchen, and to the role of submissive wives. And people, from the Trumpsters, to Orban's supporters of 'illiberal Christian democracy' to, at the extreme, the Taliban, are seriously threatening the rights of women (and gays and ethnic minorities and dissidents). Not because they are unsure what a woman is, but because they're all too sure what a woman is, and want us put in and kept in our place.
I don't think most British Tories do have these views; but I do think that the right wing culture warriors pose a real danger to society; and that safeguarding concerns, important as they are, should not let us sleepwalk into allowing ourselves to be sent back into pre-1970s 'conventional' women's roles, and to be deprived of hard-won social, reproductive, and economic rights. Even as regards safeguarding- let's not forget that there was no legal concept of marital rape in the UK until the 90s.