Men don't have a monopoly on sexual assault.
Erm to be fair, men certainly do have a monopoly on raping people with their penises.
I actually think this would be a good idea. There needs to be a brutally hard delineation between the general trans community and sex offenders, the people who benefit the most from this are trans people.
If you rape someone, murder someone or sexually abuse a child, you are permanently done as far as gender reassignment goes, you will never be allowed the rights, responsibilities and access you would need.
We do no less with other big responsibilities - childcare, working in the police, firearms licenses, the list goes on, and I don't think you could make the conditions easier to abide by than "Don't rape kill or sexually abuse anyone" so about 100% of trans people with genuine motivations would be fine.