You can respect TW (and TS) feelings, needs and preferences to not be placed in the male estate, and there are certainly many issues of safety and vulnerability to be faced here.
However if you do that, you also have to respect women's feelings, needs and preferences not to have male people in the female estate, and they have just as much issues of safety and vulnerability of their own.
To provide male prisoners with this respect for needs and feelings without extending it equally to female prisoners is male rights activism. Obviously not ok. Females are not put on this earth to play second fiddle humans, if under this ideology they have to suck up being afraid, harassed, assaulted, no privacy, no dignity, no care or interest in their voices, then I'm afraid my answer is then my answer is what is sauce for the gander is also sauce for the goose. Male prisoners will just have to suck it up in the male estate too.
If however there is going to be equal consideration of male and female needs, voices, feelings, then the only proportionate compromise is specialist wings. The answer to 'but this is segregation' is that every trans prisoner would have the option of their sex based provision or this provided alternative. This would also provide TM (who interestingly no one ever talks about or shows interest in the needs and feelings of) with another option where at present they are sex based and lump it.
Again, demonstrating: this is not about trans rights at all, it's about male rights activism, which seeks to establish female people of all identities as lesser.
Fuck that, frankly.