The writing of Anne Lawrence (an autogynephilic transsexual) is interesting:
annelawrence.com/becoming_what_we_love.pdf
who has also published a book 'Men Trapped in Mens Bodies'. The 'I've got a ladybrain' narrative isn't universal.
And a very interesting link to that survey article from elsewhere (sorry, can't find it at the moment, and I'll admit I gave it only a quick skim), but which seemed to be saying that rather than the simple, male brain/bits of brain - female brain/bits of brain, with trans somewhere in the middle, instead it seemed to be saying trans was not just in between, but distinct. Whether this is innate or neuroplasticity, it definitely is more complicated than the simple ladybrain arguments.
Ah, found it!
Archives of Sexual Behavior
October 2016, Volume 45, Issue 7, pp 1615–1648
A Review of the Status of Brain Structure Research in Transsexualism
One quibble I have with this article, it compares homosexual M2T and homosexual F2T to heterosexual males and females. So in some sense you are seeing a double effect when you make that comparison -- the possible difference between heterosexuals and homosexuals, and a possible difference between homosexuals and transitioners (who by that want to be seen as heterosexual!). Add in the usual small sample sizes and lack of statistical significance in some cases.............