OP - I'm a feminist and still a christian.
I struggled for years with this, especially having been brought up in a very strict sect where women were supposed to dress in a certain way, never speak and become good housewives, and nothing else!
However, I have discovered, through much reading, that the Bible is radically pro women. Jesus took time out to speak with women, even/especially those rejected by society, this was radical and was scorned by the (male) leaders of the day. There is language in the OT, particularly the Psalms, that aligns God with the feminine ie metaphors of childbirth etc. The new testament is full of references to women, which, when put into a cultural context, all show a radically different view on women to the culture of the time (and British culture over the last centuries). "In Christ, there is neither male nor female" is one very small example amongst many.
The problem for the church is the twist that men have put on the scriptures, over centuries past and that church leadership has been, and still is, dominated by men. I still meet men who I know are afraid of letting women lead, even though they themselves pay lip service to the fact that Jesus himself, and the letters, advocate gender equality.
However, all is not lost! Read the gospels and the letters slowly and you will find this!