Also, I kind of object to the idea that maternity leave gives women 'me time'.
I don't think it gives a woman "me time" in the sense of relaxation but it does afford her the opportunity to take time off to pursue what she considers a worthwhile and fulfilling endeavor. There are many worthwhile, beneficial-to-society endeavors that do not involve procreation and with reproduction being a 100 percent voluntary choice, it would be nice if all workers could take leave to pursue their voluntary choices as well.
If every worker received, say, one six-month break every five years, she/he could use it as she sees fit, for reproductive purposes or otherwise. We'd all be funding one another's leave and there wouldn't be so much resentment and disdain.