Liberalism was developed by rich men for rich men. It works for rich men because removing state interference benefits those who have enough power that they can interpret their lives as a series of choices, preferably unfettered by the need to consider other people.
The state has harmed many vulnerable people. Look at the track record of socialist countries (eastern Europe decades ago, the USSR, Cuba, China, North Korea) when it comes to gay people, for example. Liberal countries get a lot of shit for taking so long to decriminalise gay sex, but actually, they've always been light years ahead of socialist countries on human rights.
I apologise that this was a bit of a tangent, but my point is that liberal countries have the best records on human rights. When you give people a simple list of rights and remove direct interference from the state in their lives, vulnerable people actually win.
Just as liberalism is neither good nor bad in itself, the overlap of views on a particular topic says nothing about an overlap between the beliefs that underlie any particular approach. The feminist approach to prostitution is based on fundamentally different analysis than that of patriarchal conservatives. Even liberals and conservatives overlap on some issues (such as murder or theft). The association of feminists with conservatives has generally been used to discredit feminist analysis by those too lazy or lacking in analysis to try to discredit it on its own foundations. Even you would likely agree with Pope Francis's views on murder.
I understand this, but the key thing to understand is that there IS, in fact, some overlap between the mentality of patriarchal conservatives and anti sex work feminists. It's not just that they both want sex work to be illegal, but there is some similarity between their thought processes, and how they express those thoughts. For example, what's unquestionably common to both patriarchal conservatives and anti sex work feminists is that they both view sex workers as being weak, exploited, and believe it's the role of a strong state to protect weak people such as sex workers. This is miles away from what a liberal would argue on the subject!