Thee could be all kinds of reasons. But it seems to me that you have an underlying idea that people who disagree with you politically means they don't like people like you.
It seems to be a very common idea that some progressives have that "conservative" people actually hate anyone that is poor, non-white, gay, poor, etc. But that's usually not the case at all - in many cases conservative people spend more time and personal money supporting, for example, poor and needy people than those who identify as political progressives.
For example, the church down the road from me has many parishioners who would tend to see themselves as conservatives. They aren't particularly keen on a lot of progressive political policy ideas. But - they run a weekly soup kitchen that accepts anyone who comes, because they feel everyone needs to eat. They run a very extensive, free youth programming that involves after school activities, music lessons, summer wilderness excursions, and so on, to poor families in the neighbourhood, who are a majority non-white, because they think investing in children and exposing them to the arts and nature is deeply important. They run a free class reading foundational texts of western civilisation, taught by university professors, for local people in the community who could never afford university (and usually don't have time for it) because they think the life of the mind is something that even poor people deserve access to. They have a lot of free music concerts, and classes for children, because they think music feeds people spiritually.
So your mistake here may be that just because your college doesn't support the political policies you think are best, does not mean that he hates you, or non-white people, or whatever. He may well think that being non-white, queer, or a woman doesn't define you or the fact that he should help you out as a person.
In general, there is a differernce between progressive people and conservatives in that many of the former think they can only have friendships within their own political views ("never kissed a Tory,) as opposed to conservatives, who tend to think meaningful relationships are possible even with people with differernt political views.
So it may be that you are judging your college by your metric, whereas his is quite differernt.