The point is you didn't give into the idiocy that prices would rise forever and rates would stay low.
You made a choice not to take on a big mortgage, other people decided to take on large amounts of debt and bid up house prices. As a result they have had a few years living in the posh house, while you have lived in a more modest place.
The question is, should you now be punished for taking that stance while people who did should be bailed out ?
This is not a trivial question, because it sits at the heart of how we want society to be run and whether or not we want people to be responsible for their own actions.
It also tells you a lot about bubbles - that people are generally happy when the bubble is inflating and they are making money, but when the bubble bursts they are crying that they should be bailed out.
If housing is that central to basic living requirements (I believe it is) then governments should manage prices in order to prevent bubbles, and their inevitable collapse.
Successive governments since 1997 have failed to do this.