It sounds great chubby.
To be honest, I think there is a bit of an emotional 'script' that people rattle out about this (like lots of other areas in life: weddings, breakups). It doesn't fit everyone because life just isn't one size fits all. The script says that you're supposed to fall dramatically and head-over-heels in love with a house, to the point that you're practically willing to bankrupt yourself to get it. This has never happened to me. I am far to prudent and square for it ever to happen I think (and too liable to get anxious about big decisions ever to have that unalloyed rush of pleasure about them). In my more cynical moments, I sometimes think that that head-over-heels experience is often being in love with how it would look to other people to live in a house and not what it is actually like, IYSWIM.
The house I live in right now was bought by DH before we were together. I probably wouldn't have chosen it, certainly it would never have made me feel that head-pounding desire to possess it. It is a very, very standard and modest house, with nothing particularly special about it. But it is perfect for us, because the location is great, the neighbours are great, it's neither too big nor too small (apart from the kitchen, which we're extending), the layout works for us, it's warm, I have a decent sized garden, and it's so far within our budget that we can have a really lovely life around it doing the things we really want to do. I've really grown to like it a lot, to the point that I don't think we will move for very, very many years, if ever. While it remains a standard house, it's what it does for us that makes it amazing.
If your instincts are telling you it's wrong, then listen. But if you're worried simply because you don't feel as strongly as you "should", that's not necessarily a sign that this is a bad choice!