OP, this bloke sounds worse and worse! OK so you both don't want to sleep at your shared house, but why does that mean that he NEVER comes to pick you up and take you out near where you live? If you're not actually spending the night together, what difference does it make where you go out? Please note - there is a two-hour round trip between your houses. It's the same for both of you. Roads go both ways. WHY SHOULD YOU BE THE ONLY ONE DRIVING IT? especially if you've got work the next day and he hasn't. ?!?!
Or does going out near your house just mean he wouldn't get a shag (like he can when you come to his)?
Or did he just get grumpy and weird whenever you suggested going out near you, so you're too scared to suggest it in case you lose him?
YES you might ditch him and end up with a romantic cheat. But there's an EQUALLY high chance that you'd end up with someone NORMAL -- i.e., a man who believes Valentine's Day, present-wrapping and cards are all a bit rubbish BUT DOES THEM ANYWAY BECAUSE HE WANTS TO MAKE YOU HAPPY.
This reminds me horribly of my first marriage. He was a selfish arse and I wrapped myself up in knots trying to silence what I wanted in order to keep him around. Well, congrats to me, I kept him for 10 years, and they were the longest and most miserable of my life. Yay! 
My new fiancé thinks V-day is total bollocks but has NEVER not bought me a card, a present, and cooked or bought a meal. Never. Ditto birthdays, ditto anniversaries. Real men place making their partner smile WAY above their own petty stubbornness about really quite "normal" things. OK, even if you let V-Day go, NO cards, NO wrapping, ever? That's just weird. I promise, it's weird.
This might be your first long-term relationship but I hope very, very much it's not your last. Yes he might text you when he's away (big deal), but he won't even pick you up for a date when you've got work the next day; he'd rather you drove home at night, late, alone. Love? Really?? that's not how most men show real love. Men are usually protective in love.
Stop justifying things. Read "Why men Love Bitches" (its not about mind games, it's about getting a backbone) and start running your life to best suit you. When you're young, unmarried and childfree it's the ONLY time you can do it, so DO IT.
The first step is, decline the opportunity to drive 2 hours to have dinner bought for you when you're working next day. "Sorry, doesn't work for me."