Definitely not at their house, even if it was a long time friend, first time exploring something romantic situation. It's so intense being in someone's home, even just using the loo etc it's too much. And no natural ending to the date which could make it difficult to leave.
But a first date with someone I didn't know well, I wouldn't want to go out for dinner either. Just a quick drink ideally.