We're together 4 years now - one in 40s and other 50s. Never lived together and no talk of our future. Neither married before and no children. We used to spend maybe one night together a week, but now he's always keen to go home after we've had a nice time together and haven't spent an overnight together in weeks. Lately, he leaves soon after we've had a romantic time together, but recently I've been feeling a bit uncomfortable with this, so today I said I wasn't in the mood when he called in on his way home from the office, after we'd had a brew. He took it ok but he's gone. I feel a bit guilty. AIBU?