You're my age, op. He will eventually retire, like it or not, then he will plummet into the realisation that there is no more work, no more time - consuming activity, no more colleagues, clients etc.
Then there he'll be, no friends, interests, hobbies, activities, nothing to fill his hours, his days, but you.
You will become his entire sole source of interest, activity, attention. It will be even more 'aren't I enough for you? Why do you need friends? I'm here. Why do you need to go out? I'm here. Why do you need people coming round? I'm here.'
Some people have such a sense that they are the main character that everyone else is an extra, a supporting artiste.
Dig your heels in and keep your friends and your interests busy and vibrant. Fill your time. Go out, set the example of having A Life. Stay clear and assertive that yes you do need friends and company.