How is he when your friends visit? Or don't your friends visit anymore?
Family visiting a couple of times a month is perfectly normal, and is great for socialising your little one.
How much quality time does he really spend with his son? Does he focus every evening and weekend on his son... baths, nappies, feeding, bed time, playing? I'm guessing not.
It sounds as if he's trying to isolate you from your family, the fact that you don't really have any friends makes me wonder why, does he discourage you from making friends?
My DH nags me to contact my friends, helps me cook when they visit, drove me round the country last year to catch up with some friends I hadn't seen for a while. He wants me to have a social life and a support network.
Your partner really doesn't sound like he's very nice to you.
Do you feel cared for? Not loved or adored, that's often all puffery, caring counts. If you fell ill, would he clean up your vomit and shit, run out to get you yogurt or whatever you wanted?
If not this relationship is not worth your time.