Ignore the tiresome types who think you're unnatural for not wanting visitors, or who aren't comfortable with refusing them. We didn't see anyone at all for three weeks, and it suited us -- no one else's wishes are paramount in that situation, and in fact (our families and friends not being that weird, pushy type I only ever encounter in Mn anecdotes, who think that there's a race to see the baby, and if it's more than ten minutes' old when sighted, it's not fair), everyone was fine with it.
And in the event, I had an infected CS scar, I couldn't move without pain, and breastfeeding, despite advice from midwives, HV, GP, NCT BF supporters, La Leche League, BF cafes, and an expensive lactation consultant, didn't work, so I'm delighted we didn't have anyone around when they would only have been an extra stressor.