I was stuck in hospital for a few days so was quite keen on visitors, but only ones I wanted! I went in Thursday evening and left Monday morning, which DD being born on the Friday at lunchtime. So no visitors the day she was born, but my dad and sister came up for the 1 hour morning visit, then my aunt and cousin came on the afternoon visit (check your hospital for visiting times. Mine was quite strict, which worked out nicely, although they were a little more lax at kicking the partners out after 9 which was actually also very nice!
).
Had no visitors on Sunday as I was feeling quite miserable about being stuck at hospital, but on the Monday when we came home we had my cousin leave work early (she works an hour away) to come and visit and my sister and BIL came over that evening, too, which was lovely. My mum OTOH didn't get to meet DD, her first grandchild, until she was 6 weeks old as she was in hospital herself and wasn't discharged until DD was almost 3 months old, so with this DC I'm keen for her to visit asap.
The inlaws came over in dribs and drabs once we were home, but they've always been good at doing things on our terms.
My advice is see how you feel, let them help as much as they can (in my case I was happy for everyone else to hold DD and get some cuddles while I made tea, but everyone was very keen to help out and make lunches etc) and be polite yet firm when you're tired and ready to let everyone go home.