This is the way I met some of my dearest friends. When I had just had DD1, all my close friends were at a totally different stage of life and a few couldn't handle the idea of a baby, so I was at home, lonely and isolated.
Two old acquaintances (one of whom had sent me a lovely congratulations card when she heard I was pregnant, when most of my other friends were still being quite negative about it, or reacting with shock) invited me along to a get-together with a group of friends and their kids.
That morning was the first time in ages I'd had adult conversation with anyone who wasn't my DH or DM. They even held fractious DD so I could finish my tea (I discovered later that was a "rule" at the get togethers, if someone was having a hard time with their DC, those who were having an easier time would hold/change/rock the DC so the Mum could get a snack and a hot drink in peace.
If I hadn't been welcomed in by these people, I would have had a very miserable time. They're all on the other side of the world to me now and I miss them terribly.
So unless there's a big emotional discussion you were planning to have, or it's a special occasion, I'd always go with "the more the merrier" personally.