Hi,
I'm going to say the first year of having a baby is tough. I didn't have my family near me so it was really hard and I struggled for ages but it gets much better once the baby starts walking. Breastfeeding is hard too but it does become second nature after especially with the next children.
I wish I was able to take the help of my family but they were too far away. I would say to you that it's good you've acknowledged the PND. With the first child it is such a huge change and life seems like it will never get easier again but coming from someone who has been in a similar position with PND, I promise it goes get better and it will get better.
Is there something your family are doing that makes you feel worse?
If not then just take a day at a time. When you feel like going, go. When you don't, don't go.
I used to hear of people who had easy babies etc but later on they became nightmare sleepers. Some people also don't tell the full story and when you pick up bits and bobs from different conversations you realise it's not as easy for them as they're making it out to be. However perhaps there are some who have easy babies but don't let it get you down as we all have our own journeys. To be honest I also didn't go to groups etc and I thought I had a support network online but they really went behind my back. Wish I never washed my time with them.
Honestly just take a day at a time. Give baby to your OH for a breather whenever you can. I used to absolutely fawn over my siblings kids before my own and when I had my first I couldn't barely interact with them as I was so overwhelmed (PND) and forgot who I was. That was just a phase and it didn't happen with my second child at all. It is such a different world when you become a first time mother.
It's okay to take things slow with everyone and if you need help for anything please do ask for it but also remember the help your family gave you and appreciate it at your pace too. There's nothing like having family nearby who are there for you during pregnancy and after birth. I didn't have this due to distance and I often see how much people don't realise how much of a difference it makes to life with a baby.
It may just be you wanting to stay at home for a while and there's nothing wrong with that either. That's your safe place. Perhaps your family can spend more time at your home rather than you at theirs.