Problem is I can't do much about any of those things
Actually, yes you can. First you need to change your attitude though. My partner was in care (and has lost a baby from a previous relationship to SIDS), I had a horrific childhood and everyone is open with us that questions and concerns will be raised if I got pregnant. It's not the right time for us due to various things, but we've engaged with professionals and have taken their advice. I was pregnant last year but sadly we lost the baby - that being said the professionals (and their concerns) were all lovely, but I think that's because I have worked my socks off to engage with them.
Instead of building a family support network, build a friend's and professionals one.
Read everything you can about positive parenting, attachment parenting, connected parenting - ask to do a parenting course now. Go to NCT classes and ask questions.
Make sure your relationship is stable and loving, don't fall out with professionals, take their advice, listen to them, work with them not against them.
No, it does not mean they are going to take your baby away from you, but they will be looking to see if you are showing any signs of not going to be able to care for the needs of a baby.