Lots of us have been there - a lot of folk on the cp thread have babies that have been obviously disabled since birth. Dd2 is older now, but was discharged from scbu with full therapy team. It always makes me chuckle when I explain she has had a slt since she was born. 
I would say the first two years are absolutely the worst. Dd2 was awarded hr care at 6 mos, but was not officially dx until 2, as they just preferred to use the developmental delay label. She hasn't had sz since the neonatal period.
This board does get used a lot by asd parents, which is why it seems that the kids re older, but there are those with physical, neuro and genetic stuff going on from birth too.
I used to think that once dd2 was 5, I would have a pretty good idea of what lay in store. She changed soooooo much between 2 and 7 (biggest developmental strides around 3 - 4, for sure) that none of her early therapists would believe how able she is now. We were told she probably wouldn't walk or talk, and she does both. At 2 we were pretty certain neither was going to happen, and our house was chock full of physio equipment. She essentially screamed for the first two years, and her muscle tone was so high she could only coordinate a swallow to feed at night, so I became largely nocturnal, and set alarms through the night to feed her. She just screamed during the day, and choked if we tried to feed her. It was pretty grim.
Anyway, just wanted to say, we are around. When dd2 was little I used the special kids in the uk forum a lot. It has more kids with physical, genetic and neuro disabilities, and because a lot of the issues are obvious straight off the bat, it has little kids too. They are also great for sn meet ups, depending where you live - we went to a few, and they have an annual camp, too, chock full of families with every sn in the book.
Ask locally if there is an sn mum and toddler group, too. We went to a group every week from when dd2 was 6 mos, and it really helped to get out. I went to nt groups too, but dd2 usually screamed non stop, and it was definitely more stressful, even though my friends were great at ignoring her. 
Hopefully someone with now littlies will be along soon, but, those of us with older kids with cp and genetic stuff have all been there. It is hard. But it does get easier, I promise.
Be kind to yourself x