I'll give you a slightly different perspective, onestonetogo.
We left DS1 in his bed at night whislt DH ran me to hospital (I was pregnant, and DH thought I was having a placental abruption. He thougth the baby woulod die waiting for the ambulance). DH was gone for approx 10 mins.
I told the midwife this and she reported me (yes, still riles, DH left blameless) to SS.
Anyway, despite intervention of community midwife SS came calling and they were really nice. it was honestly a cup of tea and a lengthy chat. The SS girls said whenever they've had a serious case, it's often been neglect/abuse etc that's gone on for a long, long time that no-one's noticed. They'd much rather get involved at an early stage.
My friend who is a paeditrician says that when she has to involve SS, the parents are rarely evil child-bashing monsters. Mostly, they're just using parenting 'techniques' that are way out of date, inherited from ill-informed grandparents.
Don't hesitate to call SS sooner rather than later. They'll be nice, I promise.