Brycie, I think the problem certainly does exist, but I imagine to a significantly smaller extent than Gove indicated, and sometimes the appearance of decline has more to do with the effective lowering of the school admissions age over the last 15 years. For Gove, it was used as a bandwagon to promote centralisation of the primary school system, which has absolutely nothing at all to do with domestic neglect of children.
Remember, he loves nothing more than a sound byte and a headline, being a journalist, so the term 'school children in nappies' is excellent for such purposes. Ask him actually precisely how many children this involves, in statistical terms, and you would not get an answer.
Interestingly, these debates over raising children and the neglect of poor children by their parents are age-old. 100 years ago people talked about 'bringing up the national child' as this was also a time when children were seen as a commodity, to help support the British Empire in that case. However the people who promoted this most heavily often had links to the Eugenics movement, so we should be wary of invoking such lines of argument. Maria Montessori also worked with children who were to a large extent unsocialised, from disorganised homes, and that was a primary motivation in her developing her set of educational theories (along with her experience of educating disabled children, of course, in her capacity as a medical doctor).
My own view, and that of people such as Kathy Silva etc (who did the research into early years education that underpins the free nursery hours we are all getting) is that the answer lies in structured early years education from around the age of two. There is a strong case for well-funded local nurseries, free for all children, so gentle socialisation starts early, informal learning starts early, and that children who come from a variety of homes mix together and the overall standard of socialisation drifts upwards over time. A generation on, this would pay dividends, as benchmarks would have been set for what you feed young children, what they should wear, when toilet training starts and so on, with the knowledge spreading around local communities in a helpful way.