ReallyTired, your opinion encapsulates what alarms many HE families, when it comes to contact with the LA. People tend to assume that the family must be hiding something.
I don't assume that most parents send their children to school as a means of covering up the fact that they beat them black and blue in their own time, or that their parenting is 'lazy' and they are using schools as free childcare.
Parents do not generally need to be 'monitored'. People who are home educating their children do not exist in a void, totally cut off from interaction with others.
Our children are just as likely to join Cubs, Brownies, swimming, music classes etc. as others. We go shopping, join libraries, send our children to summer camps and playschemes etc. just as others do.
Some of us even employ childminders. We have family, friends, neighbours, doctors, dentists and health visitors.
Why would you be 'concerned' about a family who decided to give organised HE groups a miss, preferring to get on with every day life in a common or garden sort of way?