I've known other home educators that have done this. I had kinda the opposite with my oldest - everyone told me that nursery and similar would help with his language, but he reverted to nonverbal and miserable after a few months and it ended up coming down to the setting and unsupportive staff (the things I overheard as the parent who didn't usually do pickup so some staff didn't recognize me and which child was mine, it was heartbreaking but made everything make sense).
I home educate for primary for some of the reasons you give and for other reasons and then give my children choice when they reach secondary age. It's not that I think I'm "better" than schools nor do I condemn them, but I also don't view either schools or home as a default with the others as the back-up as tends to come up in these types of threads. I think there are pros and cons to all education choices and we have to consider the potential benefit, risks, and responsibility of all of them for our children and family. I think with all of those options comes some nervousness for the parents, probably more than the kids -- I think I was far more nervous when my oldest chose to start at 15 in a KS4 college programme, and my DD1 to mid-year transfer at 12 to secondary school than either of them were. I find they enjoy school far more than I did and many of their peers seem to and I think that's in part because it was their choice that they weighed up with our support. That was a benefit.
Social isolation is a risk in both options, but it's something parents have to more actively manage when taking on home education. There does tend to be more activities for younger children, and as parents we have to build the consistency. For some kids, a weekly club or two with roughly the same children alongside birthdays and similar is enough, for others they need more and that can be hard depending on your area and it can be really hard if bullying starts in one of those groups and there aren't many options around. Pre-COVID, I found it better to mix one or two home ed groups with more typical extra curricular activities like St John Ambulance as the latter tends to have more consistency (as is commonly said in some groups I've been in, gathering home educators is like herding cats, and the older they get the less they're willing to just play with anyone).
I think we also need to cautious about research used on home education - we're a self-selecting group, even more so those willing to be researched compared to school children, and the ideals and platitudes around home education, even by home educators ourselves, often don't match reality. It took me a couple of years of feeling pretty shitty, like I must be doing something wrong, to realize most of the parents talking about how their kids just magically learned to read, write, and do everything without any help because 'they just became interested in it' needed to be taken with a cup or two of salt. Really, I find home educators tend to have more at the extremes of the bell curve, academically, socially, and otherwise, which distorts perceptions.
Trying to cut this babble down, but yes it's normal to be nervous, find consistent social groups, and making consistent learning routines are my top thoughts on this, alongside try not to fall into the trap of defending home education's benefits for you and yours that you miss the risks. That happens a bit more than I think some are willing to talk about in part because we're pushed so often to defend as has been seen in this thread. However we educate, there are responsibilities to keeping an eye on all of those.