I found the hardest thing about home ed was making the decision to do it. My eldest son was at a lovely school, in the nursery and was happy there. He probably would have been happy in the main school as well. I just think that he's probably even happier being home ed. I asked if he'd like to go and look at secondary schools, as he's now ten and he looked at me as if I were mad and said 'why?'.
He's had so many opportunities through home edding; done excellent science workshops at Royal Institution, attended so many home ed sessions at museums near us, been to some great home ed sports groups (basketball, tennis, football, climbing, gymnastics, swimming, scuba divng, ice skating, fencing, archery, table tennis), workshops at art galleries, been to lots of home ed social groups - with children from far wider backgrounds than he'd meet at our local primary school, been on home ed adventure camps, taken part in home ed nativity plays, sports days, music lessons and concerts. He has friends over a much wider age range and area than he would have done if he'd been at school.
We've loved being able to follow his interests and expose him to a far wider variety of trips out and social situations than would have been possible if he'd been in school. We've found that other home ed parents are often happy to share their particular skills and lead workshops for a group of children, or we've been able to get various experts in to do sessions either free or relatively low cost (when shared between a group).
The Ted talks from Ken Robinson and Sugata Mitra are interesting and give some clues as to why people might choose home ed rather than schools (although they are talking about the school system rather than home ed). You could also read the speech John Gatto made when accepting his award for New York teacher of the Year.
Everyone's different, but I found that getting out and going to lots of home ed groups and reading quite a lot on the subject gave me a lot of confidence when I started out. I think the whole family have probably had more fun and learnt more together (I know I've learnt loads) than we would have done if the children had gone to school. I guess it's impossible to know how things would have been if you'd taken another route though and it's really about making the choice you make work.
Good luck!