I remember it seemed such a big deal when I removed my children from school - quite scary!
Now, it is just normal, but I think you have to go through that uncomfortable feeling.
My daughter was bullied at school and it destroyed her happiness and confidence, but there was a cure - HE! She is so happy now and is a lovely, grown up, confident, loving 11 yo.
Meeting some local home educators would be a good idea. Where are you?
I am kind of semi-structured but everyone has been friendly to me!
For an easy way to get started, how about thinking about one of these (or all of these) ideas:-
Sign up for Education City (you can trial it)
Get some great books to read together or to read to your son.
If you feel safer being structured, you can get free maths curriculum here www.cimt.plymouth.ac.uk/projects/mepres/primary/default.htm
There is SO MUCH available, it can actually be a bit overwhelming, so you could just start with a few things and avoid the "spend loads of money" thing! This site gives you an idea of what's available, though you don't need all this!!! www.cathyduffyreviews.com/
Try here www.tutpup.com
Many parents teach brilliantly with very little, but I think this may come with confidence and experience - I bought a curriculum for the first year from www.sonlight.com/ (which is Christian) We loved the books and it made ME feel much happier anyway. After that I had learnt a lot about what did and didn't work with my kids and felt confident to do my own thing.
Ask for more help if you need it. The HE network is very supportive and you will get help once you connect with the networks, which are online for the most part.
Best wishes to you and your son.
Sarah O