You don't have to do anything structured! I never have. My two are now 17 and 24, and that has worked out great for them. They have sometimes chosen to do formal study - the older one is at university now - but it was never imposed by me.
Of course, you also don't have to have detailed long-term plans, so there is no need to commit to this or any other specific approach. Just find whatever works for your child at this moment. As he gets older, things will change: his maturity, your circumstances, his attention span, his confidence, his ambitions. Then you will need to adjust what you're doing. It's a constant process, just like parenting has been. I'm sure when your little boy was six months old you couldn't have predicted what it would be like to parent him in five years' time!
The usual advice from experienced home educators is, when a child first comes out of school (especially if he had a traumatic time there), just give him time. Make no academic demands. Encourage him to do whatever makes him happy and relaxed, whether that is jigsaw puzzles, water play, watching TV, baking, or digging in the garden. This process is called deschooling. Some parents will move on from that to a more formal educational style if they feel that is best for their kids; others like me stick with it for years, maybe forever.
Children learn from everything around them, even when we don't require them to sit and listen and produce academic output. Even if you don't really agree with me about that, it must be recognised that some countries don't even start formal learning until children are seven, and still their kids get a good education, so you can afford to wait for a few years more.