It’s a bit like the ‘private vs state school’ debate - there is no general answer. The question is whether, at this point, home education by you in your particular circumstances is better or worse for your particular child than the school you have available to you.
It can help to work backwards. What is your plan / hope for secondary schooling? Are there considerations of eg feeder schools or selection that are relevant and a reason to be in school or not at the end of primary?
If you plan to home educate to eg 16 or 18, you do have to think about how your child will obtain the ‘entry tickets’ to the next step in education or employment and then plan backwards.
Thinking less far ahead, if you take your child out of school, what are the chances if returning him to the same or a preferred school between now and the end of primary, either because it doesn’t work out or because you or your child make a decision to re-enter school. Remember that up to the end of Y2, a class cannot be over 30, so if you leave and the space is filled, there may be no space for your child to rejoin. Even in KS2, a full and over-subscribed school may not be able to admit you, even on appeal.
Think about today. How if your child doing, academically, socially and emotionally? How will his progress in all areas be enhanced through the form of education you choose? It is perfectly valid to ‘trade’ academic progress for emotional wellbeing if your child is suffering, but if he is not, where is the benefit for him?
My DS was temporarily home schooled when the fit between him and the only accessible primary was damaging him. We moved, and he successfully re-entered school and thrived. I was glad that I had both ‘mended’ him emotionally and ensured that his academic progress aligned with schooling (took much less time, though!)