Equally Hunter gathers probably wouldn't have tolerated scroungers they would have been driven out. In reality Hunter gatherers were probably benign dictatorships: living conditions were far too hard for democratic debate and no non benign dictator could have held groups together for long. They definitely weren't socialists prime meat/furs would have gone to the strongest.
Obviously, it's difficult to know exactly what all H-G groups did but the evidence from surviving groups is that they were not as you describe.
Living conditions were hard in some ways (lack of medicine, issues with weather) but actually in terms of day to day work, they were not working every hour. They were not dictatorships, benign or not but collectives. Scroungers were not 'driven out' necessarily. More likely (and this is seen in more than one culture) shamed. Piling lots of food up out side their living space is a common theme.
Prime meat probably went to the hunters; their need for protein was greater. But get too arsey with that and you will find that the gatherers would just eat their stuff as they gather and the calories you rely on to live (gathering is much more reliable) would dry up.
There were instances of 'crime' which could be punished with banishment or maiming or death (all of these really are a death sentence). These seem to be rare.
Once fixed agriculture starts, this changes out of all recognition. Strength wins when you can hoard and control food. The biggest gets the prize.