I'd like to look at it from a more theoretical/idealised perspective for this reply.
Good idea, but we must be aware of falling into the trap of socialism. People are people, and the game theory of why we act the way we do can be wildly sub optimal in the large, but makes sense for people individually. Socialism failed because it assumed that people are different to the way they really are, and even when you killed millions of them didn't change.
But I think that small-scale farming that is community based (allowing us to live in the small groups you mention) would not be miserable.
Not stable. Look at community based farming, the word you're looking for is "famine". The variability of climate, pests etc is such that no matter how well you farm, something very very bad lands on you from time to time. Before the British invented modern agriculture famines were endemic every where, the net effect has been to restrict famine to cultures that are going to die soon anyway. The last big famine was ironically caused by the British, in India. Huge numbers died, made contemporary African famines look small.
India was mostly community farms. They died. The British refused to distribute food, and thus killed more people than the Nazis. This particularly harsh example of evolution in action affected mostly "community" farmers.
But since independance, India has avoided famine almost completely, even though it has about doubled it's population. Far fewer "community" farmers, and more efficient distribution when things go wrong.
"Community" farming is an affectation of wealthy societies, like Formula 1 racing. It may be pleasant to do, and many people enjoy supporting it, but is as rational on a large scale as cloning Michael Schumacher to make better cabbies.
You need trade to cover things that people can't do well locally, and to get through rough patches. Storing food and barter is really awful, so you end up with a cash economy of some form. When an area suffers a big flood, or all it's animals die, how do resources get there for rebuilding ? Banks are one solution, there are others, but none of them work as well.
I'm glad you raise Star Trek. The lesson I learn from ST, is that rejecting technology relegates you to the status of victim. The best you can hope for is that the guys with better technology have a Prime Directive, but that was never going to last long.
Who was it that said "you may not be interested in war, but it is interested in you" ?
Using technology for genuine benefit, not just for the sake of it, and to produce gadgets that people don't need in order to make profit
You're one step short of socialism here, be careful.
Who decides what "genuine" benefit might be ?
Mobile phones are great for emergency workers, doctors and in areas where land lines are not practical. What is an emergency worker ? You may or may not be surprised to know that many civil servants are classed as that for instance in the priority for getting flu vaccine. Imagine if your local council could decide which technologies you could use. That wouldn't end well would it ?
You call some things gadgets ? Define one ?
I would bet money that you can't think of one single gadget that doesn't have value for disabled, old, or otherwise disadvantaged people.
I don't believe you are malign, but would you want me to decide which technologies you could use ?
This would give us more power over our lives than the empty power of consumer choice
It has never worked before. Don't forget that even now there are still countries that still practice socialism. You see them on the TV, mostly on pleas for aid from charities. Basic economics tells us that if people make choices for other people they often vary between poor and actively malicious.
The rest of our needs are met through trade of physical things rather than currency.
Ah, now that is socialism. The money isn't real argument, very popular amongst socialists. Was often accompanied by the "if women ran things there wouldn't be any wars", both of which got shot to bits in the 1980s.
I didn't think anyone still believed in the inherent merit of physical goods any more.
For a start, what about medical services ?
How are you going to resource them ?
No tangibles.
Socialist countries tried limiting the pay of doctors, with horrible results. Britain has done the same with nurses and especially midwives. Anyone here think that has worked out well ?
Ever been in high dependency unit for babies ? Which of those devices are “gadgets” ? Barter them for carrots would you ?
Or even simply giving away our surpluses to communities where the things we can supply are in short supply.
Why, realistically would people produce surpluses if they got nothing in return. What would stop some not bothering to produce enough ? What if people pretend not to have enough so they could consume too much ?
What do you think of this as a model of living?
I don't think of it as a mode of living, I see it as a suicide pact.
I guess partly the question is – can we now evolve to develop the restraint an cooperation
People are good at cooperation, far better than most animals, certainly better than any other mammal. You can't do war without cooperation. 99.9% of war is working together and self sacrifice for a common goal. Attempts to fight wars when your side had divisions have often gone very badly wrong.
We are evolving, and humans suffer a bit from the recent rapid evolution we've had, but "rapid" in this context is thousands of years.
needed to survive in an already over-populated world.
All the modelling I've seen shows growth rapidly declining, leading to either stability or rapid depopulation.
??? What is the "stability" you refer to?
Lack of economic growth or advanced technology. There are technologies within the next 50 years that will make nukes irrelevant. Beam weapons, tailored virii, exotic software, and at least as many things I know nothing about.
In many ways agriculture was the weapon of mass destruction of the Brits during the growth of their empire. Brits were better fed than their enemies, and man for man the British soldier was simply tougher than the half starved savages he fought. Of course the Brits were more savage than anyone they fought. British soldiers had good technology, but in things like Rorke's Drift (film: Zulu), they could beat absolutely anyone in hand to hand combat with blades. Even today to be trained in bayonet usage is a matter of fierce pride to British soldiers who are openly contemptuous of foreign soldiers who only leqrn guns.
The hippy Nazis in their gay 1970s nightclub gear never managed to build one single weapon of mass destruction. If you are ever tempted to believe in Arayan superiority, read of their attempts to build heavy bombers or nukes. (hint: gassing the people who understand physics is not wise) The Brits were ready with Anthrax which was rejected by Churchill not on humanitarian grounds, but because it would leave "too many survivors".
Same applies to China, India et al.
We're about to start actively improving the human race, not the fuckwitted Christian nonsense of the Nazis, but genetic engineering, electroneural implants, smart diets and zygote selection. Some westerners have superstitious fears of genetic engineering, and many think an electron is about the same size an colour as a small pea. The Chinese & Japanese don’t have those inhibitions. The variable is who is running the new technologies, not whether they happen.
Already people in civilised countries are notably more intelligent than those in the 3rd world. Sad fact is that if you don't feed people properly, the brain using 25% of our static energy budget is very vulnerable. And yes, American intelligence seems to be going up in line with their gross obesity...
50 years from now, we will be a lot smarter than 3rd worlders. Also the smarter end of western nations are optimising their immigration policies to suck in people from crap countries but good brains.
Of course who are “we” in that context ?
Brits are ignorant compared to our peers, but this compensated by a deep pragmatism that alienates us from otherwise similar but more idealistic European cultures.
The not-We will be outsmarted and relegated to somewhere between livestock and zoo exhibits. I’m not keen on this as an outcome for my grandchildren.