What I'm rapidly discovering is that as a discipline, machine learning (A.I., language generation tool, whatever you want to call it) needs the humanities. Machine opacity is one serious concern, but this discipline simply cannot operate without ethics - philosophical ethics, that is; not simply passing specific universities' ethics committee as every research project completed under their banner must do. Thus, everything in its programming needs screening for four factors: responsibility and accountability; reliability and safety; fairness and inclusion, and privacy and data governance.
And here's one on intelligent machines making 'ethical' decisions; a scenario very much based around Philippa Foote's 'trolley' problem in determining utilitarianism (the greater good for the greater number):
‘The traditional example is that of an imminent car accident involving an autonomous car. The onboard software has to decide whether to veer right, and face 100 percent chances of killing a young girl, or veer left and, for instance, having 50 percent chances of killing an elderly couple. [….] what should the autonomous car do? Its actions will be driven by the algorithm and the data, but this still poses a question: whether to base the decision on gender, age, probabilities, number of fatalities, their contribution to society or on any other consideration (Pellegrino & Kelly, 'Intelligent Machines and the Growing Importance of Ethics).
If you have machines deciding who gets to live and who dies in this way, you have some very frightening similarities with eugenics. Who decides what are desirable characteristics; who gives to live and die in a society; who contributes and who doesn't? You there have something more akin with the principles of a Nazi genocide. And whilst I don't necessarily accept that a hideous Skynet or Machine Wars or the prospect of being taken over by sentient machines is an imminent (or even distant) prospect a la Terminator or Matrix franchises, these are all deeply worrying developments.
I get that these are asides from data-scraping and a few irritating pop-up bots. But this thing needs very strict regulation, IMO, and by some democratically accountable process. Imagine the 'wrong', small, privileged group of people having too much control over the programming of this tool. Here we'd have a media monopoly with far too much influence over what people (who are as a species impressionable) might think. And at the best of times, 'ethics' are a murky customer.