Some moral and technical consequences of automation

By N. Wiener. 1960

Subfields: AI Ethics, Fairness & Society

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In AI Ethics, Fairness & Society

Citations in the corpus

Scalable agent alignment via reward modeling: a research direction (2018, background): “Since then, the agent alignment problem has been echoed by philosophers (Bostrom, 2003, 2014; Yudkowsky, 2004) and treated informally by technical authors (Wiener, 1960; Etzioni & Weld, 1994; Omohundro, 2008).”
Cooperative Inverse Reinforcement Learning (2016, background): “ a mechanical agency with whose operation we cannot interfere effectively :::we had better be quite sure that the purpose put into the machine is the purpose which we really desire.” So wrote Norbert Wiener (1960) in one of the earliest explanations of the problems that arise when autonomous systems”
Translating Principles into Practices of Digital Ethics: Five Risks of Being Unethical (2019, background): “In the ethics of AI, see for example (Wiener1960; Samuel 1960).”
Large Language Model Alignment: A Survey (2023, background): “Norbert Wiener, the father of cybernetics, has initiated such a concern in a paper published in Science (Wiener, 1960):”
The Value Learning Problem (2018, background): “Wiener [ 1960 ] calls this the “Sorcerer’s Apprentice” problem, after the fable of an apprentice whose enchanted broom follows instructions’ letter but not their spirit.”
The Ghost in the Machine has an American accent: value conflict in GPT-3 (2022, background): “Prior to addressing technical issues related to value alignment in AI models, we must first clarify our ethical goals[11, 12]; for as Weiner noted in 1960 “[W]e had better be quite sure that the purpose put into the machine is the purpose which we really desire”[13].”
From What to How. An Overview of AI Ethics Tools, Methods and Research to Translate Principles into Practices (2019, background): “Abstract The debate about the ethical implications of Artificial Intelligence dates from the 1960s (Wiener, 1960) (Samuel, 1960).”
Coordinate to cooperate or compete: Abstract goals and joint intentions in social interaction (2016, background): “Finally, if we are going to build artificial agents that can act with us, act on our behalf and make sense of our actions, they will need to understand our moral values (Bostrom, 2014; Wiener, 1960).”