The Moral Machine experiment
By E. Awad, Sohan Dsouza, Richard Kim, Jonathan F. Schulz, Joseph Henrich, Azim Shariff, Jean‐François Bonnefon, Iyad Rahwan. 2018
1,563 citations recorded by the source corpus.
With the rapid development of artificial intelligence have come concerns about how machines will make moral decisions, and the major challenge of quantifying societal expectations about the ethical principles that should guide machine behaviour. To address this challenge, we deployed the Moral Machine, an online experimental platform designed to explore the moral dilemmas faced by autonomous vehicles. This platform gathered 40 million decisions in ten languages from millions of people in 233 countries and territories. Here we describe the results of this experiment. First, we summarize global moral preferences. Second, we document individual variations in preferences, based on respondents’ demographics. Third, we report cross-cultural ethical variation, and uncover three major clusters of countries. Fourth, we show that these differences correlate with modern institutions and deep cultural traits. We discuss how these preferences can contribute to developing global, socially acceptable principles for machine ethics. All data used in this article are publicly available. Responses from more than two million people to an internet-based survey of attitudes towards moral dilemmas that might be faced by autonomous vehicles shed light on similarities and variations in ethical preferences among different populations.
Subfields: Cognitive Neuroscience, Safety Research, Social Psychology, AI Ethics, Fairness & Society
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Cognitive Neuroscience
- Thiago Oliveira-Santos
- Irene Solaiman
- Karen Huang
- A. D. Souza
- Christoph Engel
- Nripendra P. Rana
- Yogesh Kumar Dwivedi
- Ryan Cotterell
In Safety Research
- Nina Grgic-Hlaca
- Krishna P. Gummadi
- Irene Solaiman
- John S. Edwards
- Yanqing Duan
- Karen Huang
- Christoph Engel
- James D. Herbsleb
In Social Psychology
- John S. Edwards
- Yanqing Duan
- Christoph Engel
- Nripendra P. Rana
- Banita Lal
- James D. Herbsleb
- Yogesh Kumar Dwivedi
- Spyridon Samothrakis
In AI Ethics, Fairness & Society
- Nina Grgic-Hlaca
- Thilo Hagendorff
- Irene Solaiman
- Christoph Engel
- Ryan Cotterell
- Vincent C. Müller
- Krishna P. Gummadi
- Spyridon Samothrakis
Citations in the corpus
- The Gradient of Generative AI Release: Methods and Considerations (2023, background): “Moral experiments show varying approaches to ethical problems by background and culture [3], which are urgently needed perspectives in building, evaluating, and deploying new AI systems.”
- How Do Fairness Definitions Fare?: Examining Public Attitudes Towards Algorithmic Definitions of Fairness (2018, background): “In line with recent work examining public attitudes of the ethical programming of machines [4, 7], we suggest that these public attitudes serve as a useful and important input in a conversation between technologists and ethicists.”
- Entanglement HCI The Next Wave? (2019, neutral): “While the trolley problem used to be a thought experiment only known to certain circles of philosophers, the prospect of self-driving cars being the prime mode of transportation has resulted that most people nowadays have an opinion on the dilemma [Awad et al. 2018].”
- Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveys (2023, methodology): “between alternatives that will inevitably result in the sacrifice of human lives [151], [152], [153].”
- Human Decision Making with Machine Assistance (2019, background): “Several studies also explored human perceptions of the fairness of machine decisions, in the context of self-driving cars [5, 12], targeted-advertising [59], loan approval [62], and bail decisions [36–38 Another series of studies has compared human and machine decision-making.”
- Ethics of artificial intelligence and robotics (2020, background): “While autonomous car trolley problems have received a lot of media attention (Awad et al. 2018), they do not seem to offer anything new to either ethical theory or to the programming of autonomous vehicles, beyond a useful ‘intuition pump’.”
- Algorithm fairness in artificial intelligence for medicine and healthcare (2023, background): “…problems of label shift or concept shift that may occur at various sites, there may be additional complexity arising from culture-specific or regional factors affecting access to protected information, and from definitions and criteria for fairness from differing moral and ethical philosophies 48 .”
- The Ethics of AI Ethics: An Evaluation of Guidelines (2019, background): “popular trolley problems (Awad et al. 2018) and their alleged relation to ethical questions surrounding selfdriving cars or other autonomous vehicles.”