The Nature of Self-Improving Artificial Intelligence

By S. Omohundro. 2008

74 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

1. Max Tegmark
2. Stuart J. Russell
3. Tom Everitt
4. Marcus Hutter
5. J. Urgen Schmidhuber
6. Gary Lea
7. Yoshua Bengio
8. Nick Bostrom

Citations in the corpus

• Research Priorities for Robust and Beneficial Artificial Intelligence (2015, background): “It has been argued that very general and capable AI systems operating autonomously to accomplish some task will often be subject to effects that increase the difficulty of maintaining meaningful human control [6, 72, 77, 78].”
• The Singularity: a Philosophical Analysis (2010, background): “See also Omohundro (2007, 2008). better species, it is possible to see the moral calculus as going either way.”
• AGI Safety Literature Review (2018, background): “Drexler (2015) outlines a theoretical idea for how to keep AIs specialized. Relatedly, Weinbaum and Veitas (2016) criticize the (rational) agent assumption underpinning most AGI theory.”
• The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agents (2012, background): “…on how the instrumental convergence thesis applies to the case of human beings, as this gives us occasion to elaborate some essential qualifications concerning how the instrumental convergence thesis should 6 Stephen Omohundro has written two pioneering papers on this topic (Omohundro 2008a, b).”
• Smarter eco-cities and their leading-edge artificial intelligence of things solutions for environmental sustainability: A comprehensive systematic review (2023, background): “[61]); and dealing with the complexities of human thinking and emotion (e.g., [64]) using decision support, strategic planning, sequential actions [65], self-learning, and self-improvement [66].”