Questions of Reasoning Under Logical Uncertainty

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Research Priorities for Robust and Beneficial Artificial Intelligence (2015, background): “…correlations between AI systems’ behaviors and those of their environments or of other agents [60–64], how agents that are embedded in their environments should reason [65, 66], and how to reason about uncertainty over logical consequences of beliefs or other deterministic computations [67].”
AGI Safety Literature Review (2018, methodology): “This is not a realistic assumption for physicalistic agents such as robots that are part of the world they interact with (Soares and Fallenstein, 2014, 2017).”
Formalizing Convergent Instrumental Goals (2016, background): “As described by Soares and Fallenstein [10], this system could well have incentives to deceive or manipulate the humans, in attempts to prevent its goals from being changed (because if its current goal is changed, then its current goal is less likely to be achieved).”
Embedded Agency (2019, background): “This is called the human manipulation problem (Soares et al. 2015; Bostrom 2014).”