Measuring and avoiding side effects using relative reachability

By Victoria Krakovna, Laurent Orseau, Miljan Martic, Shane Legg. 2018

24 citations recorded by the source corpus.

Subfields: Safety, Robustness & Interpretability

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Safety, Robustness & Interpretability

1. Tom Everitt
2. Shane Legg
3. Miljan Martic
4. Jan Leike
5. David Krueger
6. Vishal Maini
7. Victoria Krakovna
8. Marcus Hutter

Citations in the corpus

• Scalable agent alignment via reward modeling: a research direction (2018, background): “• Side-effects (Armstrong & Levinstein, 2017; Zhang et al., 2018b; Krakovna et al., 2018): the agent is not incentivized to reduce effects unrelated to its main objectives, even if those are irreversible or difficult to reverse.”