Learning Confidence for Out-of-Distribution Detection in Neural Networks

By Terrance Devries, Graham W. Taylor. 2018

664 citations recorded by the source corpus.

Modern neural networks are very powerful predictive models, but they are often incapable of recognizing when their predictions may be wrong. Closely related to this is the task of out-of-distribution detection, where a network must determine whether or not an input is outside of the set on which it is expected to safely perform. To jointly address these issues, we propose a method of learning confidence estimates for neural networks that is simple to implement and produces intuitively interpretable outputs. We demonstrate that on the task of out-of-distribution detection, our technique surpasses recently proposed techniques which construct confidence based on the network's output distribution, without requiring any additional labels or access to out-of-distribution examples. Additionally, we address the problem of calibrating out-of-distribution detectors, where we demonstrate that misclassified in-distribution examples can be used as a proxy for out-of-distribution examples.

Subfields: Artificial Intelligence, Safety, Robustness & Interpretability, Anomaly & Outlier Detection

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Sergey Levine
  3. Yoshua Bengio
  4. Percy Liang
  5. Jianfeng Gao
  6. Quoc V. Le
  7. Caiming Xiong
  8. Richard Socher

In Safety, Robustness & Interpretability

  1. Dawn Song
  2. Dan Hendrycks
  3. Jacob Steinhardt
  4. Bo Li
  5. Yixuan Li
  6. Prateek Mittal
  7. Mantas Mazeika
  8. Ziwei Liu

In Anomaly & Outlier Detection

  1. Yixuan Li
  2. Yiyou Sun
  3. Dan Hendrycks
  4. Mung Chiang
  5. José Miguel Hernández-Lobato
  6. Prateek Mittal
  7. Dawn Song
  8. Julie Arnold Shah

Citations in the corpus