A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks

By Dan Hendrycks, Kevin Gimpel. 2016

4,454 citations recorded by the source corpus.

We consider the two related problems of detecting if an example is misclassified or out-of-distribution. We present a simple baseline that utilizes probabilities from softmax distributions. Correctly classified examples tend to have greater maximum softmax probabilities than erroneously classified and out-of-distribution examples, allowing for their detection. We assess performance by defining several tasks in computer vision, natural language processing, and automatic speech recognition, showing the effectiveness of this baseline across all. We then show the baseline can sometimes be surpassed, demonstrating the room for future research on these underexplored detection tasks.

Subfields: Artificial Intelligence, Safety, Robustness & Interpretability

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Mohit Bansal
  3. Sergey Levine
  4. Percy Liang
  5. Quoc V. Le
  6. Jianfeng Gao
  7. Luke S. Zettlemoyer
  8. Ruslan Salakhutdinov

In Safety, Robustness & Interpretability

  1. Matthias Hein
  2. Percy Liang
  3. Yixuan Li
  4. Dan Hendrycks
  5. Nicholas Carlini
  6. Prateek Mittal
  7. Bo Li
  8. Dawn Song

Citations in the corpus