Uncertainty-Aware Deep Classifiers Using Generative Models

By Murat Sensoy, Lance M. Kaplan, Federico Cerutti, Maryam Saleki. 2020

90 citations recorded by the source corpus.

Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high uncertainty for the data samples close to class boundaries or from the outside of the training distribution. These approaches use an auxiliary data set during training to represent out-of-distribution samples. However, selection or creation of such an auxiliary data set is non-trivial, especially for high dimensional data such as images. In this work we develop a novel neural network model that is able to express both aleatoric and epistemic uncertainty to distinguish decision boundary and out-of-distribution regions of the feature space. To this end, variational autoencoders and generative adversarial networks are incorporated to automatically generate out-of-distribution exemplars for training. Through extensive analysis, we demonstrate that the proposed approach provides better estimates of uncertainty for in- and out-of-distribution samples, and adversarial examples on well-known data sets against state-of-the-art approaches including recent Bayesian approaches for neural networks and anomaly detection methods.

Subfields: Artificial Intelligence

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Dana Rezazadegan
  2. Vladimir Makarenkov
  3. Abbas Khosravi
  4. Mohammad Ghavamzadeh
  5. Xiaochun Cao
  6. Paul W. Fieguth
  7. Saeid Nahavandi
  8. Sadiq Hussain

Citations in the corpus