Analyzing Inverse Problems with Invertible Neural Networks

By Lynton Ardizzone, Jakob Kruse, Sebastian J. Wirkert, D. Rahner, E. Pellegrini, Ralf Klessen, Lena Maier-Hein, Carsten Rother, Ullrich Köthe. 2018

598 citations recorded by the source corpus.

In many tasks, in particular in natural science, the goal is to determine hidden system parameters from a set of measurements. Often, the forward process from parameter- to measurement-space is a well-defined function, whereas the inverse problem is ambiguous: one measurement may map to multiple different sets of parameters. In this setting, the posterior parameter distribution, conditioned on an input measurement, has to be determined. We argue that a particular class of neural networks is well suited for this task -- so-called Invertible Neural Networks (INNs). Although INNs are not new, they have, so far, received little attention in literature. While classical neural networks attempt to solve the ambiguous inverse problem directly, INNs are able to learn it jointly with the well-defined forward process, using additional latent output variables to capture the information otherwise lost. Given a specific measurement and sampled latent variables, the inverse pass of the INN provides a full distribution over parameter space. We verify experimentally, on artificial data and real-world problems from astrophysics and medicine, that INNs are a powerful analysis tool to find multi-modalities in parameter space, to uncover parameter correlations, and to identify unrecoverable parameters.

Subfields: Artificial Intelligence, Statistical and Nonlinear Physics, Neural Architecture Search & AutoML, AI for Physical Sciences

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Yoshua Bengio
  3. Ruslan Salakhutdinov
  4. Mohit Bansal
  5. Quoc V. Le
  6. Pieter Abbeel
  7. Percy Liang
  8. Trevor Darrell

In Statistical and Nonlinear Physics

  1. David Kristjanson Duvenaud
  2. Jörn-Henrik Jacobsen
  3. Jens Behrmann
  4. Lars Ruthotto
  5. Eldad Haber
  6. Arnaud Doucet
  7. Ullrich Köthe
  8. Cho-Jui Hsieh

In Neural Architecture Search & AutoML

  1. David Kristjanson Duvenaud
  2. Yee Whye Teh
  3. Kevin Swersky
  4. Richard S. Zemel
  5. Frank Hutter

In AI for Physical Sciences

  1. Sanjiv Kumar
  2. David Kristjanson Duvenaud
  3. Sergey Levine
  4. Jens Behrmann

Citations in the corpus