mixup: Beyond Empirical Risk Minimization

By Hongyi Zhang, Moustapha Cissé, Yann Dauphin, David Lopez-Paz. 2017

12,076 citations recorded by the source corpus.

Large deep neural networks are powerful, but exhibit undesirable behaviors such as memorization and sensitivity to adversarial examples. In this work, we propose mixup, a simple learning principle to alleviate these issues. In essence, mixup trains a neural network on convex combinations of pairs of examples and their labels. By doing so, mixup regularizes the neural network to favor simple linear behavior in-between training examples. Our experiments on the ImageNet-2012, CIFAR-10, CIFAR-100, Google commands and UCI datasets show that mixup improves the generalization of state-of-the-art neural network architectures. We also find that mixup reduces the memorization of corrupt labels, increases the robustness to adversarial examples, and stabilizes the training of generative adversarial networks.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Optimization & Training

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Quoc V. Le
  2. Mohit Bansal
  3. Yoshua Bengio
  4. Jianfeng Gao
  5. Sergey Levine
  6. Percy Liang
  7. Dacheng Tao
  8. Trevor Darrell

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Trevor Darrell
  4. Ming-Hsuan Yang
  5. Xiaogang Wang
  6. Jitendra Malik
  7. Andrew Zisserman
  8. Yi Yang

In Optimization & Training

  1. Quoc V. Le
  2. Yoshua Bengio
  3. Frank Hutter
  4. Soham De
  5. Samuel L. Smith
  6. Simon Lacoste-Julien
  7. Andrew Brock
  8. Barret Zoph

Citations in the corpus