XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks

By Mohammad Rastegari, Vicente Ordonez, Joseph Redmon, Ali Farhadi. 2016

4,754 citations recorded by the source corpus.

We propose two efficient approximations to standard convolutional neural networks: Binary-Weight-Networks and XNOR-Networks. In Binary-Weight-Networks, the filters are approximated with binary values resulting in 32\(\times \) memory saving. In XNOR-Networks, both the filters and the input to convolutional layers are binary. XNOR-Networks approximate convolutions using primarily binary operations. This results in 58\(\times \) faster convolutional operations (in terms of number of the high precision operations) and 32\(\times \) memory savings. XNOR-Nets offer the possibility of running state-of-the-art networks on CPUs (rather than GPUs) in real-time. Our binary networks are simple, accurate, efficient, and work on challenging visual tasks. We evaluate our approach on the ImageNet classification task. The classification accuracy with a Binary-Weight-Network version of AlexNet is the same as the full-precision AlexNet. We compare our method with recent network binarization methods, BinaryConnect and BinaryNets, and outperform these methods by large margins on ImageNet, more than \(16\,\%\) in top-1 accuracy. Our code is available at: http://allenai.org/plato/xnornet.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Efficiency & Compression

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Quoc V. Le
  3. Dacheng Tao
  4. Yoshua Bengio
  5. Jianfeng Gao
  6. Luke S. Zettlemoyer
  7. Percy Liang
  8. Trevor Darrell

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Yi Yang
  4. Xiaogang Wang
  5. Ming-Hsuan Yang
  6. Trevor Darrell
  7. Jitendra Malik
  8. Alan L. Yuille

In Efficiency & Compression

  1. Song Han
  2. Dan Alistarh
  3. Kurt Keutzer
  4. Tijmen Blankevoort
  5. Georgios Georgiadis
  6. Yang He
  7. Ji Lin
  8. Yunhe Wang

Citations in the corpus