Tips and Tricks for Visual Question Answering: Learnings from the 2017 Challenge

By Damien Teney, Peter Anderson, Xiaodong He, Anton van den Hengel. 2017

402 citations recorded by the source corpus.

Deep Learning has had a transformative impact on Computer Vision, but for all of the success there is also a significant cost. This is that the models and procedures used are so complex and intertwined that it is often impossible to distinguish the impact of the individual design and engineering choices each model embodies. This ambiguity diverts progress in the field, and leads to a situation where developing a state-of-the-art model is as much an art as a science. As a step towards addressing this problem we present a massive exploration of the effects of the myriad architectural and hyperparameter choices that must be made in generating a state-of-the-art model. The model is of particular interest because it won the 2017 Visual Question Answering Challenge. We provide a detailed analysis of the impact of each choice on model performance, in the hope that it will inform others in developing models, but also that it might set a precedent that will accelerate scientific progress in the field.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Multimodal Learning, Question Answering & Reading Comprehension

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Jianfeng Gao
  3. Zhe Gan
  4. Dacheng Tao
  5. Christopher D. Manning
  6. Devi Parikh
  7. Percy Liang
  8. Yejin Choi

In Computer Vision and Pattern Recognition

  1. Dacheng Tao
  2. Luc Van Gool
  3. Trevor Darrell
  4. Xiaogang Wang
  5. Ming-Hsuan Yang
  6. Yi Yang
  7. Cordelia Schmid
  8. Andrew Zisserman

In Multimodal Learning

  1. Zhe Gan
  2. Devi Parikh
  3. Mohit Bansal
  4. Linjie Li
  5. Qi Wu
  6. Jingjing Liu
  7. Marcus Rohrbach
  8. Jianfeng Gao

In Question Answering & Reading Comprehension

  1. Christopher Kanan
  2. Kushal Kafle
  3. Anton van den Hengel
  4. Damien Teney
  5. Dacheng Tao
  6. Zhou Yu
  7. Christopher D. Manning
  8. Drew A. Hudson

Citations in the corpus