A-OKVQA: A Benchmark for Visual Question Answering using World Knowledge

By Dustin Schwenk, Apoorv Khandelwal, Christopher Clark, Kenneth Marino, Roozbeh Mottaghi. 2022

950 citations recorded by the source corpus.

The Visual Question Answering (VQA) task aspires to provide a meaningful testbed for the development of AI models that can jointly reason over visual and natural language inputs. Despite a proliferation of VQA datasets, this goal is hindered by a set of common limitations. These include a reliance on relatively simplistic questions that are repetitive in both concepts and linguistic structure, little world knowledge needed outside of the paired image, and limited reasoning required to arrive at the correct answer. We introduce A-OKVQA, a crowdsourced dataset composed of a diverse set of about 25K questions requiring a broad base of commonsense and world knowledge to answer. In contrast to the existing knowledge-based VQA datasets, the questions generally cannot be answered by simply querying a knowledge base, and instead require some form of commonsense reasoning about the scene depicted in the image. We demonstrate the potential of this new dataset through a detailed analysis of its contents and baseline performance measurements over a variety of state-of-the-art vision-language models. Project page: http://a-okvqa.allenai.org/

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Multimodal Learning, Question Answering & Reading Comprehension

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Jianfeng Gao
  2. Mohit Bansal
  3. Percy Liang
  4. Luke S. Zettlemoyer
  5. Yejin Choi
  6. Yu Qiao
  7. Caiming Xiong
  8. Yoshua Bengio

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Trevor Darrell
  4. Xiaogang Wang
  5. Ming-Hsuan Yang
  6. Jitendra Malik
  7. Yu Qiao
  8. Cordelia Schmid

In Multimodal Learning

  1. Hongsheng Li
  2. Zhe Gan
  3. Yu Qiao
  4. Cordelia Schmid
  5. Peng Gao
  6. Mohit Bansal
  7. Pan Lu
  8. Linjie Li

In Question Answering & Reading Comprehension

  1. Peng Gao
  2. Chunyuan Li
  3. Haotian Liu
  4. Zhengyuan Yang
  5. Yong Jae Lee
  6. Aniruddha Kembhavi
  7. Hongsheng Li
  8. Victor Sanh

Citations in the corpus