ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answering

By Zhou Yu, Dejing Xu, Jun Yu, Ting Yu, Zhou Zhao, Yueting Zhuang, Dacheng Tao. 2019

754 citations recorded by the source corpus.

Recent developments in modeling language and vision have been successfully applied to image question answering. It is both crucial and natural to extend this research direction to the video domain for video question answering (VideoQA). Compared to the image domain where large scale and fully annotated benchmark datasets exists, VideoQA datasets are limited to small scale and are automatically generated, etc. These limitations restrict their applicability in practice. Here we introduce ActivityNet-QA, a fully annotated and large scale VideoQA dataset. The dataset consists of 58,000 QA pairs on 5,800 complex web videos derived from the popular ActivityNet dataset. We present a statistical analysis of our ActivityNet-QA dataset and conduct extensive experiments on it by comparing existing VideoQA baselines. Moreover, we explore various video representation strategies to improve VideoQA performance, especially for long videos.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Evaluation & Benchmarks, Question Answering & Reading Comprehension

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Jianfeng Gao
  3. Yoshua Bengio
  4. Quoc V. Le
  5. Sergey Levine
  6. Percy Liang
  7. Trevor Darrell
  8. Yejin Choi

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Trevor Darrell
  4. Cordelia Schmid
  5. Jitendra Malik
  6. Ming-Hsuan Yang
  7. Xiaogang Wang
  8. Andrew Zisserman

In Evaluation & Benchmarks

  1. Ali Farhadi
  2. Yejin Choi
  3. Jitendra Malik
  4. Li Fei-Fei
  5. Cordelia Schmid
  6. Antonio Torralba
  7. Andrew Zisserman
  8. Yu Qiao

In Question Answering & Reading Comprehension

  1. Tat-seng Chua
  2. Yueting Zhuang
  3. Cordelia Schmid
  4. Junbin Xiao
  5. Devshree Patel
  6. Ratnam Parikh
  7. Yesha Shastri
  8. Zhou Zhao

Citations in the corpus