TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension

By Mandar Joshi, Eunsol Choi, Daniel S. Weld, Luke S. Zettlemoyer. 2017

4,054 citations recorded by the source corpus.

We present TriviaQA, a challenging reading comprehension dataset containing over 650K question-answer-evidence triples. TriviaQA includes 95K question-answer pairs authored by trivia enthusiasts and independently gathered evidence documents, six per question on average, that provide high quality distant supervision for answering the questions. We show that, in comparison to other recently introduced large-scale datasets, TriviaQA (1) has relatively complex, compositional questions, (2) has considerable syntactic and lexical variability between questions and corresponding answer-evidence sentences, and (3) requires more cross sentence reasoning to find answers. We also present two baseline algorithms: a feature-based classifier and a state-of-the-art neural network, that performs well on SQuAD reading comprehension. Neither approach comes close to human performance (23% and 40% vs. 80%), suggesting that TriviaQA is a challenging testbed that is worth significant future study.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Information Retrieval & Search, Evaluation & Benchmarks

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Luke S. Zettlemoyer
  3. Jianfeng Gao
  4. Percy Liang
  5. Graham Neubig
  6. Yejin Choi
  7. Hannaneh Hajishirzi
  8. Quoc V. Le

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Trevor Darrell
  4. Xiaogang Wang
  5. Jitendra Malik
  6. Ming-Hsuan Yang
  7. Mohit Bansal
  8. Andrew Zisserman

In Information Retrieval & Search

  1. Jimmy J. Lin
  2. Hannaneh Hajishirzi
  3. Jamie Callan
  4. Wen-tau Yih
  5. Sebastian Riedel
  6. Danqi Chen
  7. Luyu Gao
  8. Gautier Izacard

In Evaluation & Benchmarks

  1. Mohit Bansal
  2. Hannaneh Hajishirzi
  3. Luke S. Zettlemoyer
  4. Douwe Kiela
  5. Ashish Sabharwal
  6. Yejin Choi
  7. Samuel R. Bowman
  8. Matt Gardner

Citations in the corpus