Conceptual Captions: A Cleaned, Hypernymed, Image Alt-text Dataset For Automatic Image Captioning

By Piyush Sharma, Nan Ding, Sebastian Goodman, Radu Soricut. 2018

3,041 citations recorded by the source corpus.

We present a new dataset of image caption annotations, Conceptual Captions, which contains an order of magnitude more images than the MS-COCO dataset (Lin et al., 2014) and represents a wider variety of both images and image caption styles. We achieve this by extracting and filtering image caption annotations from billions of webpages. We also present quantitative evaluations of a number of image captioning models and show that a model architecture based on Inception-ResNetv2 (Szegedy et al., 2016) for image-feature extraction and Transformer (Vaswani et al., 2017) for sequence modeling achieves the best performance when trained on the Conceptual Captions dataset.

Subfields: Computer Vision and Pattern Recognition, Multimodal Learning, Evaluation & Benchmarks

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Trevor Darrell
  4. Ming-Hsuan Yang
  5. Xiaogang Wang
  6. Jitendra Malik
  7. Andrew Zisserman
  8. Cordelia Schmid

In Multimodal Learning

  1. Zhe Gan
  2. Lijuan Wang
  3. Jianfeng Gao
  4. Mohit Bansal
  5. Linjie Li
  6. Zicheng Liu
  7. Devi Parikh
  8. Jianfeng Wang

In Evaluation & Benchmarks

  1. Mohit Bansal
  2. Yejin Choi
  3. Jianfeng Gao
  4. Hannaneh Hajishirzi
  5. Luke S. Zettlemoyer
  6. Douwe Kiela
  7. Samuel R. Bowman
  8. Matt Gardner

Citations in the corpus