The YLI-MED Corpus: Characteristics, Procedures, and Plans

By Julia Bernd, Damian Borth, Benjamin Elizalde, Gerald Friedland, Heather Gallagher, L. Gottlieb, Adam L. Janin, Sara Karabashlieva, J. Takahashi, Jennifer Won. 2015

25 citations recorded by the source corpus.

The YLI Multimedia Event Detection corpus is a public-domain index of videos with annotations and computed features, specialized for research in multimedia event detection (MED), i.e., automatically identifying what's happening in a video by analyzing the audio and visual content. The videos indexed in the YLI-MED corpus are a subset of the larger YLI feature corpus, which is being developed by the International Computer Science Institute and Lawrence Livermore National Laboratory based on the Yahoo Flickr Creative Commons 100 Million (YFCC100M) dataset. The videos in YLI-MED are categorized as depicting one of ten target events, or no target event, and are annotated for additional attributes like language spoken and whether the video has a musical score. The annotations also include degree of annotator agreement and average annotator confidence scores for the event categorization of each video. Version 1.0 of YLI-MED includes 1823 "positive" videos that depict the target events and 48,138 "negative" videos, as well as 177 supplementary videos that are similar to event videos but are not positive examples. Our goal in producing YLI-MED is to be as open about our data and procedures as possible. This report describes the procedures used to collect the corpus; gives detailed descriptive statistics about the corpus makeup (and how video attributes affected annotators' judgments); discusses possible biases in the corpus introduced by our procedural choices and compares it with the most similar existing dataset, TRECVID MED's HAVIC corpus; and gives an overview of our future plans for expanding the annotation effort.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Evaluation & Benchmarks, Signal Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Computer Vision and Pattern Recognition

In Evaluation & Benchmarks

In Signal Processing

Citations in the corpus

YFCC100M (2015, methodology): “To support research in multimedia event detection the YLI-MED corpus [1] was recently introduced, which consists of 50,000 handpicked videos from the YFCC100M that belong to events similar to those deﬁned in the TRECVID MED challenge.”
Real-time Analysis and Visualization of the YFCC100m Dataset (2015, background): “However, often researchers are interested in a particular subset of a dataset like for example the events in [1] or images and videos with geo-location information [4].”
The New Data and New Challenges in Multimedia Research (2015, methodology): “nts develop algorithms for estimating the geographic location where a photo or video was taken, is currently based on our dataset. To support research in multimedia event detection the YLI-MED corpus [1] was recently introduced, which consists of 50,000 handpicked videos from the YFCC100M that belon”