FSD50K: An Open Dataset of Human-Labeled Sound Events

By Eduardo Fonseca, Xavier Favory, Jordi Pons, Frederic Font, Xavier Serra. 2020

737 citations recorded by the source corpus.

Most existing datasets for sound event recognition (SER) are relatively small and/or domain-specific, with the exception of AudioSet, based on over 2 M tracks from YouTube videos and encompassing over 500 sound classes. However, AudioSet is not an open dataset as its official release consists of pre-computed audio features. Downloading the original audio tracks can be problematic due to YouTube videos gradually disappearing and usage rights issues. To provide an alternative benchmark dataset and thus foster SER research, we introduce FSD50K, an open dataset containing over 51 k audio clips totalling over 100 h of audio manually labeled using 200 classes drawn from the AudioSet Ontology. The audio clips are licensed under Creative Commons licenses, making the dataset freely distributable (including waveforms). We provide a detailed description of the FSD50K creation process, tailored to the particularities of Freesound data, including challenges encountered and solutions adopted. We include a comprehensive dataset characterization along with discussion of limitations and key factors to allow its audio-informed usage. Finally, we conduct sound event classification experiments to provide baseline systems as well as insight on the main factors to consider when splitting Freesound audio data for SER. Our goal is to develop a dataset to be widely adopted by the community as a new open benchmark for SER research.

Subfields: Music, Evaluation & Benchmarks, Speech & Audio, Signal Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Music

  1. Eduardo Fonseca
  2. Xavier Serra
  3. Jakob Abeßer
  4. Benjamin Elizalde
  5. Huaming Wang
  6. Justin Salamon
  7. Qiuqiang Kong
  8. Mark D. Plumbley

In Evaluation & Benchmarks

  1. Xavier Serra
  2. Eduardo Fonseca
  3. Jakob Abeßer
  4. Mark D. Plumbley
  5. Benjamin Elizalde
  6. Yossi Adi
  7. Huaming Wang
  8. D. Ellis

In Speech & Audio

  1. Yossi Adi
  2. Gabriel Synnaeve
  3. Jade Copet
  4. Xavier Serra
  5. Alexandre D'efossez
  6. Adam Polyak
  7. Eduardo Fonseca
  8. Felix Kreuk

In Signal Processing

  1. Eduardo Fonseca
  2. Xavier Serra
  3. Yossi Adi
  4. John R. Hershey
  5. Scott Wisdom
  6. Adam Polyak
  7. Gabriel Synnaeve
  8. Hakan Erdogan

Citations in the corpus