CNN architectures for large-scale audio classification

By Shawn Hershey, Sourish Chaudhuri, D. Ellis, Jort Florent Gemmeke, Aren Jansen, R. Channing Moore, Manoj Plakal, D. Platt, Rif A. Saurous, Bryan Seybold and 3 more. 2016

3,011 citations recorded by the source corpus.

Convolutional Neural Networks (CNNs) have proven very effective in image classification and show promise for audio. We use various CNN architectures to classify the soundtracks of a dataset of 70M training videos (5.24 million hours) with 30,871 video-level labels. We examine fully connected Deep Neural Networks (DNNs), AlexNet [1], VGG [2], Inception [3], and ResNet [4]. We investigate varying the size of both training set and label vocabulary, finding that analogs of the CNNs used in image classification do well on our audio classification task, and larger training and label sets help up to a point. A model using embeddings from these classifiers does much better than raw features on the Audio Set [5] Acoustic Event Detection (AED) classification task.

Subfields: Computer Vision and Pattern Recognition, Music, Signal Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Andrew Zisserman
  4. Trevor Darrell
  5. Cordelia Schmid
  6. Ming-Hsuan Yang
  7. Xiaogang Wang
  8. Jitendra Malik

In Music

  1. Xavier Serra
  2. Eduardo Fonseca
  3. Frederic Font
  4. Anurag Kumar
  5. Xavier Favory
  6. Dan Stowell
  7. D. Ellis
  8. Manoj Plakal

In Signal Processing

  1. Xavier Serra
  2. Eduardo Fonseca
  3. James R. Glass
  4. Kristen Grauman
  5. Andrew Zisserman
  6. Wei-Ning Hsu
  7. Xavier Favory
  8. Frederic Font

Citations in the corpus