Deep Speech: Scaling up end-to-end speech recognition

By Awni Y. Hannun, Carl Case, Jared Casper, Bryan Catanzaro, G. Diamos, Erich Elsen, Ryan J. Prenger, Sanjeev Satheesh, Shubho Sengupta, Vinay Rao and 2 more. 2014

2,263 citations recorded by the source corpus.

We present a state-of-the-art speech recognition system developed using end-to-end deep learning. Our architecture is significantly simpler than traditional speech systems, which rely on laboriously engineered processing pipelines; these traditional systems also tend to perform poorly when used in noisy environments. In contrast, our system does not need hand-designed components to model background noise, reverberation, or speaker variation, but instead directly learns a function that is robust to such effects. We do not need a phoneme dictionary, nor even the concept of a "phoneme." Key to our approach is a well-optimized RNN training system that uses multiple GPUs, as well as a set of novel data synthesis techniques that allow us to efficiently obtain a large amount of varied data for training. Our system, called Deep Speech, outperforms previously published results on the widely studied Switchboard Hub5'00, achieving 16.0% error on the full test set. Deep Speech also handles challenging noisy environments better than widely used, state-of-the-art commercial speech systems.

Subfields: Artificial Intelligence, Natural Language Processing, Speech & Audio

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Quoc V. Le
  3. Mohit Bansal
  4. Jianfeng Gao
  5. Percy Liang
  6. Luke S. Zettlemoyer
  7. Kyunghyun Cho
  8. Sergey Levine

In Natural Language Processing

  1. Kyunghyun Cho
  2. Jianfeng Gao
  3. Mohit Bansal
  4. Yoshua Bengio
  5. Graham Neubig
  6. Quoc V. Le
  7. Richard Socher
  8. Luke S. Zettlemoyer

In Speech & Audio

  1. Jinyu Li
  2. Shinji Watanabe
  3. Yu Zhang
  4. Tara N. Sainath
  5. Wei-Ning Hsu
  6. Dong Yu
  7. Gabriel Synnaeve
  8. Abdel-rahman Mohamed

Citations in the corpus