SPGISpeech: 5, 000 hours of transcribed financial audio for fully formatted end-to-end speech recognition

By Patrick K. O’Neill, Vitaly Lavrukhin, Somshubra Majumdar, Vahid Noroozi, Yuekai Zhang, Oleksii Kuchaiev, Jagadeesh Balam, Yuliya Dovzhenko, Keenan Freyberg, M. Shulman and 3 more. 2021

113 citations recorded by the source corpus.

In the English speech-to-text (STT) machine learning task, acoustic models are conventionally trained on uncased Latin characters, and any necessary orthography (such as capitalization, punctuation, and denormalization of non-standard words) is imputed by separate post-processing models. This adds complexity and limits performance, as many formatting tasks benefit from semantic information present in the acoustic signal but absent in transcription. Here we propose a new STT task: end-to-end neural transcription with fully formatted text for target labels. We present baseline Conformer-based models trained on a corpus of 5,000 hours of professionally transcribed earnings calls, achieving a CER of 1.7. As a contribution to the STT research community, we release the corpus free for non-commercial use at https://datasets.kensho.com/datasets/scribe.

Subfields: Artificial Intelligence, Speech & Audio, Signal Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Shinji Watanabe
  2. Jinyu Li
  3. Daniel Povey
  4. Sanjeev Khudanpur
  5. Dong Yu
  6. James R. Glass
  7. Yoshua Bengio
  8. Hung-yi Lee

In Speech & Audio

  1. Shinji Watanabe
  2. Sanjeev Khudanpur
  3. Daniel Povey
  4. Jinyu Li
  5. Xiangang Li
  6. Guoguo Chen
  7. Jan "Yenda" Trmal
  8. Yujun Wang

In Signal Processing

  1. Shinji Watanabe
  2. Daniel Povey
  3. Sanjeev Khudanpur
  4. Jinyu Li
  5. Dong Yu
  6. James R. Glass
  7. Xiangang Li
  8. Hung-yi Lee

Citations in the corpus