End-to-End Automatic Speech Translation of Audiobooks

By Alexandre Berard, Laurent Besacier, Ali Can Kocabiyikoglu, Olivier Pietquin. 2018

208 citations recorded by the source corpus.

We investigate end-to-end speech-to-text translation on a corpus of audiobooks specifically augmented for this task. Previous works investigated the extreme case where source language transcription is not available during learning nor decoding, but we also study a midway case where source language transcription is available at training time only. In this case, a single model is trained to decode source speech into target text in a single pass. Experimental results show that it is possible to train compact and efficient end-to-end speech translation models in this setup. We also distribute the corpus and hope that our speech translation baseline on this corpus will be challenged in the future.

Subfields: Artificial Intelligence, Machine Translation, Speech & Audio, Signal Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Graham Neubig
  2. James R. Glass
  3. Mohit Bansal
  4. Luke S. Zettlemoyer
  5. Juan Pino
  6. Wei-Ning Hsu
  7. Jiatao Gu
  8. Jianfeng Gao

In Machine Translation

  1. Juan Pino
  2. Changhan Wang
  3. Yun Tang
  4. Ye Jia
  5. Anne Wu
  6. Xutai Ma
  7. Jiatao Gu
  8. Matteo Negri

In Speech & Audio

  1. Wei-Ning Hsu
  2. Yu Zhang
  3. Jinyu Li
  4. Juan Pino
  5. Changhan Wang
  6. James R. Glass
  7. Shinji Watanabe
  8. Ye Jia

In Signal Processing

  1. Wei-Ning Hsu
  2. Jinyu Li
  3. Yu Zhang
  4. James R. Glass
  5. Shinji Watanabe
  6. Hung-yi Lee
  7. Yu-An Chung
  8. Yonghui Wu

Citations in the corpus