MuST-C: A multilingual corpus for end-to-end speech translation

By Roldano Cattoni, Mattia Antonino Di Gangi, Luisa Bentivogli, Matteo Negri, Marco Turchi. 2021

186 citations recorded by the source corpus.

Abstract End-to-end spoken language translation (SLT) has recently gained popularity thanks to the advancement of sequence to sequence learning in its two parent tasks: automatic speech recognition (ASR) and machine translation (MT). However, research in the field has to confront with the scarcity of publicly available corpora to train data-hungry neural networks. Indeed, while traditional cascade solutions can build on sizable ASR and MT training data for a variety of languages, the available SLT corpora suitable for end-to-end training are few, typically small and of limited language coverage. We contribute to fill this gap by presenting MuST-C, a large and freely available Multilingual Speech Translation Corpus built from English TED Talks. Its unique features include: i) language coverage and diversity (from English into 14 languages from different families), ii) size (at least 237 hours of transcribed recordings per language, 430 on average), iii) variety of topics and speakers, and iv) data quality. Besides describing the corpus creation methodology and discussing the outcomes of empirical and manual quality evaluations, we present baseline results computed with strong systems on each language direction covered by MuST-C.

Subfields: Artificial Intelligence, Machine Translation

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Juan Pino
  2. Changhan Wang
  3. Wei-Ning Hsu
  4. Jiatao Gu
  5. Michael Auli
  6. Philipp Koehn
  7. Ann Lee
  8. Graham Neubig

In Machine Translation

  1. Juan Pino
  2. Changhan Wang
  3. Yun Tang
  4. Anne Wu
  5. Xutai Ma
  6. Matteo Negri
  7. Marco Turchi
  8. Philipp Koehn

Citations in the corpus