Overview of the IWSLT 2011 evaluation campaign

By Marcello Federico, Luisa Bentivogli, Michael Paul, Sebastian Stüker. 2011

84 citations recorded by the source corpus.

Subfields: Evaluation & Benchmarks, Machine Translation

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Evaluation & Benchmarks

In Machine Translation

Citations in the corpus

Light Gated Recurrent Units for Speech Recognition (2018, methodology): “To evaluate the proposed model on a larger scale ASR task, some additional experiments were performed with the TED-talk dataset, that was released in the context of the IWSLT evaluation campaigns [59].”
TED-LIUM: an Automatic Speech Recognition dedicated corpus (2012, background): “The 8th International Workshop on Spoken Language Translation took place in San Francisco, USA on December 08 and 09, 2011 (Federico et al., 2011).”
The IWSLT 2011 Evaluation Campaign on Automatic Talk Translation (2012, methodology): “…numbers six additional standard metrics—METEOR (Lavie and Agarwal, 2007), WER (Niessen et al., 2000), PER (Och, 2003), TER (Snover et al., 2006), GTM (Turian et al., 2003), and NIST (Dod-dington, 2002)—were calculated ofﬂine and reported in the evaluation overview paper (Federico et al., 2011).”
Report on the 11th IWSLT evaluation campaign (2014, background): “The IWSLT evaluation has been running now for over a decade and has offered along these years a variety of speech translation tasks [1, 2, 3, 4, 5, 6, 7, 8, 9, 10].”
WIT3: Web Inventory of Transcribed and Translated Talks (2012, methodology): “One hint comes from the scores obtained by participants at the recent evaluation campaign of IWSLT 2011 (Federico et al., 2011), which organized MT tracks based on the TED Talks data.”
FINDINGS OF THE IWSLT 2020 EVALUATION CAMPAIGN (2020, unknown): “…(IWSLT) is an annual scien-tiﬁc conference (Akiba et al., 2004; Eck and Hori, 2005; Paul, 2006; Fordyce, 2007; Paul, 2008, 2009; Paul et al., 2010; Federico et al., 2011, 2012; Cettolo et al., 2013, 2014, 2015, 2016, 2017; Niehues et al., 2018, 2019) for the study, development and evaluation of…”
The IWSLT 2015 Evaluation Campaign (2015, background): “The IWSLT evaluation has been running for twelve years and has been offering a variety of speech recognition, speech translation and text translation tasks [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11].”
Factored recurrent neural network language model in TED lecture transcription (2012, methodology): “Experiments To evaluate our factored RNNLM in the context of large vocabulary speech recognition, we use the data sets for the IWSLT large vocabulary continuous speech recognition shared task [9] to recognize TED talks published on the TED website.”
Enhancing the TED-LIUM Corpus with Selected Data for Language Modeling and More TED Talks (2014, methodology): “Back in May 2012, we presented at LREC a new corpus dedicated to Automatic Speech Recognition we developed to participate to the IWSLT2011 campaign (Federico et al., 2011) on the Spoken Language Translation task (spoken English to written French).”
Corpus analysis of simultaneous interpretation data for improving real time speech translation (2013, background): “More recently, the IWSLT evaluation campaign has included a track for the ofﬂine speech translation of TED talks [4].”
FBK@IWSLT 2011 (2011, unknown): “We presented our submission runs to the IWSLT 2011 Evaluation Campaign for the ASR English track, the MT ArabicEnglish and English-French tracks, and the SLT EnglishFrench track.”