Tied Multitask Learning for Neural Speech Translation

By Antonios Anastasopoulos, David Chiang. 2018

180 citations recorded by the source corpus.

We explore multitask models for neural translation of speech, augmenting them in order to reflect two intuitive notions. First, we introduce a model where the second task decoder receives information from the decoder of the first task, since higher-level intermediate representations should provide useful information. Second, we apply regularization that encourages transitivity and invertibility. We show that the application of these notions on jointly trained models improves performance on the tasks of low-resource speech transcription and translation. It also leads to better performance when using attention information for word discovery over unsegmented input.

Subfields: Artificial Intelligence, Machine Translation, Speech & Audio

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Graham Neubig
  2. Luke S. Zettlemoyer
  3. Mohit Bansal
  4. Kyunghyun Cho
  5. Felix Stahlberg
  6. Yonatan Belinkov
  7. Yoshua Bengio
  8. Jianfeng Gao

In Machine Translation

  1. Juan Pino
  2. Changhan Wang
  3. Yun Tang
  4. Xutai Ma
  5. Jiatao Gu
  6. Ye Jia
  7. Matteo Negri
  8. Marco Turchi

In Speech & Audio

  1. Juan Pino
  2. Changhan Wang
  3. Jinyu Li
  4. Shinji Watanabe
  5. Ye Jia
  6. Yu Zhang
  7. Alexis Conneau
  8. Yonghui Wu

Citations in the corpus