Tacotron: Towards End-to-End Speech Synthesis

By Yuxuan Wang, R. Skerry-Ryan, Daisy Stanton, Yonghui Wu, Ron J. Weiss, Navdeep Jaitly, Zongheng Yang, Ying Xiao, Z. Chen, Samy Bengio and 4 more. 2017

2,067 citations recorded by the source corpus.

A text-to-speech synthesis system typically consists of multiple stages, such as a text analysis frontend, an acoustic model and an audio synthesis module. Building these components often requires extensive domain expertise and may contain brittle design choices. In this paper, we present Tacotron, an end-to-end generative text-to-speech model that synthesizes speech directly from characters. Given pairs, the model can be trained completely from scratch with random initialization. We present several key techniques to make the sequence-to-sequence framework perform well for this challenging task. Tacotron achieves a 3.82 subjective 5-scale mean opinion score on US English, outperforming a production parametric system in terms of naturalness. In addition, since Tacotron generates speech at the frame level, it's substantially faster than sample-level autoregressive methods.

Subfields: Artificial Intelligence, Model Architectures, Speech & Audio

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Tie-Yan Liu
  2. Tao Qin
  3. Xu Tan
  4. Yoshua Bengio
  5. Mohit Bansal
  6. Dong Yu
  7. Quoc V. Le
  8. Jianfeng Gao

In Model Architectures

  1. Jinyu Li
  2. Tao Qin
  3. Tie-Yan Liu
  4. Shinji Watanabe
  5. Yoshua Bengio
  6. Xu Tan
  7. Lei He
  8. Tara N. Sainath

In Speech & Audio

  1. Xu Tan
  2. Jinyu Li
  3. Yu Zhang
  4. Wei-Ning Hsu
  5. Hung-yi Lee
  6. Junichi Yamagishi
  7. Tao Qin
  8. Shinji Watanabe

Citations in the corpus