Sockeye: A Toolkit for Neural Machine Translation

By Felix Hieber, Tobias Domhan, Michael J. Denkowski, David Vilar, Artem Sokolov, Ann Clifton, Matt Post. 2017

217 citations recorded by the source corpus.

We describe Sockeye (version 1.12), an open-source sequence-to-sequence toolkit for Neural Machine Translation (NMT). Sockeye is a production-ready framework for training and applying models as well as an experimental platform for researchers. Written in Python and built on MXNet, the toolkit offers scalable training and inference for the three most prominent encoder-decoder architectures: attentional recurrent neural networks, self-attentional transformers, and fully convolutional networks. Sockeye also supports a wide range of optimizers, normalization and regularization techniques, and inference improvements from current NMT literature. Users can easily run standard training recipes, explore different model settings, and incorporate new ideas. In this paper, we highlight Sockeye's features and benchmark it against other NMT toolkits on two language arcs from the 2017 Conference on Machine Translation (WMT): English-German and Latvian-English. We report competitive BLEU scores across all three architectures, including an overall best score for Sockeye's transformer implementation. To facilitate further comparison, we release all system outputs and training scripts used in our experiments. The Sockeye toolkit is free software released under the Apache 2.0 license.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Natural Language Processing, Machine Translation

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Graham Neubig
  2. Mohit Bansal
  3. Luke S. Zettlemoyer
  4. Philipp Koehn
  5. Jianfeng Gao
  6. Kyunghyun Cho
  7. Felix Stahlberg
  8. Noah A. Smith

In Computer Vision and Pattern Recognition

  1. Felix Stahlberg
  2. Michael Auli
  3. Luc Van Gool
  4. Philipp Koehn
  5. Dacheng Tao
  6. Kyunghyun Cho
  7. Trevor Darrell
  8. Xiaogang Wang

In Natural Language Processing

  1. Graham Neubig
  2. Philipp Koehn
  3. Michael Auli
  4. Luke S. Zettlemoyer
  5. Rico Sennrich
  6. Felix Stahlberg
  7. Ondrej Bojar
  8. Kyunghyun Cho

In Machine Translation

  1. Philipp Koehn
  2. Ondrej Bojar
  3. Marine Carpuat
  4. Matīss Rikters
  5. David Vilar
  6. Matt Post
  7. Kevin Duh
  8. Rico Sennrich

Citations in the corpus