Beyond Goldfish Memory: Long-Term Open-Domain Conversation

By Jing Xu, Arthur Szlam, Jason Aaron Edward Weston. 2021

363 citations recorded by the source corpus.

Despite recent improvements in open-domain dialogue models, state of the art models are trained and evaluated on short conversations with little context. In contrast, the long-term conversation setting has hardly been studied. In this work we collect and release a human-human dataset consisting of multiple chat sessions whereby the speaking partners learn about each other’s interests and discuss the things they have learnt from past sessions. We show how existing models trained on existing datasets perform poorly in this long-term conversation setting in both automatic and human evaluations, and we study long-context models that can perform much better. In particular, we find retrieval-augmented methods and methods with an ability to summarize and recall previous conversations outperform the standard encoder-decoder architectures currently considered state of the art.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Natural Language Processing, Dialogue & Conversational AI

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Luke S. Zettlemoyer
  2. Jason Aaron Edward Weston
  3. Mohit Bansal
  4. Jianfeng Gao
  5. Percy Liang
  6. Graham Neubig
  7. Yejin Choi
  8. Caiming Xiong

In Computer Vision and Pattern Recognition

  1. Jason Aaron Edward Weston
  2. Mohit Bansal
  3. Luc Van Gool
  4. Trevor Darrell
  5. Dacheng Tao
  6. Xiaogang Wang
  7. Cordelia Schmid
  8. Ming-Hsuan Yang

In Natural Language Processing

  1. Jason Aaron Edward Weston
  2. Mohit Bansal
  3. Luke S. Zettlemoyer
  4. Eric Michael Smith
  5. Y-Lan Boureau
  6. Emily Dinan
  7. Kurt Shuster
  8. Adina Williams

In Dialogue & Conversational AI

  1. Kurt Shuster
  2. Jason Aaron Edward Weston
  3. Jing Xu
  4. Andrea Madotto
  5. Eric Michael Smith
  6. Stephen Roller
  7. Mojtaba Komeili
  8. Caiming Xiong

Citations in the corpus