BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage

By Kurt Shuster, Jing Xu, Mojtaba Komeili, Da Ju, Eric Michael Smith, Stephen Roller, Megan Ung, Moya Chen, Kushal Arora, Joshua Lane and 8 more. 2022

297 citations recorded by the source corpus.

We present BlenderBot 3, a 175B parameter dialogue model capable of open-domain conversation with access to the internet and a long-term memory, and having been trained on a large number of user defined tasks. We release both the model weights and code, and have also deployed the model on a public web page to interact with organic users. This technical report describes how the model was built (architecture, model and training scheme), and details of its deployment, including safety mechanisms. Human evaluations show its superiority to existing open-domain dialogue agents, including its predecessors (Roller et al., 2021; Komeili et al., 2022). Finally, we detail our plan for continual learning using the data collected from deployment, which will also be publicly released. The goal of this research program is thus to enable the community to study ever-improving responsible agents that learn through interaction.

Subfields: Artificial Intelligence, Natural Language Processing, LLM Agents & Tool Use

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Luke S. Zettlemoyer
  3. Jianfeng Gao
  4. Percy Liang
  5. Jason Aaron Edward Weston
  6. Yejin Choi
  7. Caiming Xiong
  8. Yoshua Bengio

In Natural Language Processing

  1. Jason Aaron Edward Weston
  2. Mohit Bansal
  3. Luke S. Zettlemoyer
  4. Jianfeng Gao
  5. Yejin Choi
  6. Emily Dinan
  7. Kurt Shuster
  8. Caiming Xiong

In LLM Agents & Tool Use

  1. Jason Aaron Edward Weston
  2. Luke S. Zettlemoyer

Citations in the corpus