Find or Classify? Dual Strategy for Slot-Value Predictions on Multi-Domain Dialog State Tracking

By Jianguo Zhang, Kazuma Hashimoto, Chien-Sheng Wu, Yao Wan, Philip S. Yu, Richard Socher, Caiming Xiong. 2019

179 citations recorded by the source corpus.

Dialog state tracking (DST) is a core component in task-oriented dialog systems. Existing approaches for DST mainly fall into one of two categories, namely, ontology-based and ontology-free methods. An ontology-based method selects a value from a candidate-value list for each target slot, while an ontology-free method extracts spans from dialog contexts. Recent work introduced a BERT-based model to strike a balance between the two methods by pre-defining categorical and non-categorical slots. However, it is not clear enough which slots are better handled by either of the two slot types, and the way to use the pre-trained model has not been well investigated. In this paper, we propose a simple yet effective dual-strategy model for DST, by adapting a single BERT-style reading comprehension model to jointly handle both the categorical and non-categorical slots. Our experiments on the MultiWOZ datasets show that our method significantly outperforms the BERT-based counterpart, finding that the key is a deep interaction between the domain-slot and context information. When evaluated on noisy (MultiWOZ 2.0) and cleaner (MultiWOZ 2.1) settings, our method performs competitively and robustly across the two different settings. Our method sets the new state of the art in the noisy setting, while performing more robustly than the best model in the cleaner setting. We also conduct a comprehensive error analysis on the dataset, including the effects of the dual strategy for each slot, to facilitate future research.

Subfields: Artificial Intelligence, Natural Language Processing, Dialogue & Conversational AI

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Andrea Madotto
  2. Pascale Fung
  3. Richard Socher
  4. Zhaojiang Lin
  5. Jianfeng Gao
  6. Caiming Xiong
  7. Chien-Sheng Wu
  8. Bing Liu

In Natural Language Processing

  1. Andrea Madotto
  2. Pascale Fung
  3. Richard Socher
  4. Chien-Sheng Wu
  5. Zhaojiang Lin
  6. Bing Liu
  7. Bryan McCann
  8. Caiming Xiong

In Dialogue & Conversational AI

  1. Andrea Madotto
  2. Zhaojiang Lin
  3. Hao Cheng
  4. Mari Ostendorf
  5. Chia-Hsuan Lee
  6. Dilek Z. Hakkani-Tür
  7. Zhou Yu
  8. Shikib Mehri

Citations in the corpus