Dialogue act modeling for automatic tagging and recognition of conversational speech

By Mark H. Burstein, Jerry R. Hobbs, Ora Lassila, David L. Martin, Drew V. McDermott, Sheila A. McIlraith, S. Narayanan, Massimo Paolucci, Terry R. Payne, Katia P. Sycara. International Conference on Computational Logic, 2000

2,914 citations recorded by the source corpus.

Abstract We describe a statistical approach for modeling dialogue acts in conversational speech, i.e., speech-act-like units such as STATEMENT, Question, BACKCHANNEL, Agreement, Disagreement, and Apology. Our model detects and predicts dialogue acts based on lexical, collocational, and prosodic cues, as well as on the discourse coherence of the dialogue act sequence. The dialogue model is based on treating the discourse structure of a conversation as a hidden Markov model and the individual dialogue acts as observations emanating from the model states. Constraints on the likely sequence of dialogue acts are modeled via a dialogue act n-gram. The statistical dialogue grammar is combined with word n-grams, decision trees, and neural networks modeling the idiosyncratic lexical and prosodic manifestations of each dialogue act. We develop a probabilistic integration of speech recognition with dialogue modeling, to improve both speech recognition and dialogue act classification accuracy. Models are trained and evaluated using a large hand-labeled database of 1,155 conversations from the Switchboard corpus of spontaneous human-to-human telephone speech. We achieved good dialogue act labeling accuracy (65% based on errorful, automatically recognized words and prosody, and 71% based on word transcripts, compared to a chance baseline accuracy of 35% and human accuracy of 84%) and a small reduction in word recognition error.

Subfields: Artificial Intelligence, Language and Linguistics

View Paper: https://www.semanticscholar.org/paper/22d45dadde6b5837eff11dc031045754bc5901c3

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Yoshua Bengio
  3. Jianfeng Gao
  4. Percy Liang
  5. Luke S. Zettlemoyer
  6. Noah A. Smith
  7. Kyunghyun Cho
  8. Quoc V. Le

In Language and Linguistics

  1. Phil Blunsom
  2. Daniel Klein
  3. David Leo Wright Hall
  4. Nal Kalchbrenner
  5. Sam Thomson
  6. Dawn Song
  7. Dan Roth
  8. A. P. Sarath Chandar

Citations in the corpus