Goal-Based Explanation Evaluation

By David B. Leake. 1991

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Natural Language Processing

Citations in the corpus

Reframing Human-AI Collaboration for Generating Free-Text Explanations (2021, methodology): “This question addresses the distinction between “validity” and “utility” (Leake, 1991): an explanation can be valid (i.e., a restate-ment of the question with the answer ﬁlled-in might be correct), but not useful; utility is de-ﬁned by whether an explanation “satisﬁes an explainer’s need for…”
Explanation in Artificial Intelligence: Insights from the Social Sciences (2017, background): “Leake [94], on the other hand, argues for goal-directed explanations in abductive”
Background shifts affect explanatory style: how a pragmatic theory of explanation accounts for background effects in the generation of explanations (2010, background): “Although we believe Kitcher and Salmon’s objection is reasonable, we do not believe they have identified a fatal flaw in the pragmatic approach, as Lloyd and Anderson (1993) have argued.”
Focusing Construction and Selection of Abductive Hypotheses (1993, methodology): “In [Leake, 1991b; Leake, 1992] we describe an indexing vocabulary for organizing a memory of explanations to facilitate this focused explanation retrieval.”
Retrieval, reuse, revision and retention in case-based reasoning (2005, unknown): “Explanations serve many different goals , such as teaching the user about the domain or explaining the relevance of a question the user is asked (Leake, 1991; 1992; Sørmo & Cassens, 2004; Sørmo et al ., 2005).”
Interpreting Interpretability: Understanding Data Scientists' Use of Interpretability Tools for Machine Learning (2020, background): “Leake’s goal-based approach to explanations further includes metrics such as timeliness of the explanation in providing opportunity to deal better with the predicted event, knowability and the features responsible for “knowing,” and independence of individual explanations [35].”
Abduction, experience, and goals: a model of everyday abductive explanation (1995, methodology): “This example illustrates that the target for an explanation of an anomaly is not only a surprising state or event, but a failure of prior reasoning to generate proper expectations (Leake, 1991b, 1992; Schank, 1986; Schank et al., 1994).”
The Pragmatics of Explanation (2008, background): “Lombrozo and Carey (2006) adopted, and found evidence supporting, a view of functional explanation that was firmly rooted in the work of Wright (1973). According to this view, functional explanations are licensed when the history of the explanandum indicates that it was intended to fulfill that func”
Explanation in Case-Based Reasoning–Perspectives and Goals (2005, background): “In contrast to these syntactic-oriented criteria, a set of goal-based criteria are suggested (Leake, 1995b).”