Human-Centered Explainable AI (XAI): From Algorithms to User Experiences

By Q. Liao, Microsoft Research, Canada Kush, Richa Varshney, Kush R. Varshney. arXiv.org, 2021

347 citations recorded by the source corpus.

In recent years, the field of explainable AI (XAI) has produced a vast collection of algorithms, providing a useful toolbox for researchers and practitioners to build XAI applications. With the rich application opportunities, explainability is believed to have moved beyond a demand by data scientists or researchers to comprehend the models they develop, to an essential requirement for people to trust and adopt AI deployed in numerous domains. However, explainability is an inherently human-centric property and the field is starting to embrace human-centered approaches. Human-computer interaction (HCI) research and user experience (UX) design in this area are becoming increasingly important. In this chapter, we begin with a high-level overview of the technical landscape of XAI algorithms, then selectively survey our own and other recent HCI works that take human-centered approaches to design, evaluate, and provide conceptual and methodological tools for XAI. We ask the question"what are human-centered approaches doing for XAI"and highlight three roles that they play in shaping XAI technologies by helping navigate, assess and expand the XAI toolbox: to drive technical choices by users' explainability needs, to uncover pitfalls of existing XAI methods and inform new methods, and to provide conceptual frameworks for human-compatible XAI.

Subfields: Artificial Intelligence, Health Informatics, Safety Research

View Paper: https://www.semanticscholar.org/paper/5e1746995debd1f17c24af01514c727598cc5613

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Health Informatics

In Safety Research

Citations in the corpus

AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap (2023, background): “In our own work [118, 188], we have argued for the importance of taking a human-centered perspective on transparency—designing and evaluating transparency approaches with stakeholders and their goals in mind.”
Explainable Artificial Intelligence Applications in Cyber Security: State-of-the-Art in Research (2022, background): “[253] presented a high-level introduction of the XAI algorithm's technical environment, followed by a selective examination of current HCI works that use humancentered design, evaluation, and provision of conceptual and methodological tools for XAI.”