Human-AI Collaboration in Data Science

By Dakuo Wang, Justin D. Weisz, Michael J. Muller, Parikshit Ram, Werner Geyer, Casey Dugan, Yla R. Tausczik, Horst Samulowitz, Alexander G. Gray. 2019

338 citations recorded by the source corpus.

The rapid advancement of artificial intelligence (AI) is changing our lives in many ways. One application domain is data science. New techniques in automating the creation of AI, known as AutoAI or AutoML, aim to automate the work practices of data scientists. AutoAI systems are capable of autonomously ingesting and pre-processing data, engineering new features, and creating and scoring models based on a target objectives (e.g. accuracy or run-time efficiency). Though not yet widely adopted, we are interested in understanding how AutoAI will impact the practice of data science. We conducted interviews with 20 data scientists who work at a large, multinational technology company and practice data science in various business settings. Our goal is to understand their current work practices and how these practices might change with AutoAI. Reactions were mixed: while informants expressed concerns about the trend of automating their jobs, they also strongly felt it was inevitable. Despite these concerns, they remained optimistic about their future job security due to a view that the future of data science work will be a collaboration between humans and AI systems, in which both automation and human expertise are indispensable.

Subfields: Artificial Intelligence, Management Information Systems, Safety Research

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Management Information Systems

Ben Shneiderman

In Safety Research

Citations in the corpus

From Human-Human Collaboration to Human-AI Collaboration: Designing AI Systems That Can Work Together with People (2020, background): “From studying how users work with various AI systems such as AutoAI, chatbots, and clinical decision support systems (CDSS), he proposes “Human-AI Collaboration” as a new framework to study and design AI systems to work together with humans [7].”
Amazon SageMaker Autopilot: a white box AutoML solution at scale (2020, background): “The beneﬁts of this approach are also discussed in Wang et al. (2019).”
Designing Creative AI Partners with COFI: A Framework for Modeling Interaction in Human-AI Co-Creative Systems (2022, background): “The term “human-AI collaboration” has emerged in recent work studying user interaction with AI systems [7, 24, 118, 151].”