Emotional Expressions Reconsidered: Challenges to Inferring Emotion From Human Facial Movements
By Lisa Feldman Barrett, Ralph Adolphs, Stacy C. Marsella, Aleix M. Martinez, Seth D. Pollak. 2019
1,413 citations recorded by the source corpus.
It is commonly assumed that a person’s emotional state can be readily inferred from his or her facial movements, typically called emotional expressions or facial expressions. This assumption influences legal judgments, policy decisions, national security protocols, and educational practices; guides the diagnosis and treatment of psychiatric illness, as well as the development of commercial applications; and pervades everyday social interactions as well as research in other scientific fields such as artificial intelligence, neuroscience, and computer vision. In this article, we survey examples of this widespread assumption, which we refer to as the common view, and we then examine the scientific evidence that tests this view, focusing on the six most popular emotion categories used by consumers of emotion research: anger, disgust, fear, happiness, sadness, and surprise. The available scientific evidence suggests that people do sometimes smile when happy, frown when sad, scowl when angry, and so on, as proposed by the common view, more than what would be expected by chance. Yet how people communicate anger, disgust, fear, happiness, sadness, and surprise varies substantially across cultures, situations, and even across people within a single situation. Furthermore, similar configurations of facial movements variably express instances of more than one emotion category. In fact, a given configuration of facial movements, such as a scowl, often communicates something other than an emotional state. Scientists agree that facial movements convey a range of information and are important for social communication, emotional or otherwise. But our review suggests an urgent need for research that examines how people actually move their faces to express emotions and other social information in the variety of contexts that make up everyday life, as well as careful study of the mechanisms by which people perceive instances of emotion in one another. We make specific research recommendations that will yield a more valid picture of how people move their faces to express emotions and how they infer emotional meaning from facial movements in situations of everyday life. This research is crucial to provide consumers of emotion research with the translational information they require.
Subfields: Cognitive Neuroscience, Experimental and Cognitive Psychology, Social Psychology
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Cognitive Neuroscience
In Experimental and Cognitive Psychology
Citations in the corpus
- Image Counterfactual Sensitivity Analysis for Detecting Unintended Bias (2019, background): “And we take care to distinguish the facial expression of smiling from the emotion of happiness, since for this inference of emotion from expression to be justifi-able would require inferential reliability, specificity, generalizability, and validity [2].”
- Towards a Standard for Identifying and Managing Bias in Artificial Intelligence (2022, background): “The basis for drawing conclusions about emotional state from facial characteristics ranges from unscientific and debunked theories to emerging experimental studies [177], presenting concerning challenges to AI systems that claim to make such judgements.”