Treating stimuli as a random factor in social psychology: a new and comprehensive solution to a pervasive but largely ignored problem.

By C. Judd, J. Westfall, David A. Kenny. Journal of Personality and Social Psychology, 2012

1,148 citations recorded by the source corpus.

Subfields: Food Science, Social Psychology, Sociology and Political Science

View Paper: https://www.semanticscholar.org/paper/c5931d46dce7652080228ecb131392388c4a6c07

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Food Science

In Social Psychology

In Sociology and Political Science

Citations in the corpus

Parsimonious Mixed Models (2015, methodology): “As a second demonstration that linear mixed models with a maximal random-effect structure may be asking too much, we re-analyze data from a visual-attention experiment (Kliegl et al., 2015), following up a published experiment (Kliegl et al., 2011) with an (unfortunately) overidentified lmm, as show”
Recommendations for Increasing Replicability in Psychology † (2013, methodology): “This includes testing appropriateness of method-required assumptions, treating stimuli as random rather than fixed factors (Judd et al., 2012), respecting”
Direct-fit to nature: an evolutionary perspective on biological (and artificial) neural networks (2019, background): “, 2008), social psychology (Brunswik, 1955; Wells & Windschitl, 1999; Judd et al., 2012), and cognitive neuroscience (Bedny et al.”
Towards More Rigorous Personality Trait–Outcome Research (2016, methodology): “Another formal method for testing the causal unity of traits is to use random-effects models and treat indicators as random factors, as suggested by Judd et al. (2012).”
The Enhancing Versus Backfiring Effects of Positive Emotion in Consumer Reviews (2020, result): “…us to make full use of the data without averaging across responses and had the added benefit of providing greater confidence in the generalizability of the results to both readers and reviews not included in the current experiment (Baayen, Davidson, and Bates 2008; Judd, Westfall, and Kenny 2012).”
The Hedonic Character of Nostalgia: An Integrative Data Analysis (2020, background): “More important, by relying on a single song to operationalize music-evoked nostalgia, these experiments are subject to the perils of insufficient stimulus sampling (Judd et al., 2012).”
Statistical power and optimal design in experiments in which samples of participants respond to samples of stimuli. (2014, methodology): “As another example, if one analyzes the data using a statistical model that incorporates uncertainty in the parameter estimates due to random stimulus variation (Judd et al., 2012), it will often be more difficult to obtain precise estimates of effects—a cost that we hope the lessons of this article”
But You Don’t Look Like A Scientist!: Women Scientists with Feminine Appearance are Deemed Less Likely to be Scientists (2016, positive): “…career likelihood were related over and above any unique variations between stimuli, eliminating the possibility that arbitrary variations among the photographs gave rise to the observed effects (e.g., the relationship obtained between perceived femininity and career likelihood; Judd et al. 2012).”
The links between self-determined motivations and behavioral automaticity in a variety of real-life behaviors (2017, methodology): “Finally, LMM allow incomplete and unbalanced data to be used and information loss due to averaging over observations or participants to be avoided (Judd et al. 2012).”
The relation between statistical power and inference in fMRI (2017, background): “…two variables [12], for instance expressed as Cohen's d or the Pearson's r) and the nominal Type I error rate ( α ) (however, when other factors (not just subjects) such as stimuli are also modelled as random factors, power is a complex function of all the random factors, see references [13,14]).”
Analyzing dynamic phonetic data using generalized additive mixed modeling: A tutorial focusing on articulatory differences between L1 and L2 speakers of English (2018, neutral): “Consequently, please keep in mind that the p -values and con-ﬁ dence bands will be overcon ﬁ dent for these ﬁ rst few models (e.g., Judd, Westfall, & Kenny, 2012).”
The Implied Truth Effect: Attaching Warnings to a Subset of Fake News Headlines Increases Perceived Accuracy of Headlines Without Warnings (2020, background): “However, it subsequently came to our attention that such a procedure is problematic andmay introduce bias (Judd et al. 2012).”