Is psychology suffering from a replication crisis? What does "failure to replicate" really mean?

By S. Maxwell, M. Y. Lau, G. Howard. American Psychologist, 2015

839 citations recorded by the source corpus.

Subfields: Ecological Modeling, Experimental and Cognitive Psychology, Statistics and Probability

View Paper: https://www.semanticscholar.org/paper/44568dcd125eb2bd279290ded2cdedae0f089f47

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Ecological Modeling

In Experimental and Cognitive Psychology

In Statistics and Probability

Citations in the corpus

Lack of group-to-individual generalizability is a threat to human subjects research (2018, background): “On a final note, with increasing emphasis on the so called “replication crisis” (46), and an acknowledgment that incentive structures can lead to harmful scientific practices (47), the present paper adds a voice to the chorus of scholars calling for increased transparency and accountability.”
Estimating the Reproducibility of Experimental Philosophy (2018, background): “There is no single or definitive way to do this (Maxwell et al. 2015; Open Science Collaboration 2015).”
Degrees of Freedom in Planning, Running, Analyzing, and Reporting Psychological Studies: A Checklist to Avoid p-Hacking (2016, methodology): “Other possible statistical frameworks are based on confidence intervals (Cumming, 2012), precision of effect size estimation (Maxwell et al., 2015), or Bayesian statistics (e.g., Kruschke, 2015).”
Systems Perspective of Amazon Mechanical Turk for Organizational Research: Review and Recommendations (2017, background): “Based on these ﬁndings and the relative ease of collecting data quickly on MTurk, we speculate that the increasing pressure for replication (Pashler and Harris, 2012; Klein et al., 2014; Stanley and Spence, 2014; Maxwell et al., 2015) may be a partial cause of MTurk’s increasing popularity.”
Harking, Sharking, and Tharking (2017, result): “Maxwell, Lau, and Howard (2015), for example, showed how 30 attempted replications— all of which were not able to reproduce a previously reported statistical finding when evaluated by the criterion of whether or not the parameter was statistically significant in any of the single replications—were…”
Psychology, Science, and Knowledge Construction: Broadening Perspectives from the Replication Crisis (2018, methodology): “B ob Although a successful replication rate of 36% was surprising to many, Maxwell et al. (2015) demonstrated v e r s y - study.”
Equivalence Tests (2017, neutral): “Maxwell, Lau, and Howard (2015) suggest that replication studies demonstrate the absence of an effect by using equivalence bounds of D L ¼ (cid:2) .1 and D U ¼ .1 or even D L ¼ (cid:2) .05 and D U ¼ .05.”