The power of statistical tests for moderators in meta-analysis.

By L. Hedges, Terri D. Pigott. Psychological methods, 2004

630 citations recorded by the source corpus.

Subfields: Management Science and Operations Research, Statistics and Probability

View Paper: https://www.semanticscholar.org/paper/c398781a56e159ee55a9464f340c83b071b14d37

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Management Science and Operations Research

In Statistics and Probability

Citations in the corpus

A Meta-Analysis of School-Based Bullying Prevention Programs' Effects on Bystander Intervention Behavior (2012, result): “Third, because of the low number of studies per factor, the ANOVA-like moderator analyses generated relatively low statistical power and the results should be interpreted with caution (Hedges & Pigott, 2004).”
A Review of Meta-Analyses in Education (2012, methodology): “As recommended in APA (2008), we suggest that meta-analysts evaluate statistical power prior to statistical analyses as described in Hedges and Pigott (2001, 2004) and report retrospective statistical power of significance testing so that readers can be fully informed.”
General Need for Autonomy and Subjective Well-Being: A Meta-Analysis of Studies in the US and East Asia (2017, positive): “Our power analyses of the differences in correlation coefﬁcients, following the procedures described by Hedges and Pigott (2004), showed that our moderator tests have sufﬁcient power to detect meaningful differences in correlations (i.e., medium or large effect) with a power of over .99, while…”
Initial Severity and Antidepressant Benefits: A Meta-Analysis of Data Submitted to the Food and Drug Administration (2008, methodology): “A last, mixedeffects analysis for the amount of change used a randomeffects constant along with fixed-effects moderator dimensions; these models provide more conservative assessments of moderation [19].”
Modeling dependent effect sizes with three-level meta-analyses: a structural equation modeling approach. (2014, background): “The statistical power of the tests might have been lowered because some information in the effect sizes was lost (Hedges & Pigott, 2001, 2004).”
Guidelines for Meta-Analyses of Counseling Psychology Research (2006, methodology): “Although we advise readers to refer to other sources for technical details (e.g., Hedges, 1994; Hedges & Pigott, 2004; Raudenbush, 1994), we provide a conceptual overview of moderator analysis.”
Mathematical Interventions for Secondary Students With Learning Disabilities and Mathematics Difficulties: A Meta-Analysis (2018, background): “Further, the effect of the small number of studies influenced results of the moderator analyses, which are lower powered than the main effect analysis (Hedges & Pigott, 2004).”
Advancing Theory by Assessing Boundary Conditions With Metaregression: A Critical Review and Best-Practice Recommendations (2018, methodology): “Using Hedges and Pigott’s (2004) formulae in Cafri and colleagues’ (2009) macro (for syntax, see Appendix C), we assumed a moderate sized effect of .”
Working Memory Training Does Not Improve Performance on Measures of Intelligence or Other Measures of “Far Transfer”: Evidence from a Meta-Analytic Review (2016, positive): “(2015), we have a considerably larger sample of studies, providing us much more robust estimates of effect size and allowing us to perform moderator analyses that have more power (Hedges & Pigott, 2004).”
Sample size planning for statistical power and accuracy in parameter estimation. (2008, background): “Hedges & Pigott (2001, 2004) argue for the importance of conducting power analyses before investing resources in a meta-analysis.”
A Meta-Analysis of the Relationship Between Sleep Problems and Loneliness (2020, methodology): “Such analyses would have required obtaining full covariance matrices from study authors (Hedges & Pigott, 2004; Valentine, Pigott, & Rothstein, 2010).”
Effects of flipping the classroom on learning outcomes and satisfaction: A meta-analysis (2019, methodology): “To aid the reader in understanding the magnitude of this problem, we provided retrospective power analysis where appropriate (Hedges & Pigott, 2004; Hempel et al., 2013).”
A meta-analysis of intercropping in Africa: impacts on crop yield, farmer income, and integrated pest management effects (2017, background): “…relationship between the dependent and independent variable relies on the moderator’s value (e.g. if the variation amongst the studies’ effect sizes is related to differences in other factors such as the study locations, study management methods, or the subject themselves) (Hedges & Pigott, 2004).”