Those Confounded Moderators in Meta-Analysis: Good, Bad, and Ugly

By Mark Lipsey. 2003

289 citations recorded by the source corpus.

Subfields: Artificial Intelligence, Statistics and Probability

View Paper: https://www.semanticscholar.org/paper/728d93b3e59f57119f22030900b5c80bb9a5554a

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Statistics and Probability

Citations in the corpus

Do Self-Concept Interventions Make a Difference? A Synergistic Blend of Construct Validation and Meta-Analysis (2006, background): “This is important because such confounds can make it difficult to establish whether a moderator has a significant independent relation to the effect size (Lipsey, 2003).”
Ego depletion and the strength model of self-control: a meta-analysis. (2010, background): “The analysis yielded relatively few significant relations among the variables, suggesting that our selection of moderators and coding procedures were largely effective in identifying unique moderator variables that were not confounded with others (Lipsey, 2003).”
Effectiveness of school-based programs to reduce bullying: a systematic and meta-analytic review (2011, background): “Researchers should try to disentangle the relationships among them and identify those that truly have significant independent relationships with effect sizes (Lipsey 2003: 78).”
Effects of Cognitive Behavioral Programs for Criminal Offenders (2007, methodology): “This confounding of moderator variables makes it difficult to identify those most critical to the outcome (Lipsey, 2003).”
Survey Response Rates and Survey Administration in Counseling and Clinical Psychology (2009, background): “The study’s primary purpose was to (a) numerically assess response rates to surveys, (b) identify factors, termed moderators (Lipsey, 2003) in the meta-analysis literature, that affect response rates, (c) and examine variance across studies to assess the influence of possible moderators on the mean…”
Prospective prediction of health-related behaviours with the Theory of Planned Behaviour: a meta-analysis (2011, methodology): “Following Lipsey (2003) and Patall, Cooper, and Robinson (2008) these moderators were first assessed for potential confounding.”
Learning Through Case Comparisons: A Meta-Analytic Review (2013, background): “As Lipsey (2003) pointed out, a great risk within metaanalysis is not to recognize when variables are confounded.”
Taking Stock of the Relationship Between Gang Membership and Offending (2016, background): “Because important methodological characteristics are often related to one another (Lipsey, 2003), disentangling their independent influence on the effect size estimates in a meta-analysis will only reveal broad patterns across studies.”
Direct and indirect aggression during childhood and adolescence: a meta-analytic review of gender differences, intercorrelations, and relations to maladjustment. (2008, background): “We found some evidence of moderation of these links, although caution should be exercised in drawing conclusions given the potential confounds among moderators among the limited number of studies considered (Lipsey, 2003).”
A Meta-Analysis of Juvenile Justice Risk Assessment Instruments (2008, background): “Analysis of moderator effects explains variation in effect sizes (Lipsey, 2003).”
A Meta-analytic Review of Components Associated with Parent Training Program Effectiveness (2008, methodology): “In a meta-analysis of 382 juvenile delinquency interventions, Lipsey found randomized designs were more often used to evaluate “research/ demonstration” programs, whereas non-randomized designs were more often employed by “practice” programs (Lipsey 2003; Wilson and Lipsey 2003).”
The Primary Factors that Characterize Effective Interventions with Juvenile Offenders: A Meta-Analytic Overview (2009, background): “Moreover, methodological and substantive factors are often confounded in ways that make it difficult to disentangle actual program effects from methodological artifacts (Lipsey, 2003).”
Can Policing Disorder Reduce Crime? A Systematic Review and Meta-analysis (2015, background): “Moderator variables cannot be assumed to capture statistically independent conditions and, as such, great care must be taken when interpreting the relationship between moderator variables and effect sizes in meta-analysis (Lipsey 2003).”