Handling Complex Meta-analytic Data Structures Using Robust Variance Estimates: a Tutorial in R

By E. Tanner‐Smith, Elizabeth Tipton, J. Polanin. Journal of Developmental and Life-Course Criminology, 2016

349 citations recorded by the source corpus.

Subfields: Experimental and Cognitive Psychology, Sociology and Political Science, Statistics and Probability

View Paper: https://www.semanticscholar.org/paper/4995691b2a28cd1a6197b9a309645dfe51877d61

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Experimental and Cognitive Psychology

In Sociology and Political Science

In Statistics and Probability

Citations in the corpus

The effects of imagery interventions in sports: a meta-analysis (2020, methodology): “We addressed this problem by using robust variance estimation (RVE, Hedges et al., 2010; Tanner-Smith et al., 2016; Tanner-Smith & Tipton, 2014).”
Simulation-Based Learning in Higher Education: A Meta-Analysis (2020, background): “Second, as multiple studies reported multiple outcomes and used several treatment and/or control conditions, the correlated effect sizes were handled by using robust variance estimation correction coefficients, as suggested by Tanner-Smith et al. (2016).”
Beyond cold technology: A systematic review and meta-analysis on emotions in technology-based learning environments (2018, background): “The remaining seven models did not reach the critical threshold of four degrees of freedom required for reliable significance testing of mean effects (Tanner-Smith et al., 2016).”
Achievement Motivation and Academic Dishonesty: A Meta-Analytic Investigation (2020, methodology): “…(to conduct the multivariate model) and clubSandwich package (to implement RVE with cluster-robust variance estimators using a sandwich estimator; Tanner-Smith et al. 2016) in R, we utilized random effects models with RVE to specify the covariance matrix structure and inverse weights for data…”
Meta-Analysis of Action Video Game Impact on Perceptual, Attentional, and Cognitive Skills (2018, background): “Impor-tantly, when the degrees of freedom for t tests are smaller than 4, the stated p value can be too small; for this reason, Tanner-Smith, Tipton, and Polanin (2016) suggest using a lower threshold for significance in these cases (e.g., p (cid:6) .01 instead of p (cid:6) .05), a strategy which…”
The Effects of Teacher Training on Teachers’ Family-Engagement Practices, Attitudes, and Knowledge: A Meta-analysis (2019, background): “…included school-based involvement (α = 0.01) and school-environment and home-based involvement (α = 0.05), degrees of freedom with these analyses were less than 4, making it difficult to rule out potential Type 1 error inflation due to too few studies and/or effects (Tanner-Smith et al., 2016).”
The Effect of Teacher Coaching on Instruction and Achievement: A Meta-Analysis of the Causal Evidence (2018, methodology): “We estimate all models using Robust Variance Estimation (RVE) methods (Hedges et al., 2010; Tanner-Smith et al., 2016) which account for both the differing degrees of precision across studies as well as the non-independence of effect sizes within studies through a method that is analogous to cluster”