Can Nonrandomized Experiments Yield Accurate Answers? A Randomized Experiment Comparing Random and Nonrandom Assignments

By W. Shadish, M. H. Clark, Peter M. Steiner. 2008

544 citations recorded by the source corpus.

View Paper: https://www.semanticscholar.org/paper/2fd33be051f998a313e9e8451bdc00f9a3eac95e

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Statistics and Probability

Citations in the corpus

Assessing the Effectiveness of a College Freshman Seminar Using Propensity Score Adjustments (2011, methodology): “Although it is not clear which propensity score adjustment method is most effective (Kurth et al. 2006; Shadish et al. 2002, 2008 ), many studies have found that propensity score adjustments are effective in reducing selection bias regardless of the adjustment method used (Shadish et al.; Stu ¨rmer”
The link between high-impact practices and student learning: some longitudinal evidence (2015, result): “…the same effect estimates, particularly—as in the present study—when a pretest measure of the outcome is specified in the analytic model (e.g., Foster et al. 2009; Hanson et al. 2012; Padgett et al. 2010; Pascarella et al. 2013; Salisbury et al. 2013; Shadish et al. 2008; Shah et al. 2005).”
A Call for Examining Replication and Bias in Special Education Research (2014, background): “For example, Shadish, Clark, and Steiner (2008) randomly assigned university students to participate in either a randomized or non-randomized trial on the effects of math and vocabulary training.”
Propensity score techniques and the assessment of measured covariate balance to test causal associations in psychological research (2010, background): “…a covariate to the final regression model is also an option, although there is mixed evidence regarding its performance (Rubin, 2001; Rubin, 2004; Shadish et al., 2008); while simply including the PS itself does not generally work well, very recent work has indicated that including non-linear PS…”
Using an Experimental Evaluation of Charter Schools to Test Whether Nonexperimental Comparison Group Methods Can Replicate Experimental Impact Estimates (2012, methodology): “A. Revisiting the Criteria for a Within-Study Comparison ............................ 43 B. Summary of Findings and Possible Extensions ....................................... 45 vii REFERENCES ..........................................................................................................”
Exploring Colleagues’ Professional Influence on Mathematics Teachers’ Learning (2014, background): “Recently, T. Cook, Shadish and Wong (2008) and Shadish, Clark, and Steiner (2008) showed that estimates from nonrandomized studies that included controls for the precondition of the outcome variable closely approximated estimates from randomized experiments.”
How to do a good systematic review of effects in international development: a tool kit (2012, background): “Most authors in the quantitative ‘evidence movement’ (for example, Rubin 1974, Cook et al. 2008, Duflo et al. 2008, Shadish et al. 2008, Higgins and Green 2011, Gertler et al. 2011) have agreed that, where an experimental approach based on randomised allocation to the intervention is possible and…”
How Effective Is Correctional Education, and Where Do We Go from Here? The Results of a Comprehensive Evaluation (2014, background): “It is also notable that none of the studies in the systematic review earned a level-4 rating, which requires that the treatment and comparison groups be nearly identical on relevant baseline characteristics, as is sometime achieved by propensity score matching or other matching methods (Rosenbaum an”