Beyond Significance Testing: Reforming Data Analysis Methods in Behavioral Research

By D. Klein. 2005

949 citations recorded by the source corpus.

Subfields: Cognitive Neuroscience, Psychiatry and Mental health

View Paper: https://www.semanticscholar.org/paper/70759b76469f5823caf3f0556978ddd29d57babe

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cognitive Neuroscience

In Psychiatry and Mental health

Citations in the corpus

Between-teacher differences in homework assignments and the development of students' homework effort, homework emotions, and achievement. (2009, neutral): “Keith, T. Z. (1986).”
A Meta-analysis of the Impact of Social and Emotional Learning Interventions on Teachers’ Burnout Symptoms (2021, methodology): “Between-group standardized mean differences at posttest (Hedges’ g) as uniform measures (Kline, 2004) were calculated based on the means, standard deviations, and group sample sizes collected from the pooled studies.”
How to select, calculate, and interpret effect sizes. (2009, methodology): “Several resources distinguish among the many different types of possible effects (Cooper & Hedges, 1994; Grissom & Kim, 2005; Kline, 2004).”
Intrinsic motivation as a moderator on the relationship between perceived job autonomy and work performance (2011, positive): “Still, it should be noted that a small sample provides a more conservative test (Song, Tsui, & Law, 2009), and the true relationships between the variables in our study may therefore be stronger than unveiled (Aguinis & Harden, 2009; Kline, 2004).”
Internalized Homophobia and Relationship Quality among Lesbians, Gay Men, and Bisexuals (2009, positive): “Kline (2004) has noted that significance testing should not be the only consideration in reviewing results so that not only Type I but also Type II errors (not recognizing a relationship because of lack of power) would be minimized.”
Quantitative Research Methods, Study Quality, and Outcomes: The Case of Interaction Research (2011, background): “Such experiments would tend to yield large effect sizes (Kline, 2004).”
Authoritarian Parenting Style in Asian Societies: A Cluster- Analytic Investigation* (2006, methodology): “The sign of d is arbitrary, and as recommended, a positive sign will be used when the result is consistent with the a priori hypothesis and a negative sign will be used when the result is in the opposite direction of that specified by the hypothesis (Kline, 2004).”
Taking Stock of Empowerment Evaluation (2006, background): “In addition, it is possible that unsuccessful empowerment evaluation projects are particularly likely to go unpublished (see Kline, 2004; Rosenthal, 1979).”
How to Estimate and Interpret Various Effect Sizes (2004, background): “The book, Beyond Significance Testing, by Kline (2004) is especially contemporary and comprehensive.”
Advances in testing the statistical significance of mediation effects. (2006, background): “Quantitative experts have urged researchers to emphasize estimating confidence limits as a way to address the limitations of null hypothesis testing (Kline, 2004; Krantz, 1999).”
Inference by eye: confidence intervals and how to read pictures of data. (2005, background): “Guidance for the calculation of CIs is given for a broad range of situations by Altman, Machin, Bryant, and Gardner (2000), Smithson (2002), and Kline (2004).”
Meta-analysis in Second Language Research: Choices and Challenges (2010, methodology): “Having completed the more objective data collection and statistical procedures of the meta-analysis, the meta-analyst is faced with the critical task of asking and addressing key questions such as these: “How do I interpret the meta-analytic effect sizes averaged across studies?” “How big is a ‘big’”
STATISTICAL COGNITION: TOWARDS EVIDENCE-BASED PRACTICE IN STATISTICS AND STATISTICS EDUCATION (2008, background): “Kline (2004), for example, listed five common fallacies in the interpretation of pvalues and eight common fallacies in reaching conclusions after deciding to reject or failing to reject the null hypothesis based on a p-value.”