Statistical Significance and Effect Size in Education Research: Two Sides of a Coin

By Xitao Fan. 2001

226 citations recorded by the source corpus.

Subfields: Computer Networks and Communications, Management Science and Operations Research, Statistics and Probability

View Paper: https://www.semanticscholar.org/paper/6b843e57989049f53ce53c57e52ed097ee40bbc7

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Networks and Communications

In Management Science and Operations Research

In Statistics and Probability

Citations in the corpus

Enhancing the Interpretation of Significant Findings: The Role of Mixed Methods Research (2004, background): “That is, holding everything else constant, the smaller the sample, the smaller the probability of obtaining a statistically significant result (Fan, 2001; Kirk, 1996; Thompson, 1993).”
The Other Half of the Story: Effect Size Analysis in Quantitative Research (2013, background): “will shorten to “significance testing,” also known as hypothesis testing) are complementary analyses, and both should be considered when evaluating quantitative research findings (Fan, 2001).”
Customer-Centric Science: Reporting Significant Research Results With Rigor, Relevance, and Practical Impact in Mind (2010, unknown): “…finance (e.g., Gómez-Bezares & Gómez-Bezares, 2006), psychology (e.g., Shrout, 1997), marketing (e.g., Iacobucci, 2005; Sawyer & Peter, 1983), economics (e.g., McCloskey, 1985), sociology (e.g., Henkel, 1976), education (e.g., Fan, 2001), and public administration (e.g., Cascio & Aguinis, 2001).”
A Comprehensive Review of Effect Size Reporting and Interpreting Practices in Academic Journals in Education and Psychology. (2010, background): “As Fan (2001) argued, p-value and effect size are two sides of one coin: They complement each other, but they do not substitute for each other; therefore, researchers should consider both sides.”
Reporting and Interpreting Effect Size in Quantitative Agricultural Education Research. (2011, background): “241); and that statistical significance testing determines the probability of obtaining the sampling outcome by chance, while it is effect size that addresses practical significance or meaningfulness (Fan, 2001).”
Tourism and Economic Growth: A Meta-regression Analysis (2019, methodology): “…on effect size and statistical significance, suggests that researchers should exert caution when interpreting estimates of the relationship between tourism and economic growth, especially for studies based on large observations (Benjamin et al. 2018; Fan 2001; Kaplan, Chambers, and Glasgow 2014).”
Enhancement of Metacognition Use and Awareness by Means of a Collaborative Intervention (2011, background): “Nonetheless, calls for caution from other authors about the possibility of statistical significance being caused by statistical power (large N) should not be disregarded (Xitao, 2001 ).”
Examining Student Evaluations of Black College Faculty: Does Race Matter? (2011, methodology): “" When traditional statistics are used with a large sample, ahnost any difference will be significant (Fan, 2001; Thompson, 1996); the sample in this study was large (14,321 undergraduate evaluation forms).”