Null hypothesis significance testing: a review of an old and continuing controversy.

By R. Nickerson. Psychological methods, 2000

1,018 citations recorded by the source corpus.

Subfields: Applied Psychology, Social Psychology, Sociology and Political Science

View Paper: https://www.semanticscholar.org/paper/8c5e0e6f85b9dc15ecf23d43a49404925c4c41bf

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Applied Psychology

In Social Psychology

In Sociology and Political Science

Citations in the corpus

Why P Values Are Not a Useful Measure of Evidence in Statistical Significance Testing (2008, methodology): “From Bayes’ theorem, the posterior probability of the null hypothesis using our terminology is calculated as follows: Readers are referred to several articles in the psychology literature making use of this formula (e.g., Cohen, 1994; Falk & Greenbaum, 1995; Hagen, 1997; Nickerson, 2000).”
Issues in information theory-based statistical inference—a commentary from a frequentist’s perspective (2010, background): “…ones) given the null hypothesis being true (Pdata|H0), but neither the probability of the null hypothesis given the data (PH0|data) nor the probability of any particular alternative hypothesis given the data (PHA|data; see, e.g. Cohen 1994; Nickerson 2000 or Quinn and Keough 2002 for summaries).”
A Critical Examination of Common Beliefs About Partial Least Squares Path Modeling (2013, background): “Under NHST, statistical inferences are made based on the p value, which is defined as ‘‘the probability of obtaining a value of a test statistic . . . as large as the one obtained—conditional on the null hypothesis being true’’ (Nickerson, 2000, p. 247).”
Estimating Population Mean Power Under Conditions of Heterogeneity and Selection for Significance (2020, neutral): “We are well aware of the powerful arguments against the null hypothesis significance testing paradigm (Berger & Selke, 1987; Cohen, 1994; Halsey, Curran-Everett, Vowler, & Drummond, 2015; Harlow, Mulaik, & Steiger, 1997; Krueger, 2001; Nickerson, 2000; Rozenboom, 1960; Schervish, 1996).”
A Critical Assessment of Null Hypothesis Significance Testing in Quantitative Communication Research (2008, methodology): “First, whereas defenders of NHST often argue that current practices should be blamed rather than the NHST procedure itself (Abelson, 1997; Frick, 1996; Hagen, 1997; Mulaik, Raju, & Harshman, 1997; Nickerson, 2000), it is clear that 401 years of books and articles aimed at correcting the situation ha”
Basic statistical tools in research and data analysis (2016, background): “In inferential statistics, the term ‘null hypothesis’ (H0 ‘H‐naught,’ ‘H‐null’) denotes that there is no relationship (difference) between the population variables in question.[9]”
Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth Over Publishability (2012, background): “Further, in the dominant model of null hypothesis significance testing (Cohen, 1994; Nickerson, 2000; Rosnow & Rosenthal, 2009; Rozeboom, 1960), the nominal false-positive rate of α = .05 has become a de facto criterion for publishing.”
Replication Research and Special Education (2016, background): “A successful direct replication only serves as ancillary support for the original claim because rejection of a null hypothesis is not direct evidence the alternative hypothesis is true (though this mistaken belief may be prevalent among researchers; Nickerson, 2000).”
A Primer on the Understanding, Use, and Calculation of Confidence Intervals that are Based on Central and Noncentral Distributions (2001, methodology): “Despite a long history of criticism and exhortation to adopt a wider variety of alternative exploratory, descriptive, and inferential methods, NHST remains the dominant technique (e.g., Bakan, 1966; Cohen, 1994; Loftus, 1993; Meehl, 1978; Nickerson, 2000).”
Tackling the Problem of Construct Proliferation (2016, background): “The limitations associated with statistical significance testing are not exclusive to CFA (Nickerson, 2000), but they are important to clarify in the context of a discriminant validity analysis.”
Cautionary Note on Reporting Eta-Squared Values from Multifactor ANOVA Designs (2004, methodology): “Psychologists have recently devoted considerable attention to null hypothesis significance testing (NHST) (e.g., Krueger, 2001; Nickerson, 2000).”
Small Sample Size Solutions (2020, background): “Example 2: Ordered-constrained means with effect sizes The p-value is not a measure for the size of an effect (Nickerson, 2000).”
LOPSIDED REASONING ON LOPSIDED TESTS AND MULTIPLE COMPARISONS (2012, background): “The first is that, for many researchers, a narrow focus on P-values has caused neglect of the important matter of effect sizes and their interpretation.”