Why Most Published Research Findings Are False

By John P. A. Ioannidis. 2005

9,605 citations recorded by the source corpus.

Summary There is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance. Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true. Moreover, for many current scientific fields, claimed research findings may often be simply accurate measures of the prevailing bias. In this essay, I discuss the implications of these problems for the conduct and interpretation of research.

Subfields: Economics and Econometrics, Statistics and Probability, Social Sciences & Humanities

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Economics and Econometrics

  1. Fotios Petropoulos
  2. Daniël Lakens
  3. Rob J Hyndman
  4. John P. A. Ioannidis
  5. Stanley E. Lazic
  6. Zoltan Dienes
  7. Douglas B. Kell
  8. Paul E. Smaldino

In Statistics and Probability

  1. Bryan G. Cook
  2. Daniël Lakens
  3. John P. A. Ioannidis
  4. Jonathan E. Taylor
  5. Andrew Gelman
  6. Vitaly Feldman
  7. Robert Tibshirani
  8. Andrea Saltelli

In Social Sciences & Humanities

  1. Paul E. Smaldino
  2. Daniël Lakens
  3. Jana Winter
  4. Charles Lambdin
  5. Daniele Fanelli
  6. Uri Simonsohn
  7. Joseph P. Simmons
  8. Leif D. Nelson

Citations in the corpus