An Agenda for Purely Confirmatory Research

By Eric-Jan Wagenmakers, Ruud Wetzels, Denny Borsboom, H.L.J. van der Maas, Rogier A. Kievit. Perspectives on Psychological Science, 2012

912 citations recorded by the source corpus.

Subfields: Food Science, General Decision Sciences, Sensory Systems

View Paper: https://www.semanticscholar.org/paper/406a31a9a208c8bc6489720ce21ef542328d5d4b

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Food Science

1. Bryan G. Cook
2. Daniël Lakens
3. Denny Borsboom
4. Roger Levy
5. Andrew Gelman
6. Felix D. Schönbrodt
7. Tal Yarkoni
8. Francis Tuerlinckx

In General Decision Sciences

1. Zoltan Dienes
2. Eric-Jan Wagenmakers
3. A. V. Veer
4. Roger Giner-Sorolla
5. Bryan G. Cook
6. Tal Yarkoni
7. J. Westfall
8. E. Marsden

In Sensory Systems

1. Bryan G. Cook
2. Roger Levy
3. Eric-Jan Wagenmakers
4. Angelos-Miltiadis Krypotos

Citations in the corpus

• Choosing prediction over explanation in psychology: Lessons from machine learning (2017, background): “…2013; Nosek & Lakens, 2014), where a sharp distinction is to be drawn between the exploratory (where flexibility is encouraged) and confirmatory (where flexibility is denied) components of a research program (Jonas & Cesario, 2015; Wagenmakers, Wetzels, Borsboom, van der Maas, & Kievit, 2012).”
• Development of Indirect Measures of Conscientiousness: Combining a Facets Approach and Network Analysis (2015, background): “Copyright © 2015 European Association of Personality Psychology (Wagenmakers et al., 2012).”
• Answers to 18 Questions About Open Science Practices (2018, neutral): “…of questionable research practices, even those where well-intentioned authors are HARKing (Wagenmakers, Wetzels, Borsboom, van der Maas, & Kievit, 2012), or when well-intentioned reviewers suggest removing non-significant hypotheses from a paper, which leads to publication bias (Banks,…”
• Same data, different conclusions: Radical dispersion in empirical results when independent analysts operationalize and test the same hypothesis (2021, background): “Note that this is a different definition of a confirmatory analysis than seen in scholarship on pre-registration of analyses, in which strictly confirmatory analyses are planned out and “frozen” online prior to having the dataset (Wagenmakers et al., 2012).”
• Registered Reports A Method to Increase the Credibility of Published Results (2014, background): “Confirmatory results follow a preregistered analysis plan and thereby ensure interpretability of the reported p -values (Wagenmakers et al., 2012).”
• A methodological synthesis and meta-analysis of judgment tasks in second language research (2020, methodology): “Outside of applied linguistics, we recommend Wagenmakers et al. (2012) and Munafò et al. (2017).”
• Hidden Multiplicity in Multiway ANOVA: Prevalence, Consequences, and Remedies (2014, neutral): “Another fruitful avenue to remedy the problem is the pre-registration of the hypotheses and the corresponding statistical analyses (e.g., Chambers, 2013; Chambers et al., 2013; de Groot, 1969; Goldacre, 2009; Wagenmakers et al., 2012; Wolfe, 2013).”