RETEST EFFECTS IN OPERATIONAL SELECTION SETTINGS: DEVELOPMENT AND TEST OF A FRAMEWORK
By Filip Lievens, Tine Buyse, P. Sackett. 2005
136 citations recorded by the source corpus.
This study proposes a framework for examining the effects of retaking tests in operational selection settings. A central feature of this framework is the distinction between within-person and between-person retest effects. This framework is used to develop hypotheses about retest effects for exemplars of three types of tests (knowledge tests, cognitive ability tests, and situational judgment tests) and to test these hypotheses in a high stakes selection setting (admission to medical studies in Belgium). Analyses of within-person retest effects showed that mean scores of repeat test takers were one-third of a standard deviation higher for the knowledge test and situational judgment test and one-half of a standard deviation higher for the cognitive ability test. The validity coefficients for the knowledge test differed significantly depending on whether examinees’ test scores on the first versus second administration were used, with the latter being more valid. Analyses of between-person retest effects on the prediction of academic performance showed that the same test score led to higher levels of performance for those passing on the first attempt than for those passing on the second attempt. The implications of these results are discussed in light of extant retesting practice.
Subfields: Cardiology and Cardiovascular Medicine, Public Health, Environmental and Occupational Health
View Paper: https://www.semanticscholar.org/paper/1ba07f25ba6724a0edbe83b43af59698a1867315
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Cardiology and Cardiovascular Medicine
In Public Health, Environmental and Occupational Health
- Eveline Schollaert
- Helga Peeters
- Filip Lievens
- Michael A. McDaniel
- Robert E. Ployhart
- William I. MacKenzie
- M. C. Campion
Citations in the corpus
- Situational judgment tests: A review of recent research (2008, methodology): “The meta-analysis of McDaniel et al. (2001) summarized these studies and found that the internal consistency coefficients varied between 0.”
- Retest effects in cognitive ability tests: A meta-analysis (2018, result): “However, several studies contradict this view and imply that validity changes as a consequence of retesting (e.g., Hausknecht et al., 2002; Lievens et al., 2005; te Nijenhuis et al., 2007), which speaks against this first cause that might lead to retest effects.”