Measures of Program Effectiveness Based on Retrospective Pretest Data: Are All Created Equal?
By Kim F. Nimon, Drea Zigarmi, Jeff M. Allen. 2011
141 citations recorded by the source corpus.
This study analyzed data from four evaluation designs incorporating the retrospective pretest (i.e., thentest), analyzing the effects of self-report pretesting and post-program survey format on a set of self-report measures. Validity of self-report data was assessed by comparing the criterion validity of then ratings to established benchmarks and by including a control condition. This study found that designs incorporating separate posttest and thentest surveys yielded the most comparable levels of criterion validity for then ratings and the least biased measures of program effectiveness. Conversely, designs that incorporated a single post-program survey, with adjacent post and then items, yielded the least comparable levels of criterion validity for then ratings and the most biased measures of program effectiveness. This study also found a slight interaction between the effects of self-report pretesting and post-program survey format. Implications for program evaluation are discussed.
Subfields: Applied Psychology, Management Science and Operations Research
View Paper: https://www.semanticscholar.org/paper/c978f12757eaed7950e66c884d7cd5496c0bf7db
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Applied Psychology
In Management Science and Operations Research
Citations in the corpus
- Exploring Organizational Alignment-Employee Engagement Linkages and Impact on Individual Performance (2015, result): “In support, recent meta-analytic work by Christian, Garza, and Slaughter (2011) echoed Rich et al. (2010) suggesting that engagement shared a statistically significant relation to task performance (Mρ = .”