Situational Judgment Tests and their Predictiveness of College Students’ Success: The Influence of Faking

By Helga Peeters, Filip Lievens. 2005

104 citations recorded by the source corpus.

There is increasing interest in using situational judgment tests (SJTs) to supplement traditional student admission procedures. An important unexplored issue is whether students can intentionally distort or fake their responses on SJTs. This study examined the fakability of an SJT of college students’ performance. Two hundred ninety-three psychology students completed a cognitive test, a personality measure, and an SJT. Only for the SJT, the students were assigned to either an honest or a fake condition. The scores of students in the fake condition were significantly higher than those of students in the honest condition (d = .89). Furthermore, faking had a negative effect on the criterion-related validity (there was a significant drop from r = .33 to r = .09) and the incremental validity of the SJT over cognitive ability and personality. These results are discussed in terms of the use of SJTs in high-stakes testing programs.

Subfields: Public Health, Environmental and Occupational Health, Safety Research

View Paper: https://www.semanticscholar.org/paper/6057591b741328c27f93137edb718acaf8c6fb57

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Public Health, Environmental and Occupational Health

In Safety Research

Citations in the corpus

SITUATIONAL JUDGMENT TESTS, RESPONSE INSTRUCTIONS, AND VALIDITY: A META‐ANALYSIS (2007, unknown): “…ability and each of the Big Five based on data obtained from seven studies (Grubb, 2003; Leaman, Vasilopoulos, & Usala, 1996; Lobsenz & Morris, 1999; McDaniel, Yost, Ludwick, Hense, & Hartman, 2004; Nguyen, 2001; O’Connell, McDaniel, Grubb, Hartman, & Lawrence, 2002; Peeters & Lievens, 2005).”
Effects of Response Instructions on Faking a Situational Judgment Test (2005, background): “They found that different response formats were associated with differences in the validity and reliability of their SJT.”
Situational judgment tests: An overview of current research (2009, background): “Peeters and Lievens (2005) studied the fakability of a SJT using college students.”
Meta-Analysis of the Relationship Between the Big Five and Academic Success at University (2007, unknown): “…Agreeableness Conscientiousness GPA 611 18.5 72.0 Multiple majors Bachelor –.07 –.03 .03 .10 .21 Paunonen & Ashton (2001) Canada Openness Conscientiousness Individual score 717 – 73.5 Psychology Bachelor –.04 .21 Peeters & Lievens (2005) Belgium Neuroticism Extraversion Openness…”
A Meta-Analysis of the Predictive Validity of the Graduate Management Admission Test (GMAT) and Undergraduate Grade Point Average (UGPA) for Graduate Student Academic Performance. (2007, background): “Faking on a situational judgment measure appears to yield a large increase in scores ( Peeters & Lievens, 2005 ).”
Personality Testing and Industrial–Organizational Psychology: Reflections, Progress, and Prospects (2008, background): “…on other selection measures; such research has been conducted on situational judgment tests (e.g., Cullen, Sackett, & Lievens, 2006; H. Peeters & Lievens, 2005), biographical data measures (e.g., Kluger & Collela, 1993; Schmitt & Kunce, 2002), employment interviews (e.g., Delery &…”
RETEST EFFECTS IN OPERATIONAL SELECTION SETTINGS: DEVELOPMENT AND TEST OF A FRAMEWORK (2005, background): “Some researchers have argued that the extent to which people are able to improve their scores on an SJT is a function of the constructs measured by the SJT (Peeters & Lievens, 2005).”
The State of Research on Situational Judgment Tests: A Content Analysis and Directions for Future Research (2014, background): “At this point there is not much evidence to show whether SJT faking actually occurs, and if it does occur, how much it might affect SJT scores, reliability, and validity (see Peeters & Lievens, 2005, for an exception).”
Situational judgment tests: A review of recent research (2008, background): “For instance, Ployhart et al. (2004) reported a test-retest reliability of 0.”
A SITUATIONAL JUDGMENT TEST OF PERSONAL INITIATIVE AND ITS RELATIONSHIP TO PERFORMANCE (2009, background): “We thought that this framing makes the “best” way of dealing with a situation less obvious and, thereby, reduces the problem of socially desirable answers (Peeters & Lievens, 2005).”