The role of situations in situational judgment tests : effects on construct saturation, predictive validity, and applicant perceptions
- Author
- Philipp Schapers, Patrick Mussel, Filip Lievens (UGent) , Cornelius J. Koenig, Jan-Philipp Freudenstein and Stefan Krumm
- Organization
- Abstract
- Recent theorizing and empirical evidence suggesting that Situational Judgment Tests (SDI's) are more context-independent than previously thought has sparked a debate about the role of situation descriptions in S.M. To contribute to this debate and add to our understanding of how SJTs work, this article conceptually embeds SJT performance in a situation construal model and examines the effects of situation descriptions on the construct saturation and predictive validity of SJT scores, as well as on applicant perceptions. Across two studies (N = 1,092 and 578) and different Sri's, personality and cognitive ability were equally important determinants of SJT performance regardless of whether situation descriptions were presented or omitted. The effects of removing situation descriptions on the criterion-related validity of SJT scores differed depending on the breadth of the criteria. For predicting global job performance criteria (in-role performance and organizational citizenship behavior), SJT validity was not significantly affected, whereas it decreased for predicting more specific criteria (interpersonal adaptability, efficacy for teamwork). Finally, the effects of omitting situation descriptions in SJTs on applicant perceptions were either negligible or small. Implications for SJT theory, research, and design are discussed.
- Keywords
- GENERAL DOMAIN KNOWLEDGE, JOB-PERFORMANCE, PERSONNEL-SELECTION, INDIVIDUAL-DIFFERENCES, PERSONALITY-TRAITS, MEAN DIFFERENCES, SHORT VERSION, FIT INDEXES, RELIABILITY, MODEL, Situational Judgment Test, validity, contextualization, situation construal
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-8702837
- MLA
- Schapers, Philipp, et al. “The Role of Situations in Situational Judgment Tests : Effects on Construct Saturation, Predictive Validity, and Applicant Perceptions.” JOURNAL OF APPLIED PSYCHOLOGY, vol. 105, no. 8, 2020, pp. 800–18, doi:10.1037/apl0000457.
- APA
- Schapers, P., Mussel, P., Lievens, F., Koenig, C. J., Freudenstein, J.-P., & Krumm, S. (2020). The role of situations in situational judgment tests : effects on construct saturation, predictive validity, and applicant perceptions. JOURNAL OF APPLIED PSYCHOLOGY, 105(8), 800–818. https://doi.org/10.1037/apl0000457
- Chicago author-date
- Schapers, Philipp, Patrick Mussel, Filip Lievens, Cornelius J. Koenig, Jan-Philipp Freudenstein, and Stefan Krumm. 2020. “The Role of Situations in Situational Judgment Tests : Effects on Construct Saturation, Predictive Validity, and Applicant Perceptions.” JOURNAL OF APPLIED PSYCHOLOGY 105 (8): 800–818. https://doi.org/10.1037/apl0000457.
- Chicago author-date (all authors)
- Schapers, Philipp, Patrick Mussel, Filip Lievens, Cornelius J. Koenig, Jan-Philipp Freudenstein, and Stefan Krumm. 2020. “The Role of Situations in Situational Judgment Tests : Effects on Construct Saturation, Predictive Validity, and Applicant Perceptions.” JOURNAL OF APPLIED PSYCHOLOGY 105 (8): 800–818. doi:10.1037/apl0000457.
- Vancouver
- 1.Schapers P, Mussel P, Lievens F, Koenig CJ, Freudenstein J-P, Krumm S. The role of situations in situational judgment tests : effects on construct saturation, predictive validity, and applicant perceptions. JOURNAL OF APPLIED PSYCHOLOGY. 2020;105(8):800–18.
- IEEE
- [1]P. Schapers, P. Mussel, F. Lievens, C. J. Koenig, J.-P. Freudenstein, and S. Krumm, “The role of situations in situational judgment tests : effects on construct saturation, predictive validity, and applicant perceptions,” JOURNAL OF APPLIED PSYCHOLOGY, vol. 105, no. 8, pp. 800–818, 2020.
@article{8702837,
abstract = {{Recent theorizing and empirical evidence suggesting that Situational Judgment Tests (SDI's) are more context-independent than previously thought has sparked a debate about the role of situation descriptions in S.M. To contribute to this debate and add to our understanding of how SJTs work, this article conceptually embeds SJT performance in a situation construal model and examines the effects of situation descriptions on the construct saturation and predictive validity of SJT scores, as well as on applicant perceptions. Across two studies (N = 1,092 and 578) and different Sri's, personality and cognitive ability were equally important determinants of SJT performance regardless of whether situation descriptions were presented or omitted. The effects of removing situation descriptions on the criterion-related validity of SJT scores differed depending on the breadth of the criteria. For predicting global job performance criteria (in-role performance and organizational citizenship behavior), SJT validity was not significantly affected, whereas it decreased for predicting more specific criteria (interpersonal adaptability, efficacy for teamwork). Finally, the effects of omitting situation descriptions in SJTs on applicant perceptions were either negligible or small. Implications for SJT theory, research, and design are discussed.}},
author = {{Schapers, Philipp and Mussel, Patrick and Lievens, Filip and Koenig, Cornelius J. and Freudenstein, Jan-Philipp and Krumm, Stefan}},
issn = {{0021-9010}},
journal = {{JOURNAL OF APPLIED PSYCHOLOGY}},
keywords = {{GENERAL DOMAIN KNOWLEDGE,JOB-PERFORMANCE,PERSONNEL-SELECTION,INDIVIDUAL-DIFFERENCES,PERSONALITY-TRAITS,MEAN DIFFERENCES,SHORT VERSION,FIT INDEXES,RELIABILITY,MODEL,Situational Judgment Test,validity,contextualization,situation construal}},
language = {{eng}},
number = {{8}},
pages = {{800--818}},
title = {{The role of situations in situational judgment tests : effects on construct saturation, predictive validity, and applicant perceptions}},
url = {{http://doi.org/10.1037/apl0000457}},
volume = {{105}},
year = {{2020}},
}
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: