Advanced search
1 file | 319.40 KB Add to list

Situational judgement tests for selection : traditional vs construct-driven approaches

(2020) MEDICAL EDUCATION. 54(2). p.105-115
Author
Organization
Abstract
Context Historically, situational judgement tests (SJTs) have been widely used for personnel selection. Their use in medical selection in Europe is growing, with plans for further expansion into North America and Australasia, in an attempt to measure and select on 'non-academic' personal attributes. However, there is a lack of clarity regarding what such tests actually measure and how they should be designed, scored and implemented within the medical and health education selection process. In particular, the theoretical basis from which such tests are developed will determine the scoring options available, influencing their psychometric properties and, ultimately, their validity. Methods The aim of this article is to create an awareness of the previous theory and practice that has informed SJT development. We describe the emerging interest in the use of the SJT format to measure specific constructs (eg 'resilience', 'dependability', etc.), drawing on the tradition of 'individual differences' psychology. We compare and contrast this newer 'construct-driven' method with the traditional, pragmatic approach to SJT creation, often employed by organisational psychologists. Making reference to measurement theory, we highlight how the anticipated psychometric properties of traditional vs construct-driven SJTs are likely to differ. Conclusions Compared to traditional SJTs, construct-driven SJTs have a strong theoretical basis, are uni- rather than multidimensional, and may behave more like personality self-report instruments. Emerging evidence also suggests that construct-driven SJTs have comparable predictive validity for workplace performance, although they may be more prone to 'faking' effects. It is possible that construct-driven approaches prove more appropriate at early stages of medical selection, where candidates have little or no health care work experience. Conversely, traditional SJTs may be more suitable for specialty recruitment, where a range of hypothetical workplace scenarios can be sampled in assessments.
Keywords
Education, General Medicine, RESPONSE INSTRUCTIONS, PERSONALITY-TRAITS, MEDICAL-EDUCATION, VALIDITY, RELIABILITY, VARIANCE, VALIDATION, PREDICTORS, TAXONOMY, POLICIES

Downloads

  • (...).pdf
    • full text (Published version)
    • |
    • UGent only
    • |
    • PDF
    • |
    • 319.40 KB

Citation

Please use this url to cite or link to this publication:

MLA
Tiffin, Paul A., et al. “Situational Judgement Tests for Selection : Traditional vs Construct-Driven Approaches.” MEDICAL EDUCATION, vol. 54, no. 2, 2020, pp. 105–15, doi:10.1111/medu.14011.
APA
Tiffin, P. A., Paton, L. W., O’Mara, D., MacCann, C., Lang, J., & Lievens, F. (2020). Situational judgement tests for selection : traditional vs construct-driven approaches. MEDICAL EDUCATION, 54(2), 105–115. https://doi.org/10.1111/medu.14011
Chicago author-date
Tiffin, Paul A., Lewis W. Paton, Deborah O’Mara, Carolyn MacCann, Jonas Lang, and Filip Lievens. 2020. “Situational Judgement Tests for Selection : Traditional vs Construct-Driven Approaches.” MEDICAL EDUCATION 54 (2): 105–15. https://doi.org/10.1111/medu.14011.
Chicago author-date (all authors)
Tiffin, Paul A., Lewis W. Paton, Deborah O’Mara, Carolyn MacCann, Jonas Lang, and Filip Lievens. 2020. “Situational Judgement Tests for Selection : Traditional vs Construct-Driven Approaches.” MEDICAL EDUCATION 54 (2): 105–115. doi:10.1111/medu.14011.
Vancouver
1.
Tiffin PA, Paton LW, O’Mara D, MacCann C, Lang J, Lievens F. Situational judgement tests for selection : traditional vs construct-driven approaches. MEDICAL EDUCATION. 2020;54(2):105–15.
IEEE
[1]
P. A. Tiffin, L. W. Paton, D. O’Mara, C. MacCann, J. Lang, and F. Lievens, “Situational judgement tests for selection : traditional vs construct-driven approaches,” MEDICAL EDUCATION, vol. 54, no. 2, pp. 105–115, 2020.
@article{8656342,
  abstract     = {Context Historically, situational judgement tests (SJTs) have been widely used for personnel selection. Their use in medical selection in Europe is growing, with plans for further expansion into North America and Australasia, in an attempt to measure and select on 'non-academic' personal attributes. However, there is a lack of clarity regarding what such tests actually measure and how they should be designed, scored and implemented within the medical and health education selection process. In particular, the theoretical basis from which such tests are developed will determine the scoring options available, influencing their psychometric properties and, ultimately, their validity. Methods The aim of this article is to create an awareness of the previous theory and practice that has informed SJT development. We describe the emerging interest in the use of the SJT format to measure specific constructs (eg 'resilience', 'dependability', etc.), drawing on the tradition of 'individual differences' psychology. We compare and contrast this newer 'construct-driven' method with the traditional, pragmatic approach to SJT creation, often employed by organisational psychologists. Making reference to measurement theory, we highlight how the anticipated psychometric properties of traditional vs construct-driven SJTs are likely to differ. Conclusions Compared to traditional SJTs, construct-driven SJTs have a strong theoretical basis, are uni- rather than multidimensional, and may behave more like personality self-report instruments. Emerging evidence also suggests that construct-driven SJTs have comparable predictive validity for workplace performance, although they may be more prone to 'faking' effects. It is possible that construct-driven approaches prove more appropriate at early stages of medical selection, where candidates have little or no health care work experience. Conversely, traditional SJTs may be more suitable for specialty recruitment, where a range of hypothetical workplace scenarios can be sampled in assessments.},
  author       = {Tiffin, Paul A. and Paton, Lewis W. and O'Mara, Deborah and MacCann, Carolyn and Lang, Jonas and Lievens, Filip},
  issn         = {0308-0110},
  journal      = {MEDICAL EDUCATION},
  keywords     = {Education,General Medicine,RESPONSE INSTRUCTIONS,PERSONALITY-TRAITS,MEDICAL-EDUCATION,VALIDITY,RELIABILITY,VARIANCE,VALIDATION,PREDICTORS,TAXONOMY,POLICIES},
  language     = {eng},
  number       = {2},
  pages        = {105--115},
  title        = {Situational judgement tests for selection : traditional vs construct-driven approaches},
  url          = {http://dx.doi.org/10.1111/medu.14011},
  volume       = {54},
  year         = {2020},
}

Altmetric
View in Altmetric
Web of Science
Times cited: