Situational judgment tests as measures of 21st century skills : evidence across Europe and Latin America = Los tests de juicio situacional como medida de las habilidades para el siglo XXI : evidencia en toda Europa y América Latina
- Author
- Christoph Herde, Filip Lievens (UGent) , Emily G. Solberg, Jan L. Harbaugh, Mark H. Strong and Gary J. Burkholder
- Organization
- Abstract
- Over the years, various governmental, employment, and academic organizations have identified a list of skills to successfully master the challenges of the 21st century. So far, an adequate assessment of these skills across countries has remained challenging. Limitations inherent in the use of self-reports (e.g., lack of self-insight, socially desirable responding, response style bias, reference group bias, etc.) have spurred on the search for methods that could complement or even substitute self-report inventories. Situational judgment tests (SJTs) have been proposed as one of the complements/alternatives to the traditional self-report inventories. SJTs are low-fidelity simulations that confront participants with multiple domain-relevant situations and request to choose from a set of predefined responses. Our objectives are twofold: (a) outlining how a combined emic-etic approach can be used for developing SJT items that can be used across geographical regions and (b) investigating whether SJT scores can be compared across regions. Our data come from Laureate International Universities (N = 5,790) and comprise test-takers from Europe and Latin America who completed five different SJTs that were developed in line with a combined emic-etic approach. Results showed evidence for metric measurement invariance across participants from Europe and Latin America for all five SJTs. Implications for the use of SJTs as measures of 21st century skills are discussed.
- Keywords
- Situational judgment test, 21st century skills, Measurement invariance, personnel-selection, competence model, response format, personality, validity, culture, suggestions, performance, constructs, invariance
Downloads
-
Published article.pdf
- full text (Published version)
- |
- open access
- |
- |
- 229.33 KB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-8634147
- MLA
- Herde, Christoph, et al. “Situational Judgment Tests as Measures of 21st Century Skills : Evidence across Europe and Latin America = Los Tests de Juicio Situacional Como Medida de Las Habilidades Para El Siglo XXI : Evidencia En Toda Europa y América Latina.” JOURNAL OF WORK AND ORGANIZATIONAL PSYCHOLOGY-REVISTA DE PSICOLOGIA DEL TRABAJO Y DE LAS ORGANIZACIONES, vol. 35, no. 2, 2019, pp. 65–74, doi:10.5093/jwop2019a8.
- APA
- Herde, C., Lievens, F., Solberg, E. G., Harbaugh, J. L., Strong, M. H., & J. Burkholder, G. (2019). Situational judgment tests as measures of 21st century skills : evidence across Europe and Latin America = Los tests de juicio situacional como medida de las habilidades para el siglo XXI : evidencia en toda Europa y América Latina. JOURNAL OF WORK AND ORGANIZATIONAL PSYCHOLOGY-REVISTA DE PSICOLOGIA DEL TRABAJO Y DE LAS ORGANIZACIONES, 35(2), 65–74. https://doi.org/10.5093/jwop2019a8
- Chicago author-date
- Herde, Christoph, Filip Lievens, Emily G. Solberg, Jan L. Harbaugh, Mark H. Strong, and Gary J. Burkholder. 2019. “Situational Judgment Tests as Measures of 21st Century Skills : Evidence across Europe and Latin America = Los Tests de Juicio Situacional Como Medida de Las Habilidades Para El Siglo XXI : Evidencia En Toda Europa y América Latina.” JOURNAL OF WORK AND ORGANIZATIONAL PSYCHOLOGY-REVISTA DE PSICOLOGIA DEL TRABAJO Y DE LAS ORGANIZACIONES 35 (2): 65–74. https://doi.org/10.5093/jwop2019a8.
- Chicago author-date (all authors)
- Herde, Christoph, Filip Lievens, Emily G. Solberg, Jan L. Harbaugh, Mark H. Strong, and Gary J. Burkholder. 2019. “Situational Judgment Tests as Measures of 21st Century Skills : Evidence across Europe and Latin America = Los Tests de Juicio Situacional Como Medida de Las Habilidades Para El Siglo XXI : Evidencia En Toda Europa y América Latina.” JOURNAL OF WORK AND ORGANIZATIONAL PSYCHOLOGY-REVISTA DE PSICOLOGIA DEL TRABAJO Y DE LAS ORGANIZACIONES 35 (2): 65–74. doi:10.5093/jwop2019a8.
- Vancouver
- 1.Herde C, Lievens F, Solberg EG, Harbaugh JL, Strong MH, J. Burkholder G. Situational judgment tests as measures of 21st century skills : evidence across Europe and Latin America = Los tests de juicio situacional como medida de las habilidades para el siglo XXI : evidencia en toda Europa y América Latina. JOURNAL OF WORK AND ORGANIZATIONAL PSYCHOLOGY-REVISTA DE PSICOLOGIA DEL TRABAJO Y DE LAS ORGANIZACIONES. 2019;35(2):65–74.
- IEEE
- [1]C. Herde, F. Lievens, E. G. Solberg, J. L. Harbaugh, M. H. Strong, and G. J. Burkholder, “Situational judgment tests as measures of 21st century skills : evidence across Europe and Latin America = Los tests de juicio situacional como medida de las habilidades para el siglo XXI : evidencia en toda Europa y América Latina,” JOURNAL OF WORK AND ORGANIZATIONAL PSYCHOLOGY-REVISTA DE PSICOLOGIA DEL TRABAJO Y DE LAS ORGANIZACIONES, vol. 35, no. 2, pp. 65–74, 2019.
@article{8634147, abstract = {{Over the years, various governmental, employment, and academic organizations have identified a list of skills to successfully master the challenges of the 21st century. So far, an adequate assessment of these skills across countries has remained challenging. Limitations inherent in the use of self-reports (e.g., lack of self-insight, socially desirable responding, response style bias, reference group bias, etc.) have spurred on the search for methods that could complement or even substitute self-report inventories. Situational judgment tests (SJTs) have been proposed as one of the complements/alternatives to the traditional self-report inventories. SJTs are low-fidelity simulations that confront participants with multiple domain-relevant situations and request to choose from a set of predefined responses. Our objectives are twofold: (a) outlining how a combined emic-etic approach can be used for developing SJT items that can be used across geographical regions and (b) investigating whether SJT scores can be compared across regions. Our data come from Laureate International Universities (N = 5,790) and comprise test-takers from Europe and Latin America who completed five different SJTs that were developed in line with a combined emic-etic approach. Results showed evidence for metric measurement invariance across participants from Europe and Latin America for all five SJTs. Implications for the use of SJTs as measures of 21st century skills are discussed.}}, author = {{Herde, Christoph and Lievens, Filip and Solberg, Emily G. and Harbaugh, Jan L. and Strong, Mark H. and J. Burkholder, Gary}}, issn = {{1576-5962}}, journal = {{JOURNAL OF WORK AND ORGANIZATIONAL PSYCHOLOGY-REVISTA DE PSICOLOGIA DEL TRABAJO Y DE LAS ORGANIZACIONES}}, keywords = {{Situational judgment test,21st century skills,Measurement invariance,personnel-selection,competence model,response format,personality,validity,culture,suggestions,performance,constructs,invariance}}, language = {{eng}}, location = {{Oviedo, SPAIN}}, number = {{2}}, pages = {{65--74}}, title = {{Situational judgment tests as measures of 21st century skills : evidence across Europe and Latin America = Los tests de juicio situacional como medida de las habilidades para el siglo XXI : evidencia en toda Europa y América Latina}}, url = {{http://doi.org/10.5093/jwop2019a8}}, volume = {{35}}, year = {{2019}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: