Using an application to measure trainees’ procedural knowledge before chest tube insertion
- Author
- Leander De Mol (UGent) , Joris Vangeneugden (UGent) , Liesbeth Desender (UGent) , Isabelle Van Herzeele (UGent) , Lars Konge and Wouter Willaert (UGent)
- Organization
- Abstract
- Purpose of the study To collect validity evidence for the chest tube insertion (CTI) test mode on the medical simulation application Touch Surgery. This was done by using Messick's contemporary framework. Methods Novice, intermediate and experienced participants provided informed consent and demographic information. After familiarisation with the application, they completed the CTI test mode. Validity evidence was collected from four sources: content, response process, relation to other variables and consequences. A post-study questionnaire with 5-point Likert scales assessed the perceived realism, relevance and utility of the assessment. Mean scores of the three groups were compared. Results A total of 25 novices, 11 intermediates and 19 experienced participants were recruited. Content evidence was collected by an expert in CTI and was based on published literature and guidelines. All users were familiarised with the application, and received standardised instructions throughout the test. Most users rated the simulation as realistic and suitable to assess cognitive skills. Novices received significantly lower (55.9 +/- 7.5) test mode scores than intermediates (80.6 +/- 4.4) (p<0.001) and experienced participants (82.3 +/- 5.3) (p<0.001). There was no significant difference in score between intermediate and experienced participants (p=0.75). Consequences evidence was provided by establishing a pass/fail score of 71% using the contrasting groups method, which resulted in one observed false positive and no false negatives. Conclusion A robust validity argument was constructed for the CTI test mode, which can be implemented in surgical curricula to assess learners' cognitive skills prior to hands-on simulation practice.
- Keywords
- medical education & training, thoracic surgery, surgery, SIMULATION, SURGERY, EDUCATION, IMPROVES
Downloads
-
(...).pdf
- full text (Published version)
- |
- UGent only
- |
- |
- 331.84 KB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-8742386
- MLA
- De Mol, Leander, et al. “Using an Application to Measure Trainees’ Procedural Knowledge before Chest Tube Insertion.” POSTGRADUATE MEDICAL JOURNAL, vol. 99, no. 1173, 2023, pp. 782–87, doi:10.1136/postgradmedj-2022-141580.
- APA
- De Mol, L., Vangeneugden, J., Desender, L., Van Herzeele, I., Konge, L., & Willaert, W. (2023). Using an application to measure trainees’ procedural knowledge before chest tube insertion. POSTGRADUATE MEDICAL JOURNAL, 99(1173), 782–787. https://doi.org/10.1136/postgradmedj-2022-141580
- Chicago author-date
- De Mol, Leander, Joris Vangeneugden, Liesbeth Desender, Isabelle Van Herzeele, Lars Konge, and Wouter Willaert. 2023. “Using an Application to Measure Trainees’ Procedural Knowledge before Chest Tube Insertion.” POSTGRADUATE MEDICAL JOURNAL 99 (1173): 782–87. https://doi.org/10.1136/postgradmedj-2022-141580.
- Chicago author-date (all authors)
- De Mol, Leander, Joris Vangeneugden, Liesbeth Desender, Isabelle Van Herzeele, Lars Konge, and Wouter Willaert. 2023. “Using an Application to Measure Trainees’ Procedural Knowledge before Chest Tube Insertion.” POSTGRADUATE MEDICAL JOURNAL 99 (1173): 782–787. doi:10.1136/postgradmedj-2022-141580.
- Vancouver
- 1.De Mol L, Vangeneugden J, Desender L, Van Herzeele I, Konge L, Willaert W. Using an application to measure trainees’ procedural knowledge before chest tube insertion. POSTGRADUATE MEDICAL JOURNAL. 2023;99(1173):782–7.
- IEEE
- [1]L. De Mol, J. Vangeneugden, L. Desender, I. Van Herzeele, L. Konge, and W. Willaert, “Using an application to measure trainees’ procedural knowledge before chest tube insertion,” POSTGRADUATE MEDICAL JOURNAL, vol. 99, no. 1173, pp. 782–787, 2023.
@article{8742386, abstract = {{Purpose of the study To collect validity evidence for the chest tube insertion (CTI) test mode on the medical simulation application Touch Surgery. This was done by using Messick's contemporary framework. Methods Novice, intermediate and experienced participants provided informed consent and demographic information. After familiarisation with the application, they completed the CTI test mode. Validity evidence was collected from four sources: content, response process, relation to other variables and consequences. A post-study questionnaire with 5-point Likert scales assessed the perceived realism, relevance and utility of the assessment. Mean scores of the three groups were compared. Results A total of 25 novices, 11 intermediates and 19 experienced participants were recruited. Content evidence was collected by an expert in CTI and was based on published literature and guidelines. All users were familiarised with the application, and received standardised instructions throughout the test. Most users rated the simulation as realistic and suitable to assess cognitive skills. Novices received significantly lower (55.9 +/- 7.5) test mode scores than intermediates (80.6 +/- 4.4) (p<0.001) and experienced participants (82.3 +/- 5.3) (p<0.001). There was no significant difference in score between intermediate and experienced participants (p=0.75). Consequences evidence was provided by establishing a pass/fail score of 71% using the contrasting groups method, which resulted in one observed false positive and no false negatives. Conclusion A robust validity argument was constructed for the CTI test mode, which can be implemented in surgical curricula to assess learners' cognitive skills prior to hands-on simulation practice.}}, author = {{De Mol, Leander and Vangeneugden, Joris and Desender, Liesbeth and Van Herzeele, Isabelle and Konge, Lars and Willaert, Wouter}}, issn = {{0032-5473}}, journal = {{POSTGRADUATE MEDICAL JOURNAL}}, keywords = {{medical education & training,thoracic surgery,surgery,SIMULATION,SURGERY,EDUCATION,IMPROVES}}, language = {{eng}}, number = {{1173}}, pages = {{782--787}}, title = {{Using an application to measure trainees’ procedural knowledge before chest tube insertion}}, url = {{http://doi.org/10.1136/postgradmedj-2022-141580}}, volume = {{99}}, year = {{2023}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: