
Development and testing of step, error, and event frameworks to evaluate technical performance in peripheral endovascular interventions
- Author
- Gilles Soenens (UGent) , Lauren Gorden, Bart Doyen, Mark Wheatcroft, Charles de Mestral, Vanessa Palter, Isabelle Van Herzeele (UGent) , Frederico Bastos Goncalves, Iris Baumgartner, Tiago Bilhim, Theodosios Bisdas, Jean Bismuth, Marianne Brodmann, Fausto Castriota, Enrico Cieri, Koen Deloose, Nuno Dias, Nicolas Diehm, Roberto Ferraresi, Ziv J. Haskal, Robert Hinchliffe, Ahmed Kayssi, Jose Ignacio Leal Lorenzo, Robert Lookstein, Robert Morgan, Stefan Müller-Hülsbeck, Jihad Mustapha, Christoph Anton Nienaber, Guiseppe Papia, Ashish Patel, Anand Prasad, Konstatinos Stavroulakis, Michel Reijnen, John Rundback, Jos C. van den Berg and [missing] NDORATE-PVI consortium
- Organization
- Project
- Abstract
- Objective: Tools for endovascular performance assessment are necessary in competency based education. This study aimed to develop and test a detailed analysis tool to assess steps, errors, and events in peripheral endovascular interventions (PVI). Methods: A modified Delphi consensus was used to identify steps, errors, and events in iliac-femoral-popliteal endovascular interventions. International experts in vascular surgery, interventional radiology, cardiology, and angiology were identified, based on their scientific track record. In an initial open ended survey round, experts volunteered a comprehensive list of steps, errors, and events. The items were then rated on a five point Likert scale until consensus was reached with a pre-defined threshold (Cronbach's alpha > 0.7) and > 70% expert agreement. An experienced endovascular surgeon applied the finalised frameworks on 10 previously videorecorded elective PVI cases. Results: The expert consensus panel was formed by 28 of 98 invited proceduralists, consisting of three angiologists, seven interventional radiologists, five cardiologists, and 13 vascular surgeons, with 29% from North America and 71% from Europe. The Delphi process was completed after three rounds (Cronbach's alpha; alpha(steps) = 0.79; alpha(errors) = 0.90; alpha(events) = 0.90), with 15, 26, and 18 items included in the final step (73 - 100% agreement), error (73 - 100% agreement), and event (73 - 100% agreement) frameworks, respectively. The median rating time per case was 4.3 hours (interquartile range [IQR] 3.2, 5 hours). A median of 55 steps (IQR 40, 67), 27 errors (IQR 21, 49), and two events (IQR 1, 6) were identified per case. Conclusion: An evaluation tool for the procedural steps, errors, and events in iliac-femoral-popliteal endovascular procedures was developed through a modified Delphi consensus and applied to recorded intra-operative data to identify hazardous steps, common errors, and events. Procedural mastery may be promoted by using the frameworks to provide endovascular proceduralists with detailed technical performance feedback.
- Keywords
- Angioplasty balloon, Delphi technique, Endovascular procedures, Medical errors, DELPHI TECHNIQUE, ADVERSE EVENTS, RATING TOOL, SURGERY, EDUCATION, OUTCOMES, SYSTEM, ROOM
Downloads
-
(...).pdf
- full text (Published version)
- |
- UGent only
- |
- |
- 437.35 KB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01J8SVCHH5P4HW5Y61HAJP4MHW
- MLA
- Soenens, Gilles, et al. “Development and Testing of Step, Error, and Event Frameworks to Evaluate Technical Performance in Peripheral Endovascular Interventions.” EUROPEAN JOURNAL OF VASCULAR AND ENDOVASCULAR SURGERY, vol. 68, no. 2, 2024, pp. 227–35, doi:10.1016/j.ejvs.2024.03.007.
- APA
- Soenens, G., Gorden, L., Doyen, B., Wheatcroft, M., de Mestral, C., Palter, V., … NDORATE-PVI consortium, [missing]. (2024). Development and testing of step, error, and event frameworks to evaluate technical performance in peripheral endovascular interventions. EUROPEAN JOURNAL OF VASCULAR AND ENDOVASCULAR SURGERY, 68(2), 227–235. https://doi.org/10.1016/j.ejvs.2024.03.007
- Chicago author-date
- Soenens, Gilles, Lauren Gorden, Bart Doyen, Mark Wheatcroft, Charles de Mestral, Vanessa Palter, Isabelle Van Herzeele, et al. 2024. “Development and Testing of Step, Error, and Event Frameworks to Evaluate Technical Performance in Peripheral Endovascular Interventions.” EUROPEAN JOURNAL OF VASCULAR AND ENDOVASCULAR SURGERY 68 (2): 227–35. https://doi.org/10.1016/j.ejvs.2024.03.007.
- Chicago author-date (all authors)
- Soenens, Gilles, Lauren Gorden, Bart Doyen, Mark Wheatcroft, Charles de Mestral, Vanessa Palter, Isabelle Van Herzeele, Frederico Bastos Goncalves, Iris Baumgartner, Tiago Bilhim, Theodosios Bisdas, Jean Bismuth, Marianne Brodmann, Fausto Castriota, Enrico Cieri, Koen Deloose, Nuno Dias, Nicolas Diehm, Roberto Ferraresi, Ziv J. Haskal, Robert Hinchliffe, Ahmed Kayssi, Jose Ignacio Leal Lorenzo, Robert Lookstein, Robert Morgan, Stefan Müller-Hülsbeck, Jihad Mustapha, Christoph Anton Nienaber, Guiseppe Papia, Ashish Patel, Anand Prasad, Konstatinos Stavroulakis, Michel Reijnen, John Rundback, Jos C. van den Berg, and [missing] NDORATE-PVI consortium. 2024. “Development and Testing of Step, Error, and Event Frameworks to Evaluate Technical Performance in Peripheral Endovascular Interventions.” EUROPEAN JOURNAL OF VASCULAR AND ENDOVASCULAR SURGERY 68 (2): 227–235. doi:10.1016/j.ejvs.2024.03.007.
- Vancouver
- 1.Soenens G, Gorden L, Doyen B, Wheatcroft M, de Mestral C, Palter V, et al. Development and testing of step, error, and event frameworks to evaluate technical performance in peripheral endovascular interventions. EUROPEAN JOURNAL OF VASCULAR AND ENDOVASCULAR SURGERY. 2024;68(2):227–35.
- IEEE
- [1]G. Soenens et al., “Development and testing of step, error, and event frameworks to evaluate technical performance in peripheral endovascular interventions,” EUROPEAN JOURNAL OF VASCULAR AND ENDOVASCULAR SURGERY, vol. 68, no. 2, pp. 227–235, 2024.
@article{01J8SVCHH5P4HW5Y61HAJP4MHW, abstract = {{Objective: Tools for endovascular performance assessment are necessary in competency based education. This study aimed to develop and test a detailed analysis tool to assess steps, errors, and events in peripheral endovascular interventions (PVI). Methods: A modified Delphi consensus was used to identify steps, errors, and events in iliac-femoral-popliteal endovascular interventions. International experts in vascular surgery, interventional radiology, cardiology, and angiology were identified, based on their scientific track record. In an initial open ended survey round, experts volunteered a comprehensive list of steps, errors, and events. The items were then rated on a five point Likert scale until consensus was reached with a pre-defined threshold (Cronbach's alpha > 0.7) and > 70% expert agreement. An experienced endovascular surgeon applied the finalised frameworks on 10 previously videorecorded elective PVI cases. Results: The expert consensus panel was formed by 28 of 98 invited proceduralists, consisting of three angiologists, seven interventional radiologists, five cardiologists, and 13 vascular surgeons, with 29% from North America and 71% from Europe. The Delphi process was completed after three rounds (Cronbach's alpha; alpha(steps) = 0.79; alpha(errors) = 0.90; alpha(events) = 0.90), with 15, 26, and 18 items included in the final step (73 - 100% agreement), error (73 - 100% agreement), and event (73 - 100% agreement) frameworks, respectively. The median rating time per case was 4.3 hours (interquartile range [IQR] 3.2, 5 hours). A median of 55 steps (IQR 40, 67), 27 errors (IQR 21, 49), and two events (IQR 1, 6) were identified per case. Conclusion: An evaluation tool for the procedural steps, errors, and events in iliac-femoral-popliteal endovascular procedures was developed through a modified Delphi consensus and applied to recorded intra-operative data to identify hazardous steps, common errors, and events. Procedural mastery may be promoted by using the frameworks to provide endovascular proceduralists with detailed technical performance feedback.}}, author = {{Soenens, Gilles and Gorden, Lauren and Doyen, Bart and Wheatcroft, Mark and de Mestral, Charles and Palter, Vanessa and Van Herzeele, Isabelle and Goncalves, Frederico Bastos and Baumgartner, Iris and Bilhim, Tiago and Bisdas, Theodosios and Bismuth, Jean and Brodmann, Marianne and Castriota, Fausto and Cieri, Enrico and Deloose, Koen and Dias, Nuno and Diehm, Nicolas and Ferraresi, Roberto and Haskal, Ziv J. and Hinchliffe, Robert and Kayssi, Ahmed and Leal Lorenzo, Jose Ignacio and Lookstein, Robert and Morgan, Robert and Müller-Hülsbeck, Stefan and Mustapha, Jihad and Nienaber, Christoph Anton and Papia, Guiseppe and Patel, Ashish and Prasad, Anand and Stavroulakis, Konstatinos and Reijnen, Michel and Rundback, John and van den Berg, Jos C. and NDORATE-PVI consortium, [missing]}}, issn = {{1078-5884}}, journal = {{EUROPEAN JOURNAL OF VASCULAR AND ENDOVASCULAR SURGERY}}, keywords = {{Angioplasty balloon,Delphi technique,Endovascular procedures,Medical errors,DELPHI TECHNIQUE,ADVERSE EVENTS,RATING TOOL,SURGERY,EDUCATION,OUTCOMES,SYSTEM,ROOM}}, language = {{eng}}, number = {{2}}, pages = {{227--235}}, title = {{Development and testing of step, error, and event frameworks to evaluate technical performance in peripheral endovascular interventions}}, url = {{http://doi.org/10.1016/j.ejvs.2024.03.007}}, volume = {{68}}, year = {{2024}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: