دورية أكاديمية

Summative Evaluation of Vaginal Surgery Skills: Setting A Pass-Fail Score.

التفاصيل البيبلوغرافية
العنوان: Summative Evaluation of Vaginal Surgery Skills: Setting A Pass-Fail Score.
المؤلفون: Geoffrion R; University of British Columbia, Vancouver, BC, Canada. roxygeo@hotmail.com.; Department of Obstetrics and Gynecology, St. Paul's Hospital, Suite 930, 1125 Howe Street, Vancouver, BC, V6Z 2K8, Canada. roxygeo@hotmail.com., Koenig NA; University of British Columbia, Vancouver, BC, Canada., Sunderji Z; University of British Columbia, Vancouver, BC, Canada., Lee T; Centre for Health Evaluation & Outcome Sciences, Vancouver, BC, Canada.
المصدر: International urogynecology journal [Int Urogynecol J] 2024 Feb; Vol. 35 (2), pp. 451-456. Date of Electronic Publication: 2024 Jan 11.
نوع المنشور: Randomized Controlled Trial; Journal Article
اللغة: English
بيانات الدورية: Publisher: Springer Country of Publication: England NLM ID: 101567041 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1433-3023 (Electronic) Linking ISSN: 09373462 NLM ISO Abbreviation: Int Urogynecol J Subsets: MEDLINE
أسماء مطبوعة: Original Publication: London : Springer
مواضيع طبية MeSH: Colpotomy* , Surgeons*, Female ; Humans ; Pregnancy ; Canada ; Computer Simulation ; Hysterectomy, Vaginal
مستخلص: Introduction and Hypothesis: We developed a summative assessment tool to evaluate competent performance on three procedure-specific low fidelity simulation models for vaginal surgery. Our purpose was to determine a pass-fail score for each model.
Methods: We enrolled participants (2011-2023, three Canadian academic centers) and grouped them according to operative competency in vaginal procedures. Novice operators were medical students recruited through targeted advertisement to clerkship level medical students. Proficient operators consisted of gynecology residents from the intervention arm of a randomized controlled trial, trained to competence in the use of the models; urogynecology fellows and attending gynecologic surgeons recruited through departmental rounds. All participants were asked to perform the three procedures on the models, were videotaped, and their performance assessed by evaluators familiar with the procedure and the scoring system, blinded to operator identity. A total performance score (range 0-400) assessed timing and errors. Basic skill deductions were set a priori. We calculated sensitivity and specificity scores and obtained an optimal cutoff based on Youden's J statistic.
Results: For anterior repair, we rated 46 novice and 16 proficient videos. The pass-fail score was 170/400. For posterior repair, we rated 54 novice and 14 proficient videos. The pass-fail score was 140/400. For vaginal hysterectomy, we rated 47 novice and 12 proficient videos. The pass-fail score was 180/400. Scores of proficient operators were significantly better than those of novice participants (p < 0.001 for all).
Conclusions: A pass-fail score can distinguish between novice and proficient operators and can be used for summative assessment of surgical skill.
(© 2024. The International Urogynecological Association.)
References: Walters MD, Ridgeway BM. Increasing Utilization of Minimally Invasive Hysterectomy. Clin Obstet Gynecol. 2017;60(2):273–85. https://doi.org/10.1097/GRF.0000000000000283 . (PMID: 10.1097/GRF.000000000000028328263200)
Washburn EE, Cohen SL, Manoucheri E, Zurawin RK, Einarsson JI. Trends in reported resident surgical experience in hysterectomy. J Minimally Invasive Gynecol. 2014;21(6):1067–70. https://doi.org/10.1016/j.jmig.2014.05.005 . (PMID: 10.1016/j.jmig.2014.05.005)
Geoffrion R. Standing on the shoulders of giants: contemplating a standard national curriculum for surgical training in gynaecology. J Obstet Gynaecol Canada: JOGC = Journal d’obstetrique et gynecologie du Canada: JOGC. 2008;30(8):684–95. https://doi.org/10.1016/S1701-2163(16)32917-6 . (PMID: 10.1016/S1701-2163(16)32917-6)
Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Fayez R, Fried GM. Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room-a randomized controlled trial. Am J Surg. 2010;199(1):115–20. https://doi.org/10.1016/j.amjsurg.2009.07.035 . (PMID: 10.1016/j.amjsurg.2009.07.03520103076)
Fraser SA, Klassen DR, Feldman LS, Ghitulescu GA, Stanbridge D, Fried GM. Evaluating laparoscopic skills: setting the pass/fail score for the MISTELS system. Surg Endoscopy. 2003;17(6):964–7. https://doi.org/10.1007/s00464-002-8828-4 . (PMID: 10.1007/s00464-002-8828-4)
Geoffrion R, Suen MW, Koenig NA, Yong P, Brennand E, Mehra N, Larouche M, Lee T, Todd NJ. Teaching vaginal surgery to junior residents: initial validation of 3 novel procedure-specific low-fidelity models. J Surg Educ. 2016;73(1):157–61. https://doi.org/10.1016/j.jsurg.2015.09.004 . (PMID: 10.1016/j.jsurg.2015.09.00426706397)
Geoffrion R, Koenig NA, Sanaee MS, Lee T, Todd NJ. Optimizing resident operative self-confidence through competency-based surgical education modules: are we there yet? Int Urogynecol J. 2019;30(3):423–8. https://doi.org/10.1007/s00192-018-3654-y . (PMID: 10.1007/s00192-018-3654-y29644383)
Guntupalli SR, Doo DW, Guy M, Sheeder J, Omurtag K, Kondapalli L, Valea F, Harper L, Muffly TM. Preparedness of obstetrics and gynecology residents for fellowship training. Obstet Gynecol. 2015;126(3):559–68. https://doi.org/10.1097/AOG.0000000000000999 . (PMID: 10.1097/AOG.000000000000099926244537)
Caccia N, Nakajima A, Scheele F, Kent N. Competency-based medical education: developing a framework for obstetrics and gynaecology. J Obstet Gynaecol Canada: Journal d’obstetrique et gynecologie du Canada. 2015;37(12):1104–12. https://doi.org/10.1016/s1701-2163(16)30076-7 . (PMID: 10.1016/s1701-2163(16)30076-7)
https://www.acgme.org/globalassets/pfassets/programresources/obgyncaseloginfo.pdf . Accessed 26 July 2023.
Dreyfus S. The five-stage model of adult skill acquisition. Bull Sci Technol Soc. 2004;24:177–81. (PMID: 10.1177/0270467604264992)
Wohlrab K, Jelovsek JE, Myers D. Incorporating simulation into gynecologic surgical training. Am J Obstet Gynecol. 2017;217(5):522–6. https://doi.org/10.1016/j.ajog.2017.05.017 . (PMID: 10.1016/j.ajog.2017.05.01728511894)
Blades ML, Glaze S, McQuillan SK. Resident Perspectives on Competency-By-Design Curriculum. J Obstet Gynaecol Canada: Journal d’obstetrique et gynecologie du Canada. 2020;42(3):242–7. https://doi.org/10.1016/j.jogc.2019.07.005 . (PMID: 10.1016/j.jogc.2019.07.005)
فهرسة مساهمة: Keywords: Low fidelity simulation; Pass–fail score; Summative assessment; Vaginal surgery
تواريخ الأحداث: Date Created: 20240111 Date Completed: 20240304 Latest Revision: 20240304
رمز التحديث: 20240304
DOI: 10.1007/s00192-023-05717-9
PMID: 38206339
قاعدة البيانات: MEDLINE
الوصف
تدمد:1433-3023
DOI:10.1007/s00192-023-05717-9