دورية أكاديمية

AI-powered real-time annotations during urologic surgery: The future of training and quality metrics.

التفاصيل البيبلوغرافية
العنوان: AI-powered real-time annotations during urologic surgery: The future of training and quality metrics.
المؤلفون: Zuluaga L; Department of Urology, Icahn School of Medicine at Mount Sinai, New York City, NY. Electronic address: laura.zuluaga@mountsinai.org., Rich JM; Department of Urology, Icahn School of Medicine at Mount Sinai, New York City, NY., Gupta R; Department of Urology, Icahn School of Medicine at Mount Sinai, New York City, NY., Pedraza A; Department of Urology, Icahn School of Medicine at Mount Sinai, New York City, NY., Ucpinar B; Department of Urology, Icahn School of Medicine at Mount Sinai, New York City, NY., Okhawere KE; Department of Urology, Icahn School of Medicine at Mount Sinai, New York City, NY., Saini I; Department of Urology, Icahn School of Medicine at Mount Sinai, New York City, NY., Dwivedi P; Department of Urology, Icahn School of Medicine at Mount Sinai, New York City, NY., Patel D; Department of Urology, Icahn School of Medicine at Mount Sinai, New York City, NY., Zaytoun O; Department of Urology, Icahn School of Medicine at Mount Sinai, New York City, NY., Menon M; Department of Urology, Icahn School of Medicine at Mount Sinai, New York City, NY., Tewari A; Department of Urology, Icahn School of Medicine at Mount Sinai, New York City, NY., Badani KK; Department of Urology, Icahn School of Medicine at Mount Sinai, New York City, NY.
المصدر: Urologic oncology [Urol Oncol] 2024 Mar; Vol. 42 (3), pp. 57-66. Date of Electronic Publication: 2023 Dec 22.
نوع المنشور: Journal Article; Review
اللغة: English
بيانات الدورية: Publisher: Elsevier Country of Publication: United States NLM ID: 9805460 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1873-2496 (Electronic) Linking ISSN: 10781439 NLM ISO Abbreviation: Urol Oncol Subsets: MEDLINE
أسماء مطبوعة: Publication: 2003- : Philadelphia, PA : Elsevier
Original Publication: New York, NY : Elsevier Science,
مواضيع طبية MeSH: Robotic Surgical Procedures*/methods , Robotics*, Male ; Humans ; Artificial Intelligence ; Urologic Surgical Procedures ; Prostatectomy/methods
مستخلص: Introduction and Objective: Real-time artificial intelligence (AI) annotation of the surgical field has the potential to automatically extract information from surgical videos, helping to create a robust surgical atlas. This content can be used for surgical education and qualitative initiatives. We demonstrate the first use of AI in urologic robotic surgery to capture live surgical video and annotate key surgical steps and safety milestones in real-time.
Summary Background Data: While AI models possess the capability to generate automated annotations based on a collection of video images, the real-time implementation of such technology in urological robotic surgery to aid surgeon and training staff it is still pending to be studied.
Methods: We conducted an educational symposium, which broadcasted 2 live procedures, a robotic-assisted radical prostatectomy (RARP) and a robotic-assisted partial nephrectomy (RAPN). A surgical AI platform system (Theator, Palo Alto, CA) generated real-time annotations and identified operative safety milestones. This was achieved through trained algorithms, conventional video recognition, and novel Video Transfer Network technology which captures clips in full context, enabling automatic recognition and surgical mapping in real-time.
Results: Real-time AI annotations for procedure #1, RARP, are found in Table 1. The safety milestone annotations included the apical safety maneuver and deliberate views of structures such as the external iliac vessels and the obturator nerve. Real-time AI annotations for procedure #2, RAPN, are found in Table 1. Safety milestones included deliberate views of structures such as the gonadal vessels and the ureter. AI annotated surgical events included intraoperative ultrasound, temporary clip application and removal, hemostatic powder application, and notable hemorrhage.
Conclusions: For the first time, surgical intelligence successfully showcased real-time AI annotations of 2 separate urologic robotic procedures during a live telecast. These annotations may provide the technological framework for send automatic notifications to clinical or operational stakeholders. This technology is a first step in real-time intraoperative decision support, leveraging big data to improve the quality of surgical care, potentially improve surgical outcomes, and support training and education.
Competing Interests: Declaration of Competing Interest The authors report no conflicts of interest.
(Copyright © 2023 Elsevier Inc. All rights reserved.)
فهرسة مساهمة: Keywords: Artificial intelligence; Robotics; Surgical steps
تواريخ الأحداث: Date Created: 20231223 Date Completed: 20240311 Latest Revision: 20240411
رمز التحديث: 20240411
DOI: 10.1016/j.urolonc.2023.11.002
PMID: 38142209
قاعدة البيانات: MEDLINE