دورية أكاديمية
Nonradiology Health Care Professionals Significantly Benefit From AI Assistance in Emergency-Related Chest Radiography Interpretation.
| العنوان: | Nonradiology Health Care Professionals Significantly Benefit From AI Assistance in Emergency-Related Chest Radiography Interpretation. |
|---|---|
| المؤلفون: | Rudolph J; Department of Radiology, University Hospital, LMU Munich, Munich, Germany. Electronic address: jan.rudolph@med.uni-muenchen.de., Huemmer C; XP Technology and Innovation, Siemens Healthcare GmbH, Forchheim, Germany., Preuhs A; XP Technology and Innovation, Siemens Healthcare GmbH, Forchheim, Germany., Buizza G; XP Technology and Innovation, Siemens Healthcare GmbH, Forchheim, Germany., Hoppe BF; Department of Radiology, University Hospital, LMU Munich, Munich, Germany., Dinkel J; Department of Radiology, University Hospital, LMU Munich, Munich, Germany; Comprehensive Pneumology Center, German Center for Lung Research, Munich, Germany; Department of Radiology, Asklepios Fachklinik München, Gauting, Germany., Koliogiannis V; Department of Radiology, University Hospital, LMU Munich, Munich, Germany., Fink N; Department of Radiology, University Hospital, LMU Munich, Munich, Germany., Goller SS; Department of Radiology, University Hospital, LMU Munich, Munich, Germany., Schwarze V; Department of Radiology, University Hospital, LMU Munich, Munich, Germany., Mansour N; Department of Radiology, University Hospital, LMU Munich, Munich, Germany., Schmidt VF; Department of Radiology, University Hospital, LMU Munich, Munich, Germany., Fischer M; Department of Medicine I, University Hospital, LMU Munich, Munich, Germany., Jörgens M; Department of Orthopaedics and Trauma Surgery, Musculoskeletal University Center Munich (MUM), University Hospital, LMU Munich, Munich, Germany., Ben Khaled N; Department of Medicine II, University Hospital, LMU Munich, Munich, Germany., Liebig T; Institute of Neuroradiology, University Hospital, LMU Munich, Munich, Germany., Ricke J; Department of Radiology, University Hospital, LMU Munich, Munich, Germany., Rueckel J; Department of Radiology, University Hospital, LMU Munich, Munich, Germany; Institute of Neuroradiology, University Hospital, LMU Munich, Munich, Germany., Sabel BO; Department of Radiology, University Hospital, LMU Munich, Munich, Germany. |
| المصدر: | Chest [Chest] 2024 Jul; Vol. 166 (1), pp. 157-170. Date of Electronic Publication: 2024 Jan 29. |
| نوع المنشور: | Journal Article |
| اللغة: | English |
| بيانات الدورية: | Publisher: Elsevier Country of Publication: United States NLM ID: 0231335 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1931-3543 (Electronic) Linking ISSN: 00123692 NLM ISO Abbreviation: Chest Subsets: MEDLINE |
| أسماء مطبوعة: | Publication: 2016- : New York : Elsevier Original Publication: Chicago : American College of Chest Physicians |
| مواضيع طبية MeSH: | Radiography, Thoracic*/methods , Artificial Intelligence* , Emergency Service, Hospital*, Humans ; Retrospective Studies ; Male ; Female ; Clinical Competence ; Middle Aged ; ROC Curve ; Adult ; Aged |
| مستخلص: | Background: Chest radiographs (CXRs) are still of crucial importance in primary diagnostics, but their interpretation poses difficulties at times. Research Question: Can a convolutional neural network-based artificial intelligence (AI) system that interprets CXRs add value in an emergency unit setting? Study Design and Methods: A total of 563 CXRs acquired in the emergency unit of a major university hospital were retrospectively assessed twice by three board-certified radiologists, three radiology residents, and three emergency unit-experienced nonradiology residents (NRRs). They used a two-step reading process: (1) without AI support; and (2) with AI support providing additional images with AI overlays. Suspicion of four suspected pathologies (pleural effusion, pneumothorax, consolidations suspicious for pneumonia, and nodules) was reported on a five-point confidence scale. Confidence scores of the board-certified radiologists were converted into four binary reference standards of different sensitivities. Performance by radiology residents and NRRs without AI support/with AI support were statistically compared by using receiver-operating characteristics (ROCs), Youden statistics, and operating point metrics derived from fitted ROC curves. Results: NRRs could significantly improve performance, sensitivity, and accuracy with AI support in all four pathologies tested. In the most sensitive reference standard (reference standard IV), NRR consensus improved the area under the ROC curve (mean, 95% CI) in the detection of the time-critical pathology pneumothorax from 0.846 (0.785-0.907) without AI support to 0.974 (0.947-1.000) with AI support (P < .001), which represented a gain of 30% in sensitivity and 2% in accuracy (while maintaining an optimized specificity). The most pronounced effect was observed in nodule detection, with NRR with AI support improving sensitivity by 53% and accuracy by 7% (area under the ROC curve without AI support, 0.723 [0.661-0.785]; with AI support, 0.890 [0.848-0.931]; P < .001). Radiology residents had smaller, mostly nonsignificant gains in performance, sensitivity, and accuracy with AI support. Interpretation: We found that in an emergency unit setting without 24/7 radiology coverage, the presented AI solution features an excellent clinical support tool to nonradiologists, similar to a second reader, and allows for a more accurate primary diagnosis and thus earlier therapy initiation. Competing Interests: Financial/Nonfinancial Disclosures The authors have reported to CHEST the following: B. O. S. and J. Rueckel received financial compensation for speaker's activities by Siemens Healthineers (lectures at conferences). C. H., A. P., and G. B. received financial compensation by Siemens Healthineers (employees). None declared (J. Rudolph, B. F. H., J. D., V. K., N. F., S. S. G., V. S., N. M., V. F. S., M. F., M. J., N. B. K., T. L., J. Ricke). (Copyright © 2024 The Author(s). Published by Elsevier Inc. All rights reserved.) |
| References: | JAMA. 2016 Dec 13;316(22):2402-2410. (PMID: 27898976) Sci Rep. 2022 Jul 27;12(1):12764. (PMID: 35896763) Nature. 2017 Feb 2;542(7639):115-118. (PMID: 28117445) Ann Am Thorac Soc. 2014 Mar;11(3):404-6. (PMID: 24673696) Br J Gen Pract. 2006 Aug;56(529):574-8. (PMID: 16882374) Nature. 2020 Jan;577(7788):89-94. (PMID: 31894144) Radiology. 1995 Apr;195(1):245-6. (PMID: 7892479) Respir Care. 2012 Mar;57(3):427-43. (PMID: 22391269) Diagnostics (Basel). 2021 Oct 11;11(10):. (PMID: 34679566) Quant Imaging Med Surg. 2021 Jun;11(6):2486-2498. (PMID: 34079718) Radiology. 2019 Nov;293(2):436-440. (PMID: 31573399) Eur Radiol. 2021 Oct;31(10):7888-7900. (PMID: 33774722) Acad Radiol. 2021 Jan;28(1):85-93. (PMID: 32102747) Cancer. 1950 Jan;3(1):32-5. (PMID: 15405679) Radiology. 2017 Aug;284(2):574-582. (PMID: 28436741) Eur J Radiol. 2020 Feb;123:108774. (PMID: 31841881) Invest Radiol. 2020 Dec;55(12):792-798. (PMID: 32694453) Emerg Radiol. 2020 Aug;27(4):361-366. (PMID: 32643069) Eur J Radiol. 2020 Jan;122:108768. (PMID: 31786504) Eur J Radiol. 2021 Jan;134:109424. (PMID: 33259990) BMC Bioinformatics. 2011 Mar 17;12:77. (PMID: 21414208) Chest. 2012 Feb;141(2):545-558. (PMID: 22315122) Acta Paediatr. 2013 Jul;102(7):e310-4. (PMID: 23565882) PLoS Med. 2018 Nov 20;15(11):e1002686. (PMID: 30457988) Acad Emerg Med. 2016 Mar;23(3):223-42. (PMID: 26910112) Eur J Radiol. 2012 Dec;81(12):3669-74. (PMID: 21466934) Invest Radiol. 2019 Oct;54(10):627-632. (PMID: 31483764) Invest Radiol. 2024 Apr 1;59(4):306-313. (PMID: 37682731) Invest Radiol. 2021 Jun 1;56(6):348-356. (PMID: 33259441) Invest Radiol. 2022 Feb 1;57(2):90-98. (PMID: 34352804) Radiology. 2000 Nov;217(2):456-9. (PMID: 11058645) Crit Care Med. 2017 Apr;45(4):715-724. (PMID: 27922877) Biometrics. 1988 Sep;44(3):837-45. (PMID: 3203132) Crit Care Med. 2020 Jul;48(7):e574-e583. (PMID: 32433121) JAAPA. 2019 Oct;32(10):18-23. (PMID: 31513034) Invest Radiol. 2024 May 1;59(5):404-412. (PMID: 37843828) |
| فهرسة مساهمة: | Keywords: AI assistance; artificial intelligence; chest radiography; emergency unit |
| تواريخ الأحداث: | Date Created: 20240131 Date Completed: 20240710 Latest Revision: 20240718 |
| رمز التحديث: | 20240718 |
| مُعرف محوري في PubMed: | PMC11251081 |
| DOI: | 10.1016/j.chest.2024.01.039 |
| PMID: | 38295950 |
| قاعدة البيانات: | MEDLINE |
| تدمد: | 1931-3543 |
|---|---|
| DOI: | 10.1016/j.chest.2024.01.039 |