دورية أكاديمية

Diagnostic and Management Applications of ChatGPT in Structured Otolaryngology Clinical Scenarios.

التفاصيل البيبلوغرافية
العنوان: Diagnostic and Management Applications of ChatGPT in Structured Otolaryngology Clinical Scenarios.
المؤلفون: Qu RW; Department of Otolaryngology-Head and Neck Surgery Loma Linda University Medical Center Loma Linda California USA., Qureshi U; Department of Otolaryngology-Head and Neck Surgery Loma Linda University Medical Center Loma Linda California USA., Petersen G; Department of Otolaryngology-Head and Neck Surgery Loma Linda School of Medicine, Loma Linda University Medical Center Loma Linda California USA., Lee SC; Department of Otolaryngology-Head and Neck Surgery Loma Linda University Medical Center Loma Linda California USA.
المصدر: OTO open [OTO Open] 2023 Aug 22; Vol. 7 (3), pp. e67. Date of Electronic Publication: 2023 Aug 22 (Print Publication: 2023).
نوع المنشور: Journal Article
اللغة: English
بيانات الدورية: Publisher: Wiley Periodicals LLC on behalf of American Academy of Otolaryngology–Head and Neck Surgery Foundation Country of Publication: United States NLM ID: 101717942 Publication Model: eCollection Cited Medium: Internet ISSN: 2473-974X (Electronic) Linking ISSN: 2473974X NLM ISO Abbreviation: OTO Open Subsets: PubMed not MEDLINE
أسماء مطبوعة: Publication: 2023- : [Hoboken, NJ] : Wiley Periodicals LLC on behalf of American Academy of Otolaryngology–Head and Neck Surgery Foundation
Original Publication: [Thousand Oaks, CA] : Sage Publications, [2017]-
مستخلص: Objective: To evaluate the clinical applications and limitations of chat generative pretrained transformer (ChatGPT) in otolaryngology.
Study Design: Cross-sectional survey.
Setting: Tertiary academic center.
Methods: ChatGPT 4.0 was queried for diagnoses and management plans for 20 physician-written clinical vignettes in otolaryngology. Attending physicians were then asked to rate the difficulty of the clinical vignettes and agreement with the differential diagnoses and management plans of ChatGPT responses on a 5-point Likert scale. Summary statistics were calculated. Univariate ordinal regression was then performed between vignette difficulty and quality of the diagnoses and management plans.
Results: Eleven attending physicians completed the survey (61% response rate). Overall, vignettes were rated as very easy to neutral difficulty (range of median score: 1.00-4.00; overall median 2.00). There was a high agreement with the differential diagnosis provided by ChatGPT (range of median score: 3.00-5.00; overall median: 5.00). There was also high agreement with treatment plans (range of median score: 3.00-5.00; overall median: 5.00). There was no association between vignette difficulty and agreement with differential diagnosis or treatment. Lower diagnosis scores had greater odds of having lower treatment scores.
Conclusion: Generative artificial intelligence models like ChatGPT are being rapidly adopted in medicine. Performance with curated, easy-to-moderate difficulty otolaryngology scenarios indicate high agreement with physicians for diagnosis and management. However, a decreased quality in diagnosis is associated with decreased quality in management. Further research is necessary on ChatGPT's ability to handle unstructured clinical information.
Competing Interests: The authors have no conflicts of interest to declare.
(© 2023 The Authors. OTO Open published by Wiley Periodicals LLC on behalf of American Academy of Otolaryngology–Head and Neck Surgery Foundation.)
References: Lancet Digit Health. 2023 Jun;5(6):e333-e335. (PMID: 37120418)
J Stomatol Oral Maxillofac Surg. 2023 Apr 13;:101471. (PMID: 37061037)
BMC Med Inform Decis Mak. 2020 Nov 30;20(1):310. (PMID: 33256715)
Radiology. 2023 Apr;307(2):e223312. (PMID: 36728748)
Int J Environ Res Public Health. 2023 Feb 15;20(4):. (PMID: 36834073)
Aesthet Surg J. 2023 May 02;:. (PMID: 37128784)
JAMA Otolaryngol Head Neck Surg. 2023 Jun 1;149(6):556-558. (PMID: 37103921)
Cureus. 2023 Feb 19;15(2):e35179. (PMID: 36811129)
JNCI Cancer Spectr. 2023 Mar 1;7(2):. (PMID: 36808255)
J Med Internet Res. 2023 Aug 22;25:e48659. (PMID: 37606976)
JMIR Med Educ. 2023 Feb 8;9:e45312. (PMID: 36753318)
Int J Med Sci. 2021 Jun 1;18(13):2871-2889. (PMID: 34220314)
J Neurosurg. 2023 Mar 24;:1-8. (PMID: 36964734)
Aesthet Surg J. 2023 May 04;:. (PMID: 37140001)
Gastroenterology. 2023 Aug;165(2):509-511.e7. (PMID: 37150470)
فهرسة مساهمة: Keywords: ChatGPT; artificial intelligence; large language model; otolaryngology
تواريخ الأحداث: Date Created: 20230824 Latest Revision: 20230825
رمز التحديث: 20240628
مُعرف محوري في PubMed: PMC10442607
DOI: 10.1002/oto2.67
PMID: 37614494
قاعدة البيانات: MEDLINE
الوصف
تدمد:2473-974X
DOI:10.1002/oto2.67