دورية أكاديمية
Evaluating the Accuracy of ChatGPT in Common Patient Questions Regarding HPV+ Oropharyngeal Carcinoma.
| العنوان: | Evaluating the Accuracy of ChatGPT in Common Patient Questions Regarding HPV+ Oropharyngeal Carcinoma. |
|---|---|
| المؤلفون: | Bellamkonda N; Department of Otolaryngology-Head and Neck Surgery, University of Utah, Salt Lake City, UT, USA., Farlow JL; Department of Otolaryngology-Head and Neck Surgery, Indiana University, Indianapolis, IN, USA., Haring CT; Department of Otolaryngology-Head and Neck Surgery, The Ohio State University Wexner Medical Center, Columbus, OH, USA., Sim MW; Department of Otolaryngology-Head and Neck Surgery, Indiana University, Indianapolis, IN, USA., Seim NB; Department of Otolaryngology-Head and Neck Surgery, The Ohio State University Wexner Medical Center, Columbus, OH, USA., Cannon RB; Department of Otolaryngology-Head and Neck Surgery, University of Utah, Salt Lake City, UT, USA., Monroe MM; Department of Otolaryngology-Head and Neck Surgery, University of Utah, Salt Lake City, UT, USA., Agrawal A; Department of Otolaryngology-Head and Neck Surgery, The Ohio State University Wexner Medical Center, Columbus, OH, USA., Rocco JW; Department of Otolaryngology-Head and Neck Surgery, The Ohio State University Wexner Medical Center, Columbus, OH, USA., McCrary HC; Department of Otolaryngology-Head and Neck Surgery, University of Utah, Salt Lake City, UT, USA. |
| المصدر: | The Annals of otology, rhinology, and laryngology [Ann Otol Rhinol Laryngol] 2024 Sep; Vol. 133 (9), pp. 814-819. Date of Electronic Publication: 2024 Jul 29. |
| نوع المنشور: | Journal Article; Multicenter Study |
| اللغة: | English |
| بيانات الدورية: | Publisher: Sage Country of Publication: United States NLM ID: 0407300 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1943-572X (Electronic) Linking ISSN: 00034894 NLM ISO Abbreviation: Ann Otol Rhinol Laryngol Subsets: MEDLINE |
| أسماء مطبوعة: | Publication: 2014- : Los Angeles : Sage Original Publication: St. Louis : Annals Publishing Co |
| مواضيع طبية MeSH: | Oropharyngeal Neoplasms*/virology , Oropharyngeal Neoplasms*/surgery , Papillomavirus Infections*/diagnosis , Papillomavirus Infections*/virology , Papillomavirus Infections*/complications, Humans ; Prospective Studies ; Surveys and Questionnaires ; United States |
| مستخلص: | Objectives: Large language model (LLM)-based chatbots such as ChatGPT have been publicly available and increasingly utilized by the general public since late 2022. This study sought to investigate ChatGPT responses to common patient questions regarding Human Papilloma Virus (HPV) positive oropharyngeal cancer (OPC). Methods: This was a prospective, multi-institutional study, with data collected from high volume institutions that perform >50 transoral robotic surgery cases per year. The 100 most recent discussion threads including the term "HPV" on the American Cancer Society's Cancer Survivors Network's Head and Neck Cancer public discussion board were reviewed. The 11 most common questions were serially queried to ChatGPT 3.5; answers were recorded. A survey was distributed to fellowship trained head and neck oncologic surgeons at 3 institutions to evaluate the responses. Results: A total of 8 surgeons participated in the study. For questions regarding HPV contraction and transmission, ChatGPT answers were scored as clinically accurate and aligned with consensus in the head and neck surgical oncology community 84.4% and 90.6% of the time, respectively. For questions involving treatment of HPV+ OPC, ChatGPT was clinically accurate and aligned with consensus 87.5% and 91.7% of the time, respectively. For questions regarding the HPV vaccine, ChatGPT was clinically accurate and aligned with consensus 62.5% and 75% of the time, respectively. When asked about circulating tumor DNA testing, only 12.5% of surgeons thought responses were accurate or consistent with consensus. Conclusion: ChatGPT 3.5 performed poorly with questions involving evolving therapies and diagnostics-thus, caution should be used when using a platform like ChatGPT 3.5 to assess use of advanced technology. Patients should be counseled on the importance of consulting their surgeons to receive accurate and up to date recommendations, and use LLM's to augment their understanding of these important health-related topics. Competing Interests: Declaration of Conflicting InterestsThe author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article. |
| فهرسة مساهمة: | Keywords: ChatGPT; HPV; artificial intelligence; large-language-models; oropharyngeal cancer |
| تواريخ الأحداث: | Date Created: 20240730 Date Completed: 20240814 Latest Revision: 20240814 |
| رمز التحديث: | 20240814 |
| DOI: | 10.1177/00034894241259137 |
| PMID: | 39075853 |
| قاعدة البيانات: | MEDLINE |
Full Text Finder | تدمد: | 1943-572X |
|---|---|
| DOI: | 10.1177/00034894241259137 |