دورية أكاديمية

ChatGPT-4 Generates More Accurate and Complete Responses to Common Patient Questions About Anterior Cruciate Ligament Reconstruction Than Google's Search Engine.

التفاصيل البيبلوغرافية
العنوان: ChatGPT-4 Generates More Accurate and Complete Responses to Common Patient Questions About Anterior Cruciate Ligament Reconstruction Than Google's Search Engine.
المؤلفون: Gaudiani MA; Department of Orthopedic Surgery, Henry Ford Health, Detroit, Michigan, U.S.A., Castle JP; Department of Orthopedic Surgery, Henry Ford Health, Detroit, Michigan, U.S.A., Abbas MJ; Department of Orthopedic Surgery, Henry Ford Health, Detroit, Michigan, U.S.A., Pratt BA; Department of Orthopedic Surgery, Henry Ford Health, Detroit, Michigan, U.S.A., Myles MD; Michigan State University College of Human Medicine, Detroit, Michigan, U.S.A., Moutzouros V; Department of Orthopedic Surgery, Henry Ford Health, Detroit, Michigan, U.S.A., Lynch TS; Department of Orthopedic Surgery, Henry Ford Health, Detroit, Michigan, U.S.A.
المصدر: Arthroscopy, sports medicine, and rehabilitation [Arthrosc Sports Med Rehabil] 2024 Apr 09; Vol. 6 (3), pp. 100939. Date of Electronic Publication: 2024 Apr 09 (Print Publication: 2024).
نوع المنشور: Journal Article
اللغة: English
بيانات الدورية: Publisher: Elsevier Inc Country of Publication: United States NLM ID: 101765256 Publication Model: eCollection Cited Medium: Internet ISSN: 2666-061X (Electronic) Linking ISSN: 2666061X NLM ISO Abbreviation: Arthrosc Sports Med Rehabil Subsets: PubMed not MEDLINE
أسماء مطبوعة: Original Publication: [New York] : Elsevier Inc., [2019]-
مستخلص: Purpose: To replicate a patient's internet search to evaluate ChatGPT's appropriateness in answering common patient questions about anterior cruciate ligament reconstruction compared with a Google web search.
Methods: A Google web search was performed by searching the term "anterior cruciate ligament reconstruction." The top 20 frequently asked questions and responses were recorded. The prompt "What are the 20 most popular patient questions related to 'anterior cruciate ligament reconstruction?'" was input into ChatGPT and questions and responses were recorded. Questions were classified based on the Rothwell system and responses assessed via Flesch-Kincaid Grade Level, correctness, and completeness were for both Google web search and ChatGPT.
Results: Three of 20 (15%) questions were similar between Google web search and ChatGPT. The most common question types among the Google web search were value (8/20, 40%), fact (7/20, 35%), and policy (5/20, 25%). The most common question types amongst the ChatGPT search were fact (12/20, 60%), policy (6/20, 30%), and value (2/20, 10%). Mean Flesch-Kincaid Grade Level for Google web search responses was significantly lower (11.8 ± 3.8 vs 14.3 ± 2.2; P  = .003) than for ChatGPT responses. The mean correctness for Google web search question answers was 1.47 ± 0.5, and mean completeness was 1.36 ± 0.5. Mean correctness for ChatGPT answers was 1.8 ± 0.4 and mean completeness was 1.9 ± 0.3, which were both significantly greater than Google web search answers ( P  = .03 and P  = .0003).
Conclusions: ChatGPT-4 generated more accurate and complete responses to common patient questions about anterior cruciate ligament reconstruction than Google's search engine.
Clinical Relevance: The use of artificial intelligence such as ChatGPT is expanding. It is important to understand the quality of information as well as how the results of ChatGPT queries compare with those from Google web searches.
Competing Interests: The authors declare the following financial interests/personal relationships which may be considered as potential competing interests: T.S.L. reports board membership, American Orthopedic Society for Sports Medicine, and consultant or advisor for Smith & Nephew. All other authors (M.A.G., J.P.C., M.J.A., B.A.P., M.D.M., and V.M.) declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
(© 2024 The Authors.)
References: Knee Surg Sports Traumatol Arthrosc. 2023 Nov;31(11):5190-5198. (PMID: 37553552)
Orthopadie (Heidelb). 2022 Dec;51(12):1003-1009. (PMID: 35994073)
Cureus. 2023 Aug 6;15(8):e43036. (PMID: 37674966)
Arthrosc Sports Med Rehabil. 2019 Aug 03;1(1):e85-e92. (PMID: 32266344)
J Bone Joint Surg Am. 2023 Oct 4;105(19):1519-1526. (PMID: 37459402)
Arthrosc Sports Med Rehabil. 2023 Sep 17;5(5):100805. (PMID: 37753188)
J Arthroplasty. 2023 Jul;38(7):1392-1399. (PMID: 36716898)
Curr Rev Musculoskelet Med. 2022 Jun;15(3):170-179. (PMID: 35381974)
Orthop J Sports Med. 2024 Jan 24;12(1):23259671231219014. (PMID: 38274014)
Australas Med J. 2012;5(12):633-8. (PMID: 23382767)
Eur Spine J. 2021 Aug;30(8):2176-2184. (PMID: 33048249)
Int J Surg. 2023 Jun 01;109(6):1816-1818. (PMID: 37074733)
Arthroscopy. 2023 Mar;39(3):787-789. (PMID: 36740298)
Cureus. 2023 Apr 8;15(4):e37281. (PMID: 37038381)
Nature. 2023 Jan;613(7945):620-621. (PMID: 36653617)
Am J Sports Med. 2016 Oct;44(10):2716-2723. (PMID: 26657853)
J Med Internet Res. 2019 May 02;21(5):e12522. (PMID: 31045507)
Arthroscopy. 2024 Mar;40(3):726-731.e6. (PMID: 37567487)
J Arthroplasty. 2023 Jul;38(7):1195-1202. (PMID: 37040823)
J Exp Orthop. 2023 Jul 26;10(1):74. (PMID: 37493985)
J Bone Joint Surg Am. 2016 Feb 17;98(4):325-38. (PMID: 26888683)
J Am Acad Orthop Surg. 2015 Mar;23(3):154-63. (PMID: 25667401)
تواريخ الأحداث: Date Created: 20240715 Latest Revision: 20240716
رمز التحديث: 20240716
مُعرف محوري في PubMed: PMC11240040
DOI: 10.1016/j.asmr.2024.100939
PMID: 39006779
قاعدة البيانات: MEDLINE
الوصف
تدمد:2666-061X
DOI:10.1016/j.asmr.2024.100939