دورية أكاديمية
Assessing ChatGPT's Competency in Addressing Interdisciplinary Inquiries on Chatbot Uses in Sports Rehabilitation: Simulation Study.
| العنوان: | Assessing ChatGPT's Competency in Addressing Interdisciplinary Inquiries on Chatbot Uses in Sports Rehabilitation: Simulation Study. |
|---|---|
| المؤلفون: | McBee JC; Department of Microbiology, Immunology, & Cell Biology, West Virginia University, Morgantown, WV, United States.; Department of Chemical and Biomedical Engineering, West Virginia University, Morgantown, WV, United States., Han DY; Department of Microbiology, Immunology, & Cell Biology, West Virginia University, Morgantown, WV, United States., Liu L; College of Health Solutions, Arizona State University, Phoenix, AZ, United States.; Biodesign Institute, Arizona State University, Tempe, AZ, United States., Ma L; College of Health, Education, and Human Services, Wright State University, Dayton, OH, United States., Adjeroh DA; Lane Department of Computer Science & Electrical Engineering, West Virginia University, Morgantown, WV, United States., Xu D; Department of Electrical Engineering and Computer Science, Christopher S. Bond Life Sciences Center, University of Missouri, Columbia, MO, United States., Hu G; Department of Microbiology, Immunology, & Cell Biology, West Virginia University, Morgantown, WV, United States. |
| المصدر: | JMIR medical education [JMIR Med Educ] 2024 Aug 07; Vol. 10, pp. e51157. Date of Electronic Publication: 2024 Aug 07. |
| نوع المنشور: | Journal Article |
| اللغة: | English |
| بيانات الدورية: | Publisher: JMIR Publications Country of Publication: Canada NLM ID: 101684518 Publication Model: Electronic Cited Medium: Internet ISSN: 2369-3762 (Electronic) Linking ISSN: 23693762 NLM ISO Abbreviation: JMIR Med Educ Subsets: MEDLINE |
| أسماء مطبوعة: | Original Publication: Toronto, ON : JMIR Publications, [2015]- |
| مواضيع طبية MeSH: | Interdisciplinary Communication*, Humans ; Sports ; Clinical Competence/standards |
| مستخلص: | Background: ChatGPT showcases exceptional conversational capabilities and extensive cross-disciplinary knowledge. In addition, it can perform multiple roles in a single chat session. This unique multirole-playing feature positions ChatGPT as a promising tool for exploring interdisciplinary subjects. Objective: The aim of this study was to evaluate ChatGPT's competency in addressing interdisciplinary inquiries based on a case study exploring the opportunities and challenges of chatbot uses in sports rehabilitation. Methods: We developed a model termed PanelGPT to assess ChatGPT's competency in addressing interdisciplinary topics through simulated panel discussions. Taking chatbot uses in sports rehabilitation as an example of an interdisciplinary topic, we prompted ChatGPT through PanelGPT to role-play a physiotherapist, psychologist, nutritionist, artificial intelligence expert, and athlete in a simulated panel discussion. During the simulation, we posed questions to the panel while ChatGPT acted as both the panelists for responses and the moderator for steering the discussion. We performed the simulation using ChatGPT-4 and evaluated the responses by referring to the literature and our human expertise. Results: By tackling questions related to chatbot uses in sports rehabilitation with respect to patient education, physiotherapy, physiology, nutrition, and ethical considerations, responses from the ChatGPT-simulated panel discussion reasonably pointed to various benefits such as 24/7 support, personalized advice, automated tracking, and reminders. ChatGPT also correctly emphasized the importance of patient education, and identified challenges such as limited interaction modes, inaccuracies in emotion-related advice, assurance of data privacy and security, transparency in data handling, and fairness in model training. It also stressed that chatbots are to assist as a copilot, not to replace human health care professionals in the rehabilitation process. Conclusions: ChatGPT exhibits strong competency in addressing interdisciplinary inquiry by simulating multiple experts from complementary backgrounds, with significant implications in assisting medical education. (©Joseph C McBee, Daniel Y Han, Li Liu, Leah Ma, Donald A Adjeroh, Dong Xu, Gangqing Hu. Originally published in JMIR Medical Education (https://mededu.jmir.org), 07.08.2024.) |
| References: | Quant Biol. 2023 Jun;11(2):105-108. (PMID: 37378043) Int J Med Inform. 2020 Aug;140:104171. (PMID: 32446158) J Med Internet Res. 2020 May 26;22(5):e16896. (PMID: 32452807) Am J Sports Med. 2022 Mar;50(4):1166-1174. (PMID: 33900125) JMIR Med Educ. 2023 Dec 22;9:e50658. (PMID: 38133908) Natl Health Stat Report. 2016 Nov;(99):1-12. (PMID: 27906643) Minds Mach (Dordr). 2018;28(4):689-707. (PMID: 30930541) JMIR Hum Factors. 2023 May 5;10:e43227. (PMID: 37145858) JMIR Med Educ. 2024 Mar 20;10:e51151. (PMID: 38506920) Nature. 2023 Mar;615(7950):20. (PMID: 36807343) Nature. 2023 Jun;618(7967):891-892. (PMID: 37340135) JMIR Cardio. 2024 Apr 19;8:e53421. (PMID: 38640472) Asian Pac Isl Nurs J. 2023 Apr 24;7:e48136. (PMID: 37093625) Ann Biomed Eng. 2023 Aug;51(8):1658-1662. (PMID: 37097528) JMIR Med Educ. 2024 Jan 31;10:e51344. (PMID: 38111256) Anat Sci Educ. 2024 Jul-Aug;17(5):926-931. (PMID: 36916887) JMIR Cancer. 2019 May 02;5(1):e12856. (PMID: 31045505) JMIR Mhealth Uhealth. 2023 May 22;11:e44838. (PMID: 37213181) Arthrosc Sports Med Rehabil. 2023 Mar 16;5(2):e495-e505. (PMID: 37101866) Heliyon. 2022 Jun 05;8(6):e09633. (PMID: 35706961) Nutrition. 2023 Aug;112:112076. (PMID: 37269717) J Exp Orthop. 2023 Jul 26;10(1):74. (PMID: 37493985) Ann Biomed Eng. 2023 Aug;51(8):1645-1653. (PMID: 37115365) J Sport Health Sci. 2024 May;13(3):368-372. (PMID: 38176646) Indian J Orthop. 2017 Sep-Oct;51(5):529-536. (PMID: 28966376) Front Psychol. 2020 Jan 23;10:3061. (PMID: 32038415) J Med Internet Res. 2020 Jul 29;22(7):e17750. (PMID: 32723723) |
| معلومات مُعتمدة: | P20 GM103434 United States GM NIGMS NIH HHS; R01 LM013392 United States LM NLM NIH HHS; R01 LM013438 United States LM NLM NIH HHS; U54 GM104942 United States GM NIGMS NIH HHS |
| فهرسة مساهمة: | Keywords: ChatGPT; chatbots; interdisciplinary inquiry; medical education; multirole-playing; sports medicine |
| تواريخ الأحداث: | Date Created: 20240723 Date Completed: 20240807 Latest Revision: 20240824 |
| رمز التحديث: | 20240826 |
| مُعرف محوري في PubMed: | PMC11339563 |
| DOI: | 10.2196/51157 |
| PMID: | 39042885 |
| قاعدة البيانات: | MEDLINE |
Full Text Finder | تدمد: | 2369-3762 |
|---|---|
| DOI: | 10.2196/51157 |