دورية أكاديمية
CPMI-ChatGLM: parameter-efficient fine-tuning ChatGLM with Chinese patent medicine instructions
| العنوان: | CPMI-ChatGLM: parameter-efficient fine-tuning ChatGLM with Chinese patent medicine instructions |
|---|---|
| المؤلفون: | Can Liu, Kaijie Sun, Qingqing Zhou, Yuchen Duan, Jianhua Shu, Hongxing Kan, Zongyun Gu, Jili Hu |
| المصدر: | Scientific Reports, Vol 14, Iss 1, Pp 1-13 (2024) |
| بيانات النشر: | Nature Portfolio, 2024. |
| سنة النشر: | 2024 |
| المجموعة: | LCC:Medicine LCC:Science |
| مصطلحات موضوعية: | Medicine, Science |
| الوصف: | Abstract Chinese patent medicine (CPM) is a typical type of traditional Chinese medicine (TCM) preparation that uses Chinese herbs as raw materials and is an important means of treating diseases in TCM. Chinese patent medicine instructions (CPMI) serve as a guide for patients to use drugs safely and effectively. In this study, we apply a pre-trained language model to the domain of CPM. We have meticulously assembled, processed, and released the first CPMI dataset and fine-tuned the ChatGLM-6B base model, resulting in the development of CPMI-ChatGLM. We employed consumer-grade graphics cards for parameter-efficient fine-tuning and investigated the impact of LoRA and P-Tuning v2, as well as different data scales and instruction data settings on model performance. We evaluated CPMI-ChatGLM using BLEU, ROUGE, and BARTScore metrics. Our model achieved scores of 0.7641, 0.8188, 0.7738, 0.8107, and − 2.4786 on the BLEU-4, ROUGE-1, ROUGE-2, ROUGE-L and BARTScore metrics, respectively. In comparison experiments and human evaluation with four large language models of similar parameter scales, CPMI-ChatGLM demonstrated state-of-the-art performance. CPMI-ChatGLM demonstrates commendable proficiency in CPM recommendations, making it a promising tool for auxiliary diagnosis and treatment. Furthermore, the various attributes in the CPMI dataset can be used for data mining and analysis, providing practical application value and research significance. |
| نوع الوثيقة: | article |
| وصف الملف: | electronic resource |
| اللغة: | English |
| تدمد: | 2045-2322 |
| Relation: | https://doaj.org/toc/2045-2322 |
| DOI: | 10.1038/s41598-024-56874-w |
| URL الوصول: | https://doaj.org/article/1b03f88871d74452ac3c0b7bc62feac3 |
| رقم الأكسشن: | edsdoj.1b03f88871d74452ac3c0b7bc62feac3 |
| قاعدة البيانات: | Directory of Open Access Journals |
Find this article in full text from Springer Verlag. 
Full Text Finder | تدمد: | 20452322 |
|---|---|
| DOI: | 10.1038/s41598-024-56874-w |