تقرير
Exploring and Adapting Chinese GPT to Pinyin Input Method
| العنوان: | Exploring and Adapting Chinese GPT to Pinyin Input Method |
|---|---|
| المؤلفون: | Tan, Minghuan, Dai, Yong, Tang, Duyu, Feng, Zhangyin, Huang, Guoping, Jiang, Jing, Li, Jiwei, Shi, Shuming |
| سنة النشر: | 2022 |
| المجموعة: | Computer Science |
| مصطلحات موضوعية: | Computer Science - Computation and Language, Computer Science - Artificial Intelligence |
| الوصف: | While GPT has become the de-facto method for text generation tasks, its application to pinyin input method remains unexplored. In this work, we make the first exploration to leverage Chinese GPT for pinyin input method. We find that a frozen GPT achieves state-of-the-art performance on perfect pinyin. However, the performance drops dramatically when the input includes abbreviated pinyin. A reason is that an abbreviated pinyin can be mapped to many perfect pinyin, which links to even larger number of Chinese characters. We mitigate this issue with two strategies, including enriching the context with pinyin and optimizing the training process to help distinguish homophones. To further facilitate the evaluation of pinyin input method, we create a dataset consisting of 270K instances from 15 domains. Results show that our approach improves performance on abbreviated pinyin across all domains. Model analysis demonstrates that both strategies contribute to the performance boost. Comment: To appear in ACL 2022 |
| نوع الوثيقة: | Working Paper |
| URL الوصول: | http://arxiv.org/abs/2203.00249 |
| رقم الأكسشن: | edsarx.2203.00249 |
| قاعدة البيانات: | arXiv |
كن أول من يترك تعليقا!