Exploring Data Augmentation for Code Generation Tasks

التفاصيل البيبلوغرافية
العنوان: Exploring Data Augmentation for Code Generation Tasks
المؤلفون: Chen, Pinzhen, Lampouras, Gerasimos
سنة النشر: 2023
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Programming Languages
الوصف: Advances in natural language processing, such as transfer learning from pre-trained language models, have impacted how models are trained for programming language tasks too. Previous research primarily explored code pre-training and expanded it through multi-modality and multi-tasking, yet the data for downstream tasks remain modest in size. Focusing on data utilization for downstream tasks, we propose and adapt augmentation methods that yield consistent improvements in code translation and summarization by up to 6.9% and 7.5% respectively. Further analysis suggests that our methods work orthogonally and show benefits in output code style and numeric consistency. We also discuss test data imperfections.
Comment: Findings of EACL 2023
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2302.03499
رقم الأكسشن: edsarx.2302.03499
قاعدة البيانات: arXiv