To What Degree Can Language Borders Be Blurred In BERT-based Multilingual Spoken Language Understanding?

التفاصيل البيبلوغرافية
العنوان: To What Degree Can Language Borders Be Blurred In BERT-based Multilingual Spoken Language Understanding?
المؤلفون: Do, Quynh, Gaspers, Judith, Roding, Tobias, Bradford, Melanie
سنة النشر: 2020
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Computation and Language, Computer Science - Artificial Intelligence
الوصف: This paper addresses the question as to what degree a BERT-based multilingual Spoken Language Understanding (SLU) model can transfer knowledge across languages. Through experiments we will show that, although it works substantially well even on distant language groups, there is still a gap to the ideal multilingual performance. In addition, we propose a novel BERT-based adversarial model architecture to learn language-shared and language-specific representations for multilingual SLU. Our experimental results prove that the proposed model is capable of narrowing the gap to the ideal multilingual performance.
Comment: COLING 2020
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2011.05007
رقم الأكسشن: edsarx.2011.05007
قاعدة البيانات: arXiv