تقرير
An\'alise de ambiguidade lingu\'istica em modelos de linguagem de grande escala (LLMs)
| العنوان: | An\'alise de ambiguidade lingu\'istica em modelos de linguagem de grande escala (LLMs) |
|---|---|
| المؤلفون: | Moraes, Lavínia de Carvalho, Silvério, Irene Cristina, Marques, Rafael Alexandre Sousa, Anaia, Bianca de Castro, de Paula, Dandara Freitas, de Faria, Maria Carolina Schincariol, Cleveston, Iury, Correia, Alana de Santana, Freitag, Raquel Meister Ko |
| سنة النشر: | 2024 |
| المجموعة: | Computer Science |
| مصطلحات موضوعية: | Computer Science - Computation and Language, Computer Science - Artificial Intelligence |
| الوصف: | Linguistic ambiguity continues to represent a significant challenge for natural language processing (NLP) systems, notwithstanding the advancements in architectures such as Transformers and BERT. Inspired by the recent success of instructional models like ChatGPT and Gemini (In 2023, the artificial intelligence was called Bard.), this study aims to analyze and discuss linguistic ambiguity within these models, focusing on three types prevalent in Brazilian Portuguese: semantic, syntactic, and lexical ambiguity. We create a corpus comprising 120 sentences, both ambiguous and unambiguous, for classification, explanation, and disambiguation. The models capability to generate ambiguous sentences was also explored by soliciting sets of sentences for each type of ambiguity. The results underwent qualitative analysis, drawing on recognized linguistic references, and quantitative assessment based on the accuracy of the responses obtained. It was evidenced that even the most sophisticated models, such as ChatGPT and Gemini, exhibit errors and deficiencies in their responses, with explanations often providing inconsistent. Furthermore, the accuracy peaked at 49.58 percent, indicating the need for descriptive studies for supervised learning. Comment: in Portuguese language, 16 p\'aginas, 5 p\'aginas de ap\^endice e 4 imagens |
| نوع الوثيقة: | Working Paper |
| اللغة: | Portuguese |
| URL الوصول: | http://arxiv.org/abs/2404.16653 |
| رقم الأكسشن: | edsarx.2404.16653 |
| قاعدة البيانات: | arXiv |
| الوصف غير متاح. |