Temporal Embeddings and Transformer Models for Narrative Text Understanding

التفاصيل البيبلوغرافية
العنوان: Temporal Embeddings and Transformer Models for Narrative Text Understanding
المؤلفون: K, Vani, Mellace, Simone, Antonucci, Alessandro
سنة النشر: 2020
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Computation and Language, Computer Science - Machine Learning
الوصف: We present two deep learning approaches to narrative text understanding for character relationship modelling. The temporal evolution of these relations is described by dynamic word embeddings, that are designed to learn semantic changes over time. An empirical analysis of the corresponding character trajectories shows that such approaches are effective in depicting dynamic evolution. A supervised learning approach based on the state-of-the-art transformer model BERT is used instead to detect static relations between characters. The empirical validation shows that such events (e.g., two characters belonging to the same family) might be spotted with good accuracy, even when using automatically annotated data. This provides a deeper understanding of narrative plots based on the identification of key facts. Standard clustering techniques are finally used for character de-aliasing, a necessary pre-processing step for both approaches. Overall, deep learning models appear to be suitable for narrative text understanding, while also providing a challenging and unexploited benchmark for general natural language understanding.
Comment: Presented at the Third International Workshop on Narrative Extraction from Texts (Text2Story 2020) held in conjunction with the 42nd European Conference on Information Retrieval
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2003.08811
رقم الأكسشن: edsarx.2003.08811
قاعدة البيانات: arXiv