Incorporating External Knowledge and Goal Guidance for LLM-based Conversational Recommender Systems

التفاصيل البيبلوغرافية
العنوان: Incorporating External Knowledge and Goal Guidance for LLM-based Conversational Recommender Systems
المؤلفون: Li, Chuang, Deng, Yang, Hu, Hengchang, Kan, Min-Yen, Li, Haizhou
سنة النشر: 2024
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Computation and Language
الوصف: This paper aims to efficiently enable large language models (LLMs) to use external knowledge and goal guidance in conversational recommender system (CRS) tasks. Advanced LLMs (e.g., ChatGPT) are limited in domain-specific CRS tasks for 1) generating grounded responses with recommendation-oriented knowledge, or 2) proactively leading the conversations through different dialogue goals. In this work, we first analyze those limitations through a comprehensive evaluation, showing the necessity of external knowledge and goal guidance which contribute significantly to the recommendation accuracy and language quality. In light of this finding, we propose a novel ChatCRS framework to decompose the complex CRS task into several sub-tasks through the implementation of 1) a knowledge retrieval agent using a tool-augmented approach to reason over external Knowledge Bases and 2) a goal-planning agent for dialogue goal prediction. Experimental results on two multi-goal CRS datasets reveal that ChatCRS sets new state-of-the-art benchmarks, improving language quality of informativeness by 17% and proactivity by 27%, and achieving a tenfold enhancement in recommendation accuracy.
Comment: Main paper 8 pages; References and Appendix 9 pages; 7 figures and 14 tables
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2405.01868
رقم الأكسشن: edsarx.2405.01868
قاعدة البيانات: arXiv