تقرير
Improving Document Representations by Generating Pseudo Query Embeddings for Dense Retrieval
العنوان: | Improving Document Representations by Generating Pseudo Query Embeddings for Dense Retrieval |
---|---|
المؤلفون: | Tang, Hongyin, Sun, Xingwu, Jin, Beihong, Wang, Jingang, Zhang, Fuzheng, Wu, Wei |
سنة النشر: | 2021 |
المجموعة: | Computer Science |
مصطلحات موضوعية: | Computer Science - Information Retrieval, Computer Science - Computation and Language |
الوصف: | Recently, the retrieval models based on dense representations have been gradually applied in the first stage of the document retrieval tasks, showing better performance than traditional sparse vector space models. To obtain high efficiency, the basic structure of these models is Bi-encoder in most cases. However, this simple structure may cause serious information loss during the encoding of documents since the queries are agnostic. To address this problem, we design a method to mimic the queries on each of the documents by an iterative clustering process and represent the documents by multiple pseudo queries (i.e., the cluster centroids). To boost the retrieval process using approximate nearest neighbor search library, we also optimize the matching function with a two-step score calculation procedure. Experimental results on several popular ranking and QA datasets show that our model can achieve state-of-the-art results. Comment: 11 pages, 2 figures, Accepted by ACL 2021 |
نوع الوثيقة: | Working Paper |
URL الوصول: | http://arxiv.org/abs/2105.03599 |
رقم الأكسشن: | edsarx.2105.03599 |
قاعدة البيانات: | arXiv |
كن أول من يترك تعليقا!