Aggregating Pairwise Semantic Differences for Few-Shot Claim Veracity Classification

التفاصيل البيبلوغرافية
العنوان: Aggregating Pairwise Semantic Differences for Few-Shot Claim Veracity Classification
المؤلفون: Zeng, Xia, Zubiaga, Arkaitz
سنة النشر: 2022
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Machine Learning
الوصف: As part of an automated fact-checking pipeline, the claim veracity classification task consists in determining if a claim is supported by an associated piece of evidence. The complexity of gathering labelled claim-evidence pairs leads to a scarcity of datasets, particularly when dealing with new domains. In this paper, we introduce SEED, a novel vector-based method to few-shot claim veracity classification that aggregates pairwise semantic differences for claim-evidence pairs. We build on the hypothesis that we can simulate class representative vectors that capture average semantic differences for claim-evidence pairs in a class, which can then be used for classification of new instances. We compare the performance of our method with competitive baselines including fine-tuned BERT/RoBERTa models, as well as the state-of-the-art few-shot veracity classification method that leverages language model perplexity. Experiments conducted on the FEVER and SCIFACT datasets show consistent improvements over competitive baselines in few-shot settings. Our code is available.
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2205.05646
رقم الأكسشن: edsarx.2205.05646
قاعدة البيانات: arXiv