BinaryAlign: Word Alignment as Binary Sequence Labeling

التفاصيل البيبلوغرافية
العنوان: BinaryAlign: Word Alignment as Binary Sequence Labeling
المؤلفون: Latouche, Gaetan Lopez, Carbonneau, Marc-André, Swanson, Ben
سنة النشر: 2024
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Computation and Language, Computer Science - Artificial Intelligence
الوصف: Real world deployments of word alignment are almost certain to cover both high and low resource languages. However, the state-of-the-art for this task recommends a different model class depending on the availability of gold alignment training data for a particular language pair. We propose BinaryAlign, a novel word alignment technique based on binary sequence labeling that outperforms existing approaches in both scenarios, offering a unifying approach to the task. Additionally, we vary the specific choice of multilingual foundation model, perform stratified error analysis over alignment error type, and explore the performance of BinaryAlign on non-English language pairs. We make our source code publicly available.
Comment: Accepted to ACL 2024
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2407.12881
رقم الأكسشن: edsarx.2407.12881
قاعدة البيانات: arXiv