Sign Language Translation from Instructional Videos

التفاصيل البيبلوغرافية
العنوان: Sign Language Translation from Instructional Videos
المؤلفون: Tarrés, Laia, Gállego, Gerard I., Duarte, Amanda, Torres, Jordi, Giró-i-Nieto, Xavier
سنة النشر: 2023
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Computation and Language, Computer Science - Computer Vision and Pattern Recognition
الوصف: The advances in automatic sign language translation (SLT) to spoken languages have been mostly benchmarked with datasets of limited size and restricted domains. Our work advances the state of the art by providing the first baseline results on How2Sign, a large and broad dataset. We train a Transformer over I3D video features, using the reduced BLEU as a reference metric for validation, instead of the widely used BLEU score. We report a result of 8.03 on the BLEU score, and publish the first open-source implementation of its kind to promote further advances.
Comment: Paper accepted at WiCV @CVPR23
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2304.06371
رقم الأكسشن: edsarx.2304.06371
قاعدة البيانات: arXiv