تقرير
CSSL-MHTR: Continual Self-Supervised Learning for Scalable Multi-script Handwritten Text Recognition
العنوان: | CSSL-MHTR: Continual Self-Supervised Learning for Scalable Multi-script Handwritten Text Recognition |
---|---|
المؤلفون: | Dhiaf, Marwa, Souibgui, Mohamed Ali, Wang, Kai, Liu, Yuyang, Kessentini, Yousri, Fornés, Alicia, Rouhou, Ahmed Cheikh |
سنة النشر: | 2023 |
المجموعة: | Computer Science |
مصطلحات موضوعية: | Computer Science - Computer Vision and Pattern Recognition |
الوصف: | Self-supervised learning has recently emerged as a strong alternative in document analysis. These approaches are now capable of learning high-quality image representations and overcoming the limitations of supervised methods, which require a large amount of labeled data. However, these methods are unable to capture new knowledge in an incremental fashion, where data is presented to the model sequentially, which is closer to the realistic scenario. In this paper, we explore the potential of continual self-supervised learning to alleviate the catastrophic forgetting problem in handwritten text recognition, as an example of sequence recognition. Our method consists in adding intermediate layers called adapters for each task, and efficiently distilling knowledge from the previous model while learning the current task. Our proposed framework is efficient in both computation and memory complexity. To demonstrate its effectiveness, we evaluate our method by transferring the learned model to diverse text recognition downstream tasks, including Latin and non-Latin scripts. As far as we know, this is the first application of continual self-supervised learning for handwritten text recognition. We attain state-of-the-art performance on English, Italian and Russian scripts, whilst adding only a few parameters per task. The code and trained models will be publicly available. Comment: Due to current company policy constraints, we are compelled to withdraw our paper. The organization's guidelines prohibit us from proceeding with the publication of this work at this time. We apologize for any inconvenience this may cause and appreciate your understanding in this matter |
نوع الوثيقة: | Working Paper |
URL الوصول: | http://arxiv.org/abs/2303.09347 |
رقم الأكسشن: | edsarx.2303.09347 |
قاعدة البيانات: | arXiv |
الوصف غير متاح. |