تقرير
CMAE-V: Contrastive Masked Autoencoders for Video Action Recognition
| العنوان: | CMAE-V: Contrastive Masked Autoencoders for Video Action Recognition |
|---|---|
| المؤلفون: | Lu, Cheng-Ze, Jin, Xiaojie, Huang, Zhicheng, Hou, Qibin, Cheng, Ming-Ming, Feng, Jiashi |
| سنة النشر: | 2023 |
| المجموعة: | Computer Science |
| مصطلحات موضوعية: | Computer Science - Computer Vision and Pattern Recognition |
| الوصف: | Contrastive Masked Autoencoder (CMAE), as a new self-supervised framework, has shown its potential of learning expressive feature representations in visual image recognition. This work shows that CMAE also trivially generalizes well on video action recognition without modifying the architecture and the loss criterion. By directly replacing the original pixel shift with the temporal shift, our CMAE for visual action recognition, CMAE-V for short, can generate stronger feature representations than its counterpart based on pure masked autoencoders. Notably, CMAE-V, with a hybrid architecture, can achieve 82.2% and 71.6% top-1 accuracy on the Kinetics-400 and Something-something V2 datasets, respectively. We hope this report could provide some informative inspiration for future works. Comment: Technical Report |
| نوع الوثيقة: | Working Paper |
| URL الوصول: | http://arxiv.org/abs/2301.06018 |
| رقم الأكسشن: | edsarx.2301.06018 |
| قاعدة البيانات: | arXiv |
| الوصف غير متاح. |