Indiscriminate Poisoning Attacks on Unsupervised Contrastive Learning

التفاصيل البيبلوغرافية
العنوان: Indiscriminate Poisoning Attacks on Unsupervised Contrastive Learning
المؤلفون: He, Hao, Zha, Kaiwen, Katabi, Dina
سنة النشر: 2022
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Machine Learning, Computer Science - Artificial Intelligence, Computer Science - Cryptography and Security, Computer Science - Computer Vision and Pattern Recognition
الوصف: Indiscriminate data poisoning attacks are quite effective against supervised learning. However, not much is known about their impact on unsupervised contrastive learning (CL). This paper is the first to consider indiscriminate poisoning attacks of contrastive learning. We propose Contrastive Poisoning (CP), the first effective such attack on CL. We empirically show that Contrastive Poisoning, not only drastically reduces the performance of CL algorithms, but also attacks supervised learning models, making it the most generalizable indiscriminate poisoning attack. We also show that CL algorithms with a momentum encoder are more robust to indiscriminate poisoning, and propose a new countermeasure based on matrix completion. Code is available at: https://github.com/kaiwenzha/contrastive-poisoning.
Comment: ICLR 2023 Spotlight (notable top 25%). The first two authors contributed equally to this paper
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2202.11202
رقم الأكسشن: edsarx.2202.11202
قاعدة البيانات: arXiv