Robust Contrastive Active Learning with Feature-guided Query Strategies

التفاصيل البيبلوغرافية
العنوان: Robust Contrastive Active Learning with Feature-guided Query Strategies
المؤلفون: Krishnan, Ranganath, Ahuja, Nilesh, Sinha, Alok, Subedar, Mahesh, Tickoo, Omesh, Iyer, Ravi
سنة النشر: 2021
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Machine Learning, Computer Science - Artificial Intelligence
الوصف: We introduce supervised contrastive active learning (SCAL) and propose efficient query strategies in active learning based on the feature similarity (featuresim) and principal component analysis based feature-reconstruction error (fre) to select informative data samples with diverse feature representations. We demonstrate our proposed method achieves state-of-the-art accuracy, model calibration and reduces sampling bias in an active learning setup for balanced and imbalanced datasets on image classification tasks. We also evaluate robustness of model to distributional shift derived from different query strategies in active learning setting. Using extensive experiments, we show that our proposed approach outperforms high performing compute-intensive methods by a big margin resulting in 9.9% lower mean corruption error, 7.2% lower expected calibration error under dataset shift and 8.9% higher AUROC for out-of-distribution detection.
Comment: 20 pages with appendix. arXiv admin note: text overlap with arXiv:2109.06321
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2109.06873
رقم الأكسشن: edsarx.2109.06873
قاعدة البيانات: arXiv