Learning Binary Color Filter Arrays with Trainable Hard Thresholding

التفاصيل البيبلوغرافية
العنوان: Learning Binary Color Filter Arrays with Trainable Hard Thresholding
المؤلفون: Ayna, Cemre Omer, Gunturk, Bahadir Kursat, Gurbuz, Ali Cafer
سنة النشر: 2024
مصطلحات موضوعية: Electrical Engineering and Systems Science - Image and Video Processing
الوصف: Color Filter Arrays (CFA) are optical filters in digital cameras that capture specific color channels. Current commercial CFAs are hand-crafted patterns with different physical and application-specific considerations. This study proposes a binary CFA learning module based on hard thresholding with a deep learning-based demosaicing network in a joint architecture. Unlike most existing learnable CFAs that learn a channel from the whole color spectrum or linearly combine available digital colors, this method learns a binary channel selection, resulting in CFAs that are practical and physically implementable to digital cameras. The binary selection is based on adapting the hard thresholding operation into neural networks via a straight-through estimator, and therefore it is named HardMax. This paper includes the background on the CFA design problem, the description of the HardMax method, and the performance evaluation results. The evaluation of the proposed method includes tests for different demosaicing models, color configurations, filter sizes, and a comparison with existing methods in various reconstruction metrics. The proposed approach is tested with Kodak and BSDS500 datasets and provides higher reconstruction performance than hand-crafted or alternative learned binary filters.
Comment: Pre-publication journal paper, 17 pages, 9 figures. Potential submissions include IEEE Transactions on Computational Imaging, IEEE Transactions on Image Processing, IEEE Access, and MDPI Sensors
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2406.14421
رقم الأكسشن: edsarx.2406.14421
قاعدة البيانات: arXiv