Improving the matching of deformable objects by learning to detect keypoints

التفاصيل البيبلوغرافية
العنوان: Improving the matching of deformable objects by learning to detect keypoints
المؤلفون: Cadar, Felipe, Melo, Welerson, Kanagasabapathi, Vaishnavi, Potje, Guilherme, Martins, Renato, Nascimento, Erickson R.
المصدر: Pattern Recognition Letters 2023
سنة النشر: 2023
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Computer Vision and Pattern Recognition
الوصف: We propose a novel learned keypoint detection method to increase the number of correct matches for the task of non-rigid image correspondence. By leveraging true correspondences acquired by matching annotated image pairs with a specified descriptor extractor, we train an end-to-end convolutional neural network (CNN) to find keypoint locations that are more appropriate to the considered descriptor. For that, we apply geometric and photometric warpings to images to generate a supervisory signal, allowing the optimization of the detector. Experiments demonstrate that our method enhances the Mean Matching Accuracy of numerous descriptors when used in conjunction with our detection method, while outperforming the state-of-the-art keypoint detectors on real images of non-rigid objects by 20 p.p. We also apply our method on the complex real-world task of object retrieval where our detector performs on par with the finest keypoint detectors currently available for this task. The source code and trained models are publicly available at https://github.com/verlab/LearningToDetect_PRL_2023
Comment: This is the accepted version of the paper to appear at Pattern Recognition Letters (PRL). The final journal version will be available at https://doi.org/10.1016/j.patrec.2023.08.012
نوع الوثيقة: Working Paper
DOI: 10.1016/j.patrec.2023.08.012
URL الوصول: http://arxiv.org/abs/2309.00434
رقم الأكسشن: edsarx.2309.00434
قاعدة البيانات: arXiv