Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation

التفاصيل البيبلوغرافية
العنوان: Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation
المؤلفون: Moab Arar, Daniel Cohen-Or, Dov Danon, Amit Bermano, Yiftach Ginger
المصدر: CVPR
بيانات النشر: IEEE, 2020.
سنة النشر: 2020
مصطلحات موضوعية: Similarity (geometry), Computer science, Reliability (computer networking), Image registration, Geometry, 02 engineering and technology, 010501 environmental sciences, Translation (geometry), 01 natural sciences, Image (mathematics), Modal, ComputerApplications_MISCELLANEOUS, 0202 electrical engineering, electronic engineering, information engineering, Image translation, 020201 artificial intelligence & image processing, 0105 earth and related environmental sciences
الوصف: Many applications, such as autonomous driving, heavily rely on multi-modal data where spatial alignment between the modalities is required. Most multi-modal registration methods struggle computing the spatial correspondence between the images using prevalent cross-modality similarity measures. In this work, we bypass the difficulties of developing cross-modality similarity measures, by training an image-to-image translation network on the two input modalities. This learned translation allows training the registration network using simple and reliable mono-modality metrics. We perform multi-modal registration using two networks - a spatial transformation network and a translation network. We show that by encouraging our translation network to be geometry preserving, we manage to train an accurate spatial transformation network. Compared to state-of-the-art multi-modal methods our presented method is unsupervised, requiring no pairs of aligned modalities for training, and can be adapted to any pair of modalities. We evaluate our method quantitatively and qualitatively on commercial datasets, showing that it performs well on several modalities and achieves accurate alignment.
URL الوصول: https://explore.openaire.eu/search/publication?articleId=doi_________::7417e42343ddd31985685de44722978a
https://doi.org/10.1109/cvpr42600.2020.01342
حقوق: OPEN
رقم الأكسشن: edsair.doi...........7417e42343ddd31985685de44722978a
قاعدة البيانات: OpenAIRE