Feature-Realistic Neural Fusion for Real-Time, Open Set Scene Understanding

التفاصيل البيبلوغرافية
العنوان: Feature-Realistic Neural Fusion for Real-Time, Open Set Scene Understanding
المؤلفون: Mazur, Kirill, Sucar, Edgar, Davison, Andrew J.
سنة النشر: 2022
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Machine Learning, Computer Science - Robotics
الوصف: General scene understanding for robotics requires flexible semantic representation, so that novel objects and structures which may not have been known at training time can be identified, segmented and grouped. We present an algorithm which fuses general learned features from a standard pre-trained network into a highly efficient 3D geometric neural field representation during real-time SLAM. The fused 3D feature maps inherit the coherence of the neural field's geometry representation. This means that tiny amounts of human labelling interacting at runtime enable objects or even parts of objects to be robustly and accurately segmented in an open set manner.
Comment: For our project page, see https://makezur.github.io/FeatureRealisticFusion/
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2210.03043
رقم الأكسشن: edsarx.2210.03043
قاعدة البيانات: arXiv