Dynamic Open Vocabulary Enhanced Safe-landing with Intelligence (DOVESEI)

التفاصيل البيبلوغرافية
العنوان: Dynamic Open Vocabulary Enhanced Safe-landing with Intelligence (DOVESEI)
المؤلفون: Bong, Haechan Mark, Zhang, Rongge, de Azambuja, Ricardo, Beltrame, Giovanni
سنة النشر: 2023
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Robotics, Computer Science - Artificial Intelligence, Computer Science - Computer Vision and Pattern Recognition
الوصف: This work targets what we consider to be the foundational step for urban airborne robots, a safe landing. Our attention is directed toward what we deem the most crucial aspect of the safe landing perception stack: segmentation. We present a streamlined reactive UAV system that employs visual servoing by harnessing the capabilities of open vocabulary image segmentation. This approach can adapt to various scenarios with minimal adjustments, bypassing the necessity for extensive data accumulation for refining internal models, thanks to its open vocabulary methodology. Given the limitations imposed by local authorities, our primary focus centers on operations originating from altitudes of 100 meters. This choice is deliberate, as numerous preceding works have dealt with altitudes up to 30 meters, aligning with the capabilities of small stereo cameras. Consequently, we leave the remaining 20m to be navigated using conventional 3D path planning methods. Utilizing monocular cameras and image segmentation, our findings demonstrate the system's capability to successfully execute landing maneuvers at altitudes as low as 20 meters. However, this approach is vulnerable to intermittent and occasionally abrupt fluctuations in the segmentation between frames in a video stream. To address this challenge, we enhance the image segmentation output by introducing what we call a dynamic focus: a masking mechanism that self adjusts according to the current landing stage. This dynamic focus guides the control system to avoid regions beyond the drone's safety radius projected onto the ground, thus mitigating the problems with fluctuations. Through the implementation of this supplementary layer, our experiments have reached improvements in the landing success rate of almost tenfold when compared to global segmentation. All the source code is open source and available online (github.com/MISTLab/DOVESEI).
Comment: IROS 2023 The Last-Mile Robotics Workshop
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2308.11471
رقم الأكسشن: edsarx.2308.11471
قاعدة البيانات: arXiv