Unsupervised Welding Defect Detection Using Audio And Video

التفاصيل البيبلوغرافية
العنوان: Unsupervised Welding Defect Detection Using Audio And Video
المؤلفون: Stemmer, Georg, Lopez, Jose A., Ontiveros, Juan A. Del Hoyo, Raju, Arvind, Thimmanaik, Tara, Biswas, Sovan
سنة النشر: 2024
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Robotics, Computer Science - Computer Vision and Pattern Recognition, Electrical Engineering and Systems Science - Image and Video Processing
الوصف: In this work we explore the application of AI to robotic welding. Robotic welding is a widely used technology in many industries, but robots currently do not have the capability to detect welding defects which get introduced due to various reasons in the welding process. We describe how deep-learning methods can be applied to detect weld defects in real-time by recording the welding process with microphones and a camera. Our findings are based on a large database with more than 4000 welding samples we collected which covers different weld types, materials and various defect categories. All deep learning models are trained in an unsupervised fashion because the space of possible defects is large and the defects in our data may contain biases. We demonstrate that a reliable real-time detection of most categories of weld defects is feasible both from audio and video, with improvements achieved by combining both modalities. Specifically, the multi-modal approach achieves an average Area-under-ROC-Curve (AUC) of 0.92 over all eleven defect types in our data. We conclude the paper with an analysis of the results by defect type and a discussion of future work.
Comment: 21 pages
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2409.02290
رقم الأكسشن: edsarx.2409.02290
قاعدة البيانات: arXiv