Robustness testing of AI systems: A case study for traffic sign recognition

التفاصيل البيبلوغرافية
العنوان: Robustness testing of AI systems: A case study for traffic sign recognition
المؤلفون: Berghoff, Christian, Bielik, Pavol, Neu, Matthias, Tsankov, Petar, von Twickel, Arndt
المصدر: In: Maglogiannis I., Macintyre J., Iliadis L. (eds) Artificial Intelligence Applications and Innovations. AIAI 2021. IFIP Advances in Information and Communication Technology, vol 627. Springer, Cham
سنة النشر: 2021
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence, Computer Science - Machine Learning
الوصف: In the last years, AI systems, in particular neural networks, have seen a tremendous increase in performance, and they are now used in a broad range of applications. Unlike classical symbolic AI systems, neural networks are trained using large data sets and their inner structure containing possibly billions of parameters does not lend itself to human interpretation. As a consequence, it is so far not feasible to provide broad guarantees for the correct behaviour of neural networks during operation if they process input data that significantly differ from those seen during training. However, many applications of AI systems are security- or safety-critical, and hence require obtaining statements on the robustness of the systems when facing unexpected events, whether they occur naturally or are induced by an attacker in a targeted way. As a step towards developing robust AI systems for such applications, this paper presents how the robustness of AI systems can be practically examined and which methods and metrics can be used to do so. The robustness testing methodology is described and analysed for the example use case of traffic sign recognition in autonomous driving.
Comment: 12 pages, 7 figures. The final publication is available at Springer via https://doi.org/10.1007/978-3-030-79150-6_21
نوع الوثيقة: Working Paper
DOI: 10.1007/978-3-030-79150-6_21
URL الوصول: http://arxiv.org/abs/2108.06159
رقم الأكسشن: edsarx.2108.06159
قاعدة البيانات: arXiv