Towards Evaluating the Robustness of Automatic Speech Recognition Systems via Audio Style Transfer

التفاصيل البيبلوغرافية
العنوان: Towards Evaluating the Robustness of Automatic Speech Recognition Systems via Audio Style Transfer
المؤلفون: Jin, Weifei, Cao, Yuxin, Su, Junjie, Shen, Qi, Ye, Kai, Wang, Derui, Hao, Jie, Liu, Ziyao
سنة النشر: 2024
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Sound, Computer Science - Cryptography and Security, Computer Science - Machine Learning, Electrical Engineering and Systems Science - Audio and Speech Processing
الوصف: In light of the widespread application of Automatic Speech Recognition (ASR) systems, their security concerns have received much more attention than ever before, primarily due to the susceptibility of Deep Neural Networks. Previous studies have illustrated that surreptitiously crafting adversarial perturbations enables the manipulation of speech recognition systems, resulting in the production of malicious commands. These attack methods mostly require adding noise perturbations under $\ell_p$ norm constraints, inevitably leaving behind artifacts of manual modifications. Recent research has alleviated this limitation by manipulating style vectors to synthesize adversarial examples based on Text-to-Speech (TTS) synthesis audio. However, style modifications based on optimization objectives significantly reduce the controllability and editability of audio styles. In this paper, we propose an attack on ASR systems based on user-customized style transfer. We first test the effect of Style Transfer Attack (STA) which combines style transfer and adversarial attack in sequential order. And then, as an improvement, we propose an iterative Style Code Attack (SCA) to maintain audio quality. Experimental results show that our method can meet the need for user-customized styles and achieve a success rate of 82% in attacks, while keeping sound naturalness due to our user study.
Comment: Accepted to SecTL (AsiaCCS Workshop) 2024
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2405.09470
رقم الأكسشن: edsarx.2405.09470
قاعدة البيانات: arXiv