Multimodal Dyadic Impression Recognition via Listener Adaptive Cross-Domain Fusion
| العنوان: | Multimodal Dyadic Impression Recognition via Listener Adaptive Cross-Domain Fusion |
|---|---|
| المؤلفون: | Li, Yuanchao, Bell, Peter, Lai, Catherine |
| المصدر: | Li, Y, Bell, P & Lai, C 2023, Multimodal Dyadic Impression Recognition via Listener Adaptive Cross-Domain Fusion . in 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023 IEEE International Conference on Acoustics, Speech and Signal Processing, Rhodes Island, Greece, 4/06/23 . https://doi.org/10.1109/ICASSP49357.2023.10095072 |
| بيانات النشر: | IEEE, 2023. |
| سنة النشر: | 2023 |
| مصطلحات موضوعية: | FOS: Computer and information sciences, Sound (cs.SD), cs.MM, impression recognition, Affective computing, Multimodal Fusion, Computer Science - Sound, Multimedia (cs.MM), cs.SD, Audio and Speech Processing (eess.AS), FOS: Electrical engineering, electronic engineering, information engineering, eess.AS, Computer Science - Multimedia, Electrical Engineering and Systems Science - Audio and Speech Processing |
| الوصف: | As a sub-branch of affective computing, impression recognition, e.g., perception of speaker characteristics such as warmth or competence, is potentially a critical part of both human-human conversations and spoken dialogue systems. Most research has studied impressions only from the behaviors expressed by the speaker or the response from the listener, yet ignored their latent connection. In this paper, we perform impression recognition using a proposed listener adaptive cross-domain architecture, which consists of a listener adaptation function to model the causality between speaker and listener behaviors and a cross-domain fusion function to strengthen their connection. The experimental evaluation on the dyadic IMPRESSION dataset verified the efficacy of our method, producing concordance correlation coefficients of 78.8% and 77.5% in the competence and warmth dimensions, outperforming previous studies. The proposed method is expected to be generalized to similar dyadic interaction scenarios. Accepted to ICASSP2023. arXiv admin note: substantial text overlap with arXiv:2203.13932 |
| وصف الملف: | application/pdf |
| URL الوصول: | https://explore.openaire.eu/search/publication?articleId=doi_dedup___::9f05ef057464aefc5106fcc0d84398b2 https://doi.org/10.1109/icassp49357.2023.10095072 |
| حقوق: | OPEN |
| رقم الأكسشن: | edsair.doi.dedup.....9f05ef057464aefc5106fcc0d84398b2 |
| قاعدة البيانات: | OpenAIRE |
| الوصف غير متاح. |