التفاصيل البيبلوغرافية
| العنوان: |
RAGA CLASSIFICATION FROM VOCAL PERFORMANCES USING MULTIMODAL ANALYSIS. |
| المؤلفون: |
Clayton, Martin, Rao, Preeti, Shikarpur, Nithya, Roychowdhury, Sujoy, Jin Li |
| المصدر: |
International Society for Music Information Retrieval Conference Proceedings; 2022, p283-290, 8p |
| مصطلحات موضوعية: |
MUSICAL performance, RAGAS, MUSIC data processing, MUSICAL analysis, MUSICAL interpretation |
| مستخلص: |
Work on musical gesture and embodied cognition suggests a rich complementarity between audio and movement information in musical performance. Pose estimation algorithms now make it possible (in contrast to traditional Motion Capture) to collect rich movement information from unconstrained performances of indefinite length. Vocal performances of Indian art music offer the opportunity to carry out multimodal analysis using this information, combining musician’s body movements (i.e. pose and gesture data) with audio features. In this work we investigate raga identification from 12 s excerpts from a dataset of 3 singers and 9 ragas using the combination of audio and visual representations that are each semantically salient on their own. While gesture based classification is relatively weak by itself, we show that combining latent representations from the pre-trained unimodal networks can surpass the already high performance obtained by audio features. [ABSTRACT FROM AUTHOR] |
|
Copyright of International Society for Music Information Retrieval Conference Proceedings is the property of Ubiquity Press and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) |
| قاعدة البيانات: |
Complementary Index |
