تقرير
Adapting an ASR Foundation Model for Spoken Language Assessment
| العنوان: | Adapting an ASR Foundation Model for Spoken Language Assessment |
|---|---|
| المؤلفون: | Ma, Rao, Qian, Mengjie, Gales, Mark J. F., Knill, Kate M. |
| سنة النشر: | 2023 |
| المجموعة: | Computer Science |
| مصطلحات موضوعية: | Computer Science - Computation and Language, Computer Science - Sound, Electrical Engineering and Systems Science - Audio and Speech Processing |
| الوصف: | A crucial part of an accurate and reliable spoken language assessment system is the underlying ASR model. Recently, large-scale pre-trained ASR foundation models such as Whisper have been made available. As the output of these models is designed to be human readable, punctuation is added, numbers are presented in Arabic numeric form and abbreviations are included. Additionally, these models have a tendency to skip disfluencies and hesitations in the output. Though useful for readability, these attributes are not helpful for assessing the ability of a candidate and providing feedback. Here a precise transcription of what a candidate said is needed. In this paper, we give a detailed analysis of Whisper outputs and propose two solutions: fine-tuning and soft prompt tuning. Experiments are conducted on both public speech corpora and an English learner dataset. Results show that we can effectively alter the decoding behaviour of Whisper to generate the exact words spoken in the response. Comment: Proceedings of SLaTE |
| نوع الوثيقة: | Working Paper |
| DOI: | 10.21437/SLaTE.2023-20 |
| URL الوصول: | http://arxiv.org/abs/2307.09378 |
| رقم الأكسشن: | edsarx.2307.09378 |
| قاعدة البيانات: | arXiv |
| DOI: | 10.21437/SLaTE.2023-20 |
|---|