Project: FIN-CLARIAH
Grant agreement: Academy of Finland no. 345610
Start date: 01-01-2022
Duration: 24 months
WP 2.2: Report on Speech recognition for L2
Date of reporting: 2023-11
Report author: Yaroslav Getman (Aalto University)
Contributors: Getman, Y., Phan, N., Al-Ghezi, R., Voskoboinik, E., Singh, M., Grosz, T., Clara, A., Kurimo, M. (Aalto University); Salvi, G., Svendsen, T. (Norwegian University of Science and Technology); Strömbergsson, S. (Karolinska Institutet); Smolander, A., Ylinen, S. (Tampere University); von Zansen, A., Hilden, R., Linden, K. (University of Helsinki); Kallio, H., Kuronen, M., Huhta, A., Kronholm, S. (University of Jyväskylä)
Deliverable location: Aalto Speech Research | Multi-task wav2vec2
Systems trained to perform automatic speech recognition (ASR) and pronunciation rating for child L2 Finnish are available on HuggingFace Hub. The links to the models are collected on this GitHub page and the methods are described in [1] and [2].
ASR systems for L2 learners of Finnish are described in [3] and [4]. The scripts used to train the models are available on this GitHub page and the data will be released in Kielipankki here and here.
[1] Getman, Y., Al-Ghezi, R., Grosz, T., Kurimo, M. (2023) Multi-task wav2vec2 Serving as a Pronunciation Training System for Children. Proc. 9th Workshop on Speech and Language Technology in Education (SLaTE), 36-40, doi: 10.21437/SLaTE.2023-8
[2] Getman, Y., Phan, N., Al-Ghezi, R., Voskoboinik, E., Singh, M., Grosz, T., Kurimo, M., Salvi, G., Svendsen, T., Strömbergsson, S., Smolander, A., Ylinen, S. (2023) Developing an AI-Assisted Low-Resource Spoken Language Learning App for Children. IEEE Access, vol. 11, pp. 86025-86037, 2023, doi: 10.1109/ACCESS.2023.3304274
[3] Kurimo, M., Getman, Y., Voskoboinik, E., Al-Ghezi, R., Kallio, H., Kuronen, M., von Zansen, A., Hilden, R., Kronholm, S., Huhta, A., Linden, K. (2023) New data, benchmark and baseline for L2 speaking assessment for low-resource languages. Proc. 9th Workshop on Speech and Language Technology in Education (SLaTE), 166-170, doi: 10.21437/SLaTE.2023-32
[4] Al-Ghezi, R., Voskoboinik, K., Getman, Y., von Zansen, A., Kallio, H., Clara, A., Kuronen, M., Huhta, A., Hilden, R. (in review) Automatic speaking assessment of Spontaneus L2 Finnish and Swedish. Language Assessment Quarterly.
