Fine-Tuning-Free English Pronunciation Assessment System Using Multimodal Large Language Models

서지정보

· 발행기관 : 한국외국어대학교 외국어교육연구소
· 수록지 정보 : 외국어교육연구 / 38권 / 4호 / 25 ~ 38페이지
· 저자명 : 안태경, 남호성

초록

This study explores the performance and characteristics of Multimodal Large Language Models (MLLMs) in evaluating the English pronunciation of Korean speakers. While advancements in AI have enabled the development of various pronunciation assessment models with minimal data and fine-tuning, the limitation of requiring well-curated training data for specific purposes persisted. However, pre-trained Multimodal Large Language Models (MLLMs) have demonstrated the ability to perform tasks based on human instructions without additional training. This research investigates the effectiveness of using pre-trained MLLMs for pronunciation assessment without fine-tuning, comparing their evaluation results with those of human raters using the Pearson Correlation Coefficient (PCC). The results showed a high correlation of 0.798 for prosody scores, while articulation scores exhibited a lower correlation of 0.45. Despite scoring discrepancies between model and human raters, this study proposes a novel approach to pronunciation assessment without additional training, suggesting the potential for MLLMs to be widely applied as automated speaking assessment systems. These findings contribute to the growing body of research on AI-assisted language assessment and open new avenues for developing more efficient and adaptable pronunciation evaluation tools.

참고자료

· 없음