Kevin Hirschi, Okim Kang, Mu Yang, John H. L. Hansen, Kyle Beloin
{"title":"人工智能生成的反馈对第二语言可理解性的影响和感知的探索性干预研究","authors":"Kevin Hirschi, Okim Kang, Mu Yang, John H. L. Hansen, Kyle Beloin","doi":"10.1111/lang.12719","DOIUrl":null,"url":null,"abstract":"This study investigated the use of Artificial Intelligence (AI) models and signal detection processes to generate meaningful visual and ChatGPT‐like narrative feedback on second language (L2) English intelligibility. To test the effects and perceptions of such techniques, three groups of learners (<jats:italic>N</jats:italic> = 90) received visual and narrative feedback (<jats:italic>n</jats:italic> = 30), visual‐only feedback (<jats:italic>n</jats:italic> = 29), and no feedback (<jats:italic>n</jats:italic> = 31) in an online self‐paced intervention with explicit instruction on segmental and suprasegmental features of intelligibility. Pre/postspeaking tasks were evaluated by raters for intelligibility, comprehensibility, and accentedness, as well as segmental and suprasegmental accuracy, in scripted and spontaneous speech. The results indicate that visual feedback improves prominence production, but only those participants who also received the narrative (i.e., ChatGPT) feedback improved in two of the three prosodic features and in intelligibility. However, those who received narrative feedback had the lowest perceptions of the practice activity helpfulness. Implications for the use and improvement of AI‐based pronunciation feedback are provided.","PeriodicalId":51371,"journal":{"name":"Language Learning","volume":"57 1","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2025-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Artificial Intelligence‐Generated Feedback for Second Language Intelligibility: An Exploratory Intervention Study on Effects and Perceptions\",\"authors\":\"Kevin Hirschi, Okim Kang, Mu Yang, John H. L. Hansen, Kyle Beloin\",\"doi\":\"10.1111/lang.12719\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This study investigated the use of Artificial Intelligence (AI) models and signal detection processes to generate meaningful visual and ChatGPT‐like narrative feedback on second language (L2) English intelligibility. To test the effects and perceptions of such techniques, three groups of learners (<jats:italic>N</jats:italic> = 90) received visual and narrative feedback (<jats:italic>n</jats:italic> = 30), visual‐only feedback (<jats:italic>n</jats:italic> = 29), and no feedback (<jats:italic>n</jats:italic> = 31) in an online self‐paced intervention with explicit instruction on segmental and suprasegmental features of intelligibility. Pre/postspeaking tasks were evaluated by raters for intelligibility, comprehensibility, and accentedness, as well as segmental and suprasegmental accuracy, in scripted and spontaneous speech. The results indicate that visual feedback improves prominence production, but only those participants who also received the narrative (i.e., ChatGPT) feedback improved in two of the three prosodic features and in intelligibility. However, those who received narrative feedback had the lowest perceptions of the practice activity helpfulness. Implications for the use and improvement of AI‐based pronunciation feedback are provided.\",\"PeriodicalId\":51371,\"journal\":{\"name\":\"Language Learning\",\"volume\":\"57 1\",\"pages\":\"\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2025-05-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Language Learning\",\"FirstCategoryId\":\"98\",\"ListUrlMain\":\"https://doi.org/10.1111/lang.12719\",\"RegionNum\":1,\"RegionCategory\":\"文学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Language Learning","FirstCategoryId":"98","ListUrlMain":"https://doi.org/10.1111/lang.12719","RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
Artificial Intelligence‐Generated Feedback for Second Language Intelligibility: An Exploratory Intervention Study on Effects and Perceptions
This study investigated the use of Artificial Intelligence (AI) models and signal detection processes to generate meaningful visual and ChatGPT‐like narrative feedback on second language (L2) English intelligibility. To test the effects and perceptions of such techniques, three groups of learners (N = 90) received visual and narrative feedback (n = 30), visual‐only feedback (n = 29), and no feedback (n = 31) in an online self‐paced intervention with explicit instruction on segmental and suprasegmental features of intelligibility. Pre/postspeaking tasks were evaluated by raters for intelligibility, comprehensibility, and accentedness, as well as segmental and suprasegmental accuracy, in scripted and spontaneous speech. The results indicate that visual feedback improves prominence production, but only those participants who also received the narrative (i.e., ChatGPT) feedback improved in two of the three prosodic features and in intelligibility. However, those who received narrative feedback had the lowest perceptions of the practice activity helpfulness. Implications for the use and improvement of AI‐based pronunciation feedback are provided.
期刊介绍:
Language Learning is a scientific journal dedicated to the understanding of language learning broadly defined. It publishes research articles that systematically apply methods of inquiry from disciplines including psychology, linguistics, cognitive science, educational inquiry, neuroscience, ethnography, sociolinguistics, sociology, and anthropology. It is concerned with fundamental theoretical issues in language learning such as child, second, and foreign language acquisition, language education, bilingualism, literacy, language representation in mind and brain, culture, cognition, pragmatics, and intergroup relations. A subscription includes one or two annual supplements, alternating among a volume from the Language Learning Cognitive Neuroscience Series, the Currents in Language Learning Series or the Language Learning Special Issue Series.