{"title":"Advancing Language Assessment with AI and ML- Leaning into AI is Inevitable, but Can Theory Keep Up?","authors":"Xiaoming Xi","doi":"10.1080/15434303.2023.2291488","DOIUrl":"https://doi.org/10.1080/15434303.2023.2291488","url":null,"abstract":"Following the burgeoning growth of artificial intelligence (AI) and machine learning (ML) applications in language assessment in recent years, the meteoric rise of ChatGPT and its sweeping applicat...","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138560495","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Test-Taker Engagement in AI Technology-Mediated Language Assessment","authors":"Yan Jin, Jason Fan","doi":"10.1080/15434303.2023.2291731","DOIUrl":"https://doi.org/10.1080/15434303.2023.2291731","url":null,"abstract":"In language assessment, AI technology has been incorporated in task design, assessment delivery, automated scoring of performance-based tasks, score reporting, and provision of feedback. AI technol...","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138560321","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"What Do the Measures of Utterance Fluency Employed in Automatic Speech Evaluation (ASE) Tell Us About Oral Proficiency?","authors":"Zoe L. Handley, Haiping Wang","doi":"10.1080/15434303.2023.2283839","DOIUrl":"https://doi.org/10.1080/15434303.2023.2283839","url":null,"abstract":"","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138588941","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Assessing Academic English for Higher Education Admissions","authors":"Dan Douglas","doi":"10.1080/15434303.2023.2290635","DOIUrl":"https://doi.org/10.1080/15434303.2023.2290635","url":null,"abstract":"Published in Language Assessment Quarterly (Ahead of Print, 2023)","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138547944","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Erik Voss, Sara T. Cushing, Gary J. Ockey, Xun Yan
{"title":"The Use of Assistive Technologies Including Generative AI by Test Takers in Language Assessment: A Debate of Theory and Practice","authors":"Erik Voss, Sara T. Cushing, Gary J. Ockey, Xun Yan","doi":"10.1080/15434303.2023.2288256","DOIUrl":"https://doi.org/10.1080/15434303.2023.2288256","url":null,"abstract":"Assistive writing tools that provide suggestions for word choice, sentence structure, and grammar correction are allowed as accommodations for students with learning disabilities on a case-by-case ...","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138560255","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Validity Arguments for Automated Essay Scoring of Young Students’ Writing Traits","authors":"L. Hannah, E. E. Jang, M. Shah, V. Gupta","doi":"10.1080/15434303.2023.2288253","DOIUrl":"https://doi.org/10.1080/15434303.2023.2288253","url":null,"abstract":"Machines have a long-demonstrated ability to find statistical relationships between qualities of texts and surface-level linguistic indicators of writing. More recently, unlocked by artificial inte...","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138518349","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Criticality of Implementing Principled Design When Using AI Technologies in Test Development","authors":"Brad Bolender, Charles Foster, Sara Vispoel","doi":"10.1080/15434303.2023.2288266","DOIUrl":"https://doi.org/10.1080/15434303.2023.2288266","url":null,"abstract":"Published in Language Assessment Quarterly (Ahead of Print, 2023)","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138518350","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Washback into an Ecosystem of Teaching, Learning and Testing within Asia and Beyond: An Interview with Liying Cheng","authors":"Alla Khan, Norhaslinda Hassan","doi":"10.1080/15434303.2023.2276917","DOIUrl":"https://doi.org/10.1080/15434303.2023.2276917","url":null,"abstract":"Click to increase image sizeClick to decrease image size Disclosure statementNo potential conflict of interest was reported by the author(s).Liying’s key publications on washbackMei, Y., & Cheng, L. (2019). Impact of a high-stakes test on education: Evidence from newspaperdata. Foreign Language Testing and Teaching 《外语测试与教学》, 1, 1–15.Zheng, Y., & Cheng, L. (2018). How does anxiety in foreign language classrooms and cognitivetests influence language performance? Language Testing in Asia, 8(13). https://doi.org/10.1186/s40468-018-0065-4Cheng, L., & Ma, J. (2015). “It puts us in our students’ shoes”: Listening to voices from teachercandidates on their test-taking experience. International Journal of Humanities and Social ScienceResearch, 1, 46–56.Song, X., Cheng, L., & Klinger, D. (2015). DIF investigation across groups of gender and academicbackground in a large-scale high-stakes language test. Papers in Language Testing and Assessment, 4(1), 97–124.Cheng, L., & Sun, Y. (2015). Interpreting the impact of the Ontario Secondary School Literacy Teston second language students within argument-based validation framework. Language AssessmentQuarterly, 12, 50–66. https://doi.org/10.1186/s40468-018-0065-4Cheng, L., Klinger, D., Fox, J., Doe, C., Jin, Y., & Wu, J. (2014). Motivation and test anxiety in testperformance across three testing contexts: The CAEL, CET and GEPT. TESOL Quarterly. 48(2),300–330. https://doi.org/10.1186/s40468-018-0065-4: 10.1002/tesq.105Mei, Y., & Cheng, L. (2014). Scoring fairness in large-scale high-stakes English language testing:An examination of the National Matriculation English Test. In Conium, D. (Ed.), Englishlanguage education and assessment: Recent developments in Hong Kong and Chinese mainland(pp.171–187). Singapore: Springer Science+Business Media. https://doi.org/10.1186/s40468-018-0065-4Sun, Y., & Cheng, L. (2013). Assessing second/foreign language competence using translation: Thecase of the College English Test in China. In Tsagari, D., & Floros, G. (Eds.), Translation in languageteaching and assessment (pp. 235–252). Newcastle upon Tyne: Cambridge Scholars Publishing.Cheng, L., Klinger, D., & Zheng, Y. (2013). Factors influencing ESL/ELD students’ performance onthe Ontario Secondary School Literacy Test. Foreign Language Testing and Teaching 《外语测试与教学》, 4, 26–41.DeLuca, C., Cheng, L., Fox, J., Doe, C., & Li, M. (2013). Putting testing researchers to the test: Anexploratory study on the TOEFL iBT. System, 41(3), 663–676.Jin, Y., & Cheng, L. (2013). The effects of psychological factors on the validity of high-stakes tests.Modern Foreign Languages 《现代外语》, 36(1), 62–69.Cheng, L., Andrews, S., & Yu, Y. (2011). Impact and consequences of school-based assessment inHong Kong: Views from students and their parents. Language Testing, 28, 221–250.Doe, C., Cheng, L., Fox, J., Klinger, D., & Zheng, Y. (2011). What has experience got to do with it? Anexploration of L1 and L2 OSSLT test takers’ feelings, perceptions of test perfor","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135042838","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ingela Holmström, Krister Schönström, Magnus Ryttervik
{"title":"Development of a Sign Repetition Task for Novice L2 Signers","authors":"Ingela Holmström, Krister Schönström, Magnus Ryttervik","doi":"10.1080/15434303.2023.2256320","DOIUrl":"https://doi.org/10.1080/15434303.2023.2256320","url":null,"abstract":"There is a lack of tests available for assessing sign language proficiency among L2 learners. We have therefore developed a sign repetition test, SignRepL2, with a specific focus on the phonological features of signs. This paper describes the two phases of developing this test. In the first phase, content was developed in the form of 50 items with sentence lengths between one and three signs. Then, when a period of teaching revealed a ceiling effect in the first version, a second version was developed with 40 items varying between one and four signs. Test scores revealed increasing proficiency in Swedish Sign Language during education, and that mouth actions have a lower degree of accuracy than manual parameters.","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136280481","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Assessing Interactional Competence: ICE versus a Human Partner","authors":"G. Ockey, E. Chukharev-Hudilainen, R. Hirch","doi":"10.1080/15434303.2023.2237486","DOIUrl":"https://doi.org/10.1080/15434303.2023.2237486","url":null,"abstract":"","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43012752","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}