Language Assessment Quarterly最新文献

筛选
英文 中文
Test Review: LanguageCert IESOL B1 (Achiever) SELT 考试回顾:LanguageCert IESOL B1(成就者)SELT
IF 2.9 2区 文学
Language Assessment Quarterly Pub Date : 2022-07-28 DOI: 10.1080/15434303.2022.2103420
William S. Pearson
{"title":"Test Review: LanguageCert IESOL B1 (Achiever) SELT","authors":"William S. Pearson","doi":"10.1080/15434303.2022.2103420","DOIUrl":"https://doi.org/10.1080/15434303.2022.2103420","url":null,"abstract":"ABSTRACT The present article reviews LanguageCert’s International English for Speakers of Other Languages (IESOL) Achiever Secure English Language Test (SELT). This high-stakes on-demand CEFR-linked exam has, since 2020, constituted Home Office-recognised evidence L2 English users can speak, write, and understand written and verbal English at B1 level. Passing the test facilitates enrolment onto a foundation or pre-sessional English course at a UK higher education institution, although some institutions set higher standards. As a neophyte SELT, there have been few descriptions and evaluations of the test beyond a range of sponsored studies. The current review indicated the Achiever test measures candidates’ general abilities to understand, interact, and produce tasks that mirror real life. However, a lack of ‘academicness’ and validity concerns in listening raise questions over its suitability for predicting readiness for tertiary study. The test offers the benefits of efficiency in registration and communicating results, remote proctoring and invigilation, and numerous sample materials in the public domain. The provision of an innovative re-sit option may prove favourable to candidates, although could encourage repeat test taking and attempts to pass by a narrow margin, rather than investments in language learning.","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":"19 1","pages":"526 - 537"},"PeriodicalIF":2.9,"publicationDate":"2022-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42431282","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating Fairness and Justice of External English Language Test Score Interpretation and Use for Japanese University Admission 评价日本大学对外英语考试成绩解释与使用的公平性与正义性
IF 2.9 2区 文学
Language Assessment Quarterly Pub Date : 2022-07-27 DOI: 10.1080/15434303.2022.2083965
H. Saito, Yasuyo Sawaki, Kiwamu Kasahara
{"title":"Evaluating Fairness and Justice of External English Language Test Score Interpretation and Use for Japanese University Admission","authors":"H. Saito, Yasuyo Sawaki, Kiwamu Kasahara","doi":"10.1080/15434303.2022.2083965","DOIUrl":"https://doi.org/10.1080/15434303.2022.2083965","url":null,"abstract":"ABSTRACT The study evaluated a recently postponed national test policy on the use of external agencies’ English tests measuring four skills for Japanese university admission purposes. Using Kunnan’s principles of fairness and justice, we generated and evaluated three claims regarding the test policy: vocabulary coverage of the tests, the justifiability of the Common European Framework of References for Languages (CEFR)-based concordance table, and tests’ impact on teaching and learning productive skills. Scrutinizing the backing and rebuttal evidence from the test agencies’ voices to the key literature, we arrived at a partial acceptance of all three claims with the need for further research, calling into question a optimistic outlook underlying the test policy.","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":"19 1","pages":"422 - 448"},"PeriodicalIF":2.9,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43794625","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessing Speaking in Context: Expanding the Construct and its Applications 语境中的口语评估:结构的拓展及其应用
IF 2.9 2区 文学
Language Assessment Quarterly Pub Date : 2022-07-03 DOI: 10.1080/15434303.2022.2095913
Nichola Glasson
{"title":"Assessing Speaking in Context: Expanding the Construct and its Applications","authors":"Nichola Glasson","doi":"10.1080/15434303.2022.2095913","DOIUrl":"https://doi.org/10.1080/15434303.2022.2095913","url":null,"abstract":"By reviewing the key features of the theoretical underpinnings of existing assessment frameworks","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":"20 1","pages":"245 - 249"},"PeriodicalIF":2.9,"publicationDate":"2022-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47967678","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Prof Liz Hamp-Lyons (1946–2022) 利兹·汉普-莱昂斯教授(1946-2022)
IF 2.9 2区 文学
Language Assessment Quarterly Pub Date : 2022-06-20 DOI: 10.1080/15434303.2022.2085573
E. Bruce, A. Green
{"title":"Prof Liz Hamp-Lyons (1946–2022)","authors":"E. Bruce, A. Green","doi":"10.1080/15434303.2022.2085573","DOIUrl":"https://doi.org/10.1080/15434303.2022.2085573","url":null,"abstract":"","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":"19 1","pages":"341 - 342"},"PeriodicalIF":2.9,"publicationDate":"2022-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43973120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An Investigation of the Impact of Jagged Profile on L2 Speaking Test Ratings: Evidence from Rating and Eye-tracking Data 锯齿形轮廓对二语口语测试评分影响的研究:来自评分和眼动数据的证据
IF 2.9 2区 文学
Language Assessment Quarterly Pub Date : 2022-06-12 DOI: 10.1080/15434303.2022.2078720
Wenyue Ma, Paula M. Winke
{"title":"An Investigation of the Impact of Jagged Profile on L2 Speaking Test Ratings: Evidence from Rating and Eye-tracking Data","authors":"Wenyue Ma, Paula M. Winke","doi":"10.1080/15434303.2022.2078720","DOIUrl":"https://doi.org/10.1080/15434303.2022.2078720","url":null,"abstract":"ABSTRACT The factors that influence rater scoring have been a subject of great interest to researchers in second language assessment. However, the research on the impact of test-takers’ speech profiles (e.g., a jagged or a flat profile reflecting analytic subscores) on raters’ scoring behaviors remains to be seen. To investigate the role of speech profiles in scoring, we collected analytic and holistic rating scores from 28 trained raters while they were marking the performances of three groups of speakers with distinct profiles, determined by prior ratings. We tracked eleven of the raters’ eye-movements to record how often and how long they looked at the various categories on the rating scales. We found that the raters perceived speakers who have better pronunciation as overall more competent speakers. Meanwhile, speakers’ score profiles influenced raters’ attention: raters fixated longer and more often, and made more eye-visits, to the lexical grammar category while assessing speakers with a jagged profile. Raters spent less time assessing the pronunciation of the speakers who were pre-identified as having better pronunciation. The findings shed light on the impact of speech characteristics on raters’ cognition and score assignments and therefore have important implications for rater training in L2 speaking assessments.","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":"19 1","pages":"394 - 421"},"PeriodicalIF":2.9,"publicationDate":"2022-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45956640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
The Fluctuating Effect of Thinking on Language Performance: New Evidence for the Island Ridge Curve 思维对语言表现的波动效应:岛脊曲线的新证据
IF 2.9 2区 文学
Language Assessment Quarterly Pub Date : 2022-06-12 DOI: 10.1080/15434303.2022.2080553
Yuyang Cai, Huilin Chen
{"title":"The Fluctuating Effect of Thinking on Language Performance: New Evidence for the Island Ridge Curve","authors":"Yuyang Cai, Huilin Chen","doi":"10.1080/15434303.2022.2080553","DOIUrl":"https://doi.org/10.1080/15434303.2022.2080553","url":null,"abstract":"ABSTRACT Thinking skills play a critical role in determining language performance. Recent advancement in cognitive diagnostic modelling (CDM) provides a powerful tool for obtaining fine-grained information regarding these thinking skills during reading. Studies are scant, however, exploring the relations between thinking skills and language performance, not to mention studies examining the variation of this association with language proficiency. The current study explored this variation through the lens of the Island Ridge Curve (IRC). Drawing on an English reading test data by 2,285 students, we identified five thinking skills using CDM. Next, we followed guidelines of IRC and put students into four language proficiency groups to examine the relations of each skill identified through reading tasks to language performance across groups. Results of multi-group path analysis showed the effect of each skill identified through reading test fluctuated in the pattern of the IRC. The potential of IRC for examining the moderation of language proficiency on language factors is discussed.","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":"19 1","pages":"465 - 479"},"PeriodicalIF":2.9,"publicationDate":"2022-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42567040","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Investigating the Effects of Task Type and Linguistic Background on Accuracy in Automated Speech Recognition Systems: Implications for Use in Language Assessment of Young Learners 研究任务类型和语言背景对自动语音识别系统准确性的影响:对年轻学习者语言评估的启示
IF 2.9 2区 文学
Language Assessment Quarterly Pub Date : 2022-03-27 DOI: 10.1080/15434303.2022.2038172
L. Hannah, H. Kim, E. Jang
{"title":"Investigating the Effects of Task Type and Linguistic Background on Accuracy in Automated Speech Recognition Systems: Implications for Use in Language Assessment of Young Learners","authors":"L. Hannah, H. Kim, E. Jang","doi":"10.1080/15434303.2022.2038172","DOIUrl":"https://doi.org/10.1080/15434303.2022.2038172","url":null,"abstract":"ABSTRACT As a branch of artificial intelligence, automated speech recognition (ASR) technology is increasingly used to detect speech, process it to text, and derive the meaning of natural language for various learning and assessment purposes. ASR inaccuracy may pose serious threats to valid score interpretations and fair score use for all when it is exacerbated by test takers’ characteristics, such as language background and accent, and assessment task type. The present study investigated the extent to which speech-to-text accuracy rates of three major ASR systems vary across different oral tasks and students’ language background variables. Results indicate that task types and students’ language backgrounds have statistically significant main and interaction effects on ASR accuracy. The paper discusses the implications of the study results for applying ASR to computerized assessment design and automated scoring.","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":"19 1","pages":"289 - 313"},"PeriodicalIF":2.9,"publicationDate":"2022-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45194954","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Application of Bi-factor MIRT and Higher-order CDM Models to an In-house EFL Listening Test for Diagnostic Purposes 双因素MIRT和高阶CDM模型在诊断性英语听力测试中的应用
IF 2.9 2区 文学
Language Assessment Quarterly Pub Date : 2022-03-15 DOI: 10.1080/15434303.2021.1980571
Shangchao Min, Hongwen Cai, Lianzhen He
{"title":"Application of Bi-factor MIRT and Higher-order CDM Models to an In-house EFL Listening Test for Diagnostic Purposes","authors":"Shangchao Min, Hongwen Cai, Lianzhen He","doi":"10.1080/15434303.2021.1980571","DOIUrl":"https://doi.org/10.1080/15434303.2021.1980571","url":null,"abstract":"ABSTRACT The present study examined the performance of the bi-factor multidimensional item response theory (MIRT) model and higher-order (HO) cognitive diagnostic models (CDM) in providing diagnostic information and general ability estimation simultaneously in a listening test. The data used were 1,611 examinees’ item-level responses to an in-house EFL listening test in China and five content experts’ item-attribute coding results of the test form. The bi-factor MIRT model was compared with five CDMs with and without a higher-order structure in terms of model fit, attribute classification and general ability estimation. The results showed that the bi-factor MIRT model provided the best model-data fit, followed by the HO-G-DINA model, the saturated G-DINA model, and other reduced CDMs. The HO-G-DINA model produced attribute classification results more similar to the G-DINA model, whereas the bi-factor MIRT model offered better results in discriminating examinees’ general listening ability. The findings of this study highlighted the feasibility of using the bi-factor MIRT model as an attractive alternative for diagnostic assessment, especially in language assessment where attributes are assumed to be continuous.","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":"19 1","pages":"189 - 213"},"PeriodicalIF":2.9,"publicationDate":"2022-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45134984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Classroom-Based Formative Assessment 基于课堂的形成性评估
IF 2.9 2区 文学
Language Assessment Quarterly Pub Date : 2022-03-14 DOI: 10.1080/15434303.2022.2050729
Chunqing Zhang, Liping Liu
{"title":"Classroom-Based Formative Assessment","authors":"Chunqing Zhang, Liping Liu","doi":"10.1080/15434303.2022.2050729","DOIUrl":"https://doi.org/10.1080/15434303.2022.2050729","url":null,"abstract":"","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":"20 1","pages":"240 - 244"},"PeriodicalIF":2.9,"publicationDate":"2022-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48985232","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Promoting Change in Language Teaching and Assessment at Policy and Practice Levels: An Interview with Hossein Farhady 在政策和实践层面促进语言教学和评估的变革——侯赛因·法哈迪访谈录
IF 2.9 2区 文学
Language Assessment Quarterly Pub Date : 2022-03-12 DOI: 10.1080/15434303.2022.2038173
P. Tavakoli
{"title":"Promoting Change in Language Teaching and Assessment at Policy and Practice Levels: An Interview with Hossein Farhady","authors":"P. Tavakoli","doi":"10.1080/15434303.2022.2038173","DOIUrl":"https://doi.org/10.1080/15434303.2022.2038173","url":null,"abstract":"ABSTRACT This interview highlights Professor Hossein Farhady’s academic life and his sustained contribution to research in the fields of English Language teaching, language testing and ESP over the past decades. Through a number of questions, the interview asks Professor Farhady about his pioneering role in the field of language testing in Iran and his highly valued contribution to issues related to English language teaching and material design. The interview takes the shape of a narrative about Professor Farhady’s past from early days of schooling in a village near Makou in Iran to his PhD studies at UCLA in California and his post-PhD research career in different countries around the globe. The interview summarises his accomplishment in leading research projects, disseminating research outputs, and training new teachers, researchers and language test and material designers. It also provides an interesting portrait of his vision for the field which is based on his experience of working in various higher education contexts over the past decades. Most importantly, the interview demonstrates Professor Farhady’s commitment to research and his dedication to translating research findings to action and bringing change about in policy and professional practice. Above all, the interview is a recognition of his lifetime achievements and an acknowledgement of his dedication, diligence and devotion to research in applied linguistics.","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":"19 1","pages":"449 - 464"},"PeriodicalIF":2.9,"publicationDate":"2022-03-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45897494","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信