COMPUTER ADAPTIVE LANGUAGE TESTING ACCORDING TO NATO STANAG 6001 REQUIREMENTS

IF 0.7 Q3 EDUCATION & EDUCATIONAL RESEARCH
Piotr Gawliczek, V. Krykun, N. Tarasenko, Maksym Tyshchenko, Oleksandr Shapran
{"title":"COMPUTER ADAPTIVE LANGUAGE TESTING ACCORDING TO NATO STANAG 6001 REQUIREMENTS","authors":"Piotr Gawliczek, V. Krykun, N. Tarasenko, Maksym Tyshchenko, Oleksandr Shapran","doi":"10.20535/2410-8286.225018","DOIUrl":null,"url":null,"abstract":"The article deals with the innovative, cutting age solution within the language testing realm, namely computer adaptive language testing (CALT) in accordance with the NATO Standardization Agreement 6001 (NATO STANAG 6001) requirements for further implementation in foreign language training of personnel of the Armed Forces of Ukraine (AF of Ukraine) in order to increase the quality of foreign language testing. The research provides the CALT method developed according to NATO STANAG 6001 requirements and the CALT algorithm that contains three blocks: “Starting point”, “Item selection algorithm”, “Scoring algorithm” and “Termination criterion”. The CALT algorithm has an adaptive ability, changing a complexity level, sequence and the number of items according to the answers of a test taker. The comparative analysis of the results of the CALT method piloting and the paper-and-pencil testing (PPT) in reading and listening according to the NATO STANAG 6001 requirements justifies the effectiveness of the three-level CALT method. It allows us to determine the following important benefits of CALT: test length reduction, control of measurement accuracy, objective assessment, improved test security, generation of a unique set of items, adaptive ability of the CALT algorithm, high motivation of the test takers, immediate score reporting and test results management. CALT is a qualitative and effective tool to determine test takers’ foreign language proficiency level in accordance with NATO STANAG 6001 requirements within the NATO Defence Educational Enhancement Programme. CALT acquires a special value and relevance in the context of the global COVID 19 pandemic.","PeriodicalId":43037,"journal":{"name":"Advanced Education","volume":"25 1","pages":""},"PeriodicalIF":0.7000,"publicationDate":"2021-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.20535/2410-8286.225018","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 3

Abstract

The article deals with the innovative, cutting age solution within the language testing realm, namely computer adaptive language testing (CALT) in accordance with the NATO Standardization Agreement 6001 (NATO STANAG 6001) requirements for further implementation in foreign language training of personnel of the Armed Forces of Ukraine (AF of Ukraine) in order to increase the quality of foreign language testing. The research provides the CALT method developed according to NATO STANAG 6001 requirements and the CALT algorithm that contains three blocks: “Starting point”, “Item selection algorithm”, “Scoring algorithm” and “Termination criterion”. The CALT algorithm has an adaptive ability, changing a complexity level, sequence and the number of items according to the answers of a test taker. The comparative analysis of the results of the CALT method piloting and the paper-and-pencil testing (PPT) in reading and listening according to the NATO STANAG 6001 requirements justifies the effectiveness of the three-level CALT method. It allows us to determine the following important benefits of CALT: test length reduction, control of measurement accuracy, objective assessment, improved test security, generation of a unique set of items, adaptive ability of the CALT algorithm, high motivation of the test takers, immediate score reporting and test results management. CALT is a qualitative and effective tool to determine test takers’ foreign language proficiency level in accordance with NATO STANAG 6001 requirements within the NATO Defence Educational Enhancement Programme. CALT acquires a special value and relevance in the context of the global COVID 19 pandemic.
根据北约标准6001要求进行计算机自适应语言测试
本文讨论了语言测试领域内的创新,削减年龄的解决方案,即计算机自适应语言测试(CALT),根据北约标准化协议6001(北约STANAG 6001)的要求,进一步实施乌克兰武装部队人员的外语培训,以提高外语测试的质量。本研究提供了根据NATO STANAG 6001要求开发的CALT方法,CALT算法包含“起始点”、“项目选择算法”、“评分算法”和“终止准则”三个模块。CALT算法具有自适应能力,可以根据考生的答案改变题目的复杂程度、顺序和数量。根据北大西洋公约(NATO) STANAG 6001的要求,将CALT方法试点和纸笔测试(PPT)在阅读和听力方面的结果进行对比分析,证明了三级CALT方法的有效性。它使我们能够确定CALT的以下重要好处:缩短考试长度,控制测量精度,客观评估,提高考试安全性,生成一组独特的项目,CALT算法的自适应能力,考生的高积极性,即时分数报告和考试结果管理。CALT是一种定性和有效的工具,根据北约国防教育增强计划中的北约STANAG 6001要求,确定考生的外语熟练程度。在全球COVID - 19大流行的背景下,CALT具有特殊的价值和相关性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Advanced Education
Advanced Education EDUCATION & EDUCATIONAL RESEARCH-
自引率
27.30%
发文量
0
审稿时长
8 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信