小学儿童程序设计概念理解的计算机自适应评估

IF 3 Q1 EDUCATION & EDUCATIONAL RESEARCH
S. Hogenboom, F. Hermans, H.L.J. van der Maas
{"title":"小学儿童程序设计概念理解的计算机自适应评估","authors":"S. Hogenboom, F. Hermans, H.L.J. van der Maas","doi":"10.1080/08993408.2021.1914461","DOIUrl":null,"url":null,"abstract":"ABSTRACT Background and Context Valid assessment of understanding of programming concepts in primary school children is essential to implement and improve programming education. Objective: We developed and validated the Computerized Adaptive Programming Concepts Test (CAPCT) with a novel application of Item Response Theory. The CAPCT is a web-based and resource-efficient adaptive assessment of 4489 questions measuring: the understanding of basic sequences, loops, conditions (if & if-else statements), debugging, multiple agents, procedures, and the ability to generalize to a new syntax. Method: Data was collected through an existing online adaptive practice and monitoring system called Math Garden. We collected 14 million responses from 93,341 Dutch children (ages 4 - 13). Findings: The CAPCT demonstrated good psychometric qualities because 75% of the variance in question difficulty was explained by differences in item characteristics. The CAPCT demonstrated robustness against adding new participants and adding new items. Differences in player ability (i.e., understanding of CS concepts) were due to differences in age, gender, the number of items played, and prior mathematical ability. Implications: The CAPCT may be used by teachers to identify the level of programming concept understanding of their pupils, while researchers may use the CAPCT to construct and validate effective teaching resources.","PeriodicalId":45844,"journal":{"name":"Computer Science Education","volume":"32 1","pages":"418 - 448"},"PeriodicalIF":3.0000,"publicationDate":"2021-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/08993408.2021.1914461","citationCount":"5","resultStr":"{\"title\":\"Computerized adaptive assessment of understanding of programming concepts in primary school children\",\"authors\":\"S. Hogenboom, F. Hermans, H.L.J. van der Maas\",\"doi\":\"10.1080/08993408.2021.1914461\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"ABSTRACT Background and Context Valid assessment of understanding of programming concepts in primary school children is essential to implement and improve programming education. Objective: We developed and validated the Computerized Adaptive Programming Concepts Test (CAPCT) with a novel application of Item Response Theory. The CAPCT is a web-based and resource-efficient adaptive assessment of 4489 questions measuring: the understanding of basic sequences, loops, conditions (if & if-else statements), debugging, multiple agents, procedures, and the ability to generalize to a new syntax. Method: Data was collected through an existing online adaptive practice and monitoring system called Math Garden. We collected 14 million responses from 93,341 Dutch children (ages 4 - 13). Findings: The CAPCT demonstrated good psychometric qualities because 75% of the variance in question difficulty was explained by differences in item characteristics. The CAPCT demonstrated robustness against adding new participants and adding new items. Differences in player ability (i.e., understanding of CS concepts) were due to differences in age, gender, the number of items played, and prior mathematical ability. Implications: The CAPCT may be used by teachers to identify the level of programming concept understanding of their pupils, while researchers may use the CAPCT to construct and validate effective teaching resources.\",\"PeriodicalId\":45844,\"journal\":{\"name\":\"Computer Science Education\",\"volume\":\"32 1\",\"pages\":\"418 - 448\"},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2021-04-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://sci-hub-pdf.com/10.1080/08993408.2021.1914461\",\"citationCount\":\"5\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computer Science Education\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1080/08993408.2021.1914461\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Science Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/08993408.2021.1914461","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 5

摘要

背景与背景有效评估小学生对程序设计概念的理解是实施和改进程序设计教育的必要条件。目的:利用项目反应理论的新应用,开发并验证计算机自适应规划概念测验(CAPCT)。CAPCT是一个基于web的、资源高效的4489个问题的自适应评估,测量:对基本序列、循环、条件(if & if-else语句)、调试、多个代理、过程以及泛化到新语法的能力的理解。方法:通过现有的在线自适应实践和监测系统“数学花园”收集数据。我们从93341名荷兰儿童(4 - 13岁)中收集了1400万份回复。结果:CAPCT表现出良好的心理测量质量,因为75%的问题难度差异可以用项目特征的差异来解释。CAPCT显示了对添加新参与者和添加新项目的鲁棒性。玩家能力的差异(如对CS概念的理解)是由于年龄、性别、所玩道具的数量和先前的数学能力的差异。含义:教师可以使用CAPCT来确定学生对编程概念的理解水平,而研究人员可以使用CAPCT来构建和验证有效的教学资源。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Computerized adaptive assessment of understanding of programming concepts in primary school children
ABSTRACT Background and Context Valid assessment of understanding of programming concepts in primary school children is essential to implement and improve programming education. Objective: We developed and validated the Computerized Adaptive Programming Concepts Test (CAPCT) with a novel application of Item Response Theory. The CAPCT is a web-based and resource-efficient adaptive assessment of 4489 questions measuring: the understanding of basic sequences, loops, conditions (if & if-else statements), debugging, multiple agents, procedures, and the ability to generalize to a new syntax. Method: Data was collected through an existing online adaptive practice and monitoring system called Math Garden. We collected 14 million responses from 93,341 Dutch children (ages 4 - 13). Findings: The CAPCT demonstrated good psychometric qualities because 75% of the variance in question difficulty was explained by differences in item characteristics. The CAPCT demonstrated robustness against adding new participants and adding new items. Differences in player ability (i.e., understanding of CS concepts) were due to differences in age, gender, the number of items played, and prior mathematical ability. Implications: The CAPCT may be used by teachers to identify the level of programming concept understanding of their pupils, while researchers may use the CAPCT to construct and validate effective teaching resources.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Computer Science Education
Computer Science Education EDUCATION & EDUCATIONAL RESEARCH-
CiteScore
6.90
自引率
3.70%
发文量
23
期刊介绍: Computer Science Education publishes high-quality papers with a specific focus on teaching and learning within the computing discipline. The journal seeks novel contributions that are accessible and of interest to researchers and practitioners alike. We invite work with learners of all ages and across both classroom and out-of-classroom learning contexts.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信