The Coding Stages Assessment: development and validation of an instrument for assessing young children’s proficiency in the ScratchJr programming language

IF 3 Q1 EDUCATION & EDUCATIONAL RESEARCH
Laura E. de Ruiter, M. Bers
{"title":"The Coding Stages Assessment: development and validation of an instrument for assessing young children’s proficiency in the ScratchJr programming language","authors":"Laura E. de Ruiter, M. Bers","doi":"10.1080/08993408.2021.1956216","DOIUrl":null,"url":null,"abstract":"ABSTRACT Background and Context Despite the increasing implementation of coding in early curricula, there are few valid and reliable assessments of coding abilities for young children. This impedes studying learning outcomes and the development and evaluation of curricula. Objective Developing and validating a new instrument for assessing young children’s proficiency in the programming language ScratchJr, based on the Coding Stages framework. Method We used an iterative, design-based research approach to develop the Coding Stages Assessment (CSA), a one-on-one assessment capturing children’s technical skills and expressivity. We tested 118 five-to-eight-year-olds and used Classical Test Theory and Item Response Theory to evaluate the assessment’s psychometric properties. Findings The CSA has good to very good reliability. CSA scores were correlated with computational thinking ability, demonstrating construct validity. The items have good discrimination levels, and a variety of difficulty levels to capture different proficiency levels. Younger children tended to have lower scores, but even first graders can achieve the highest coding stage. There was no evidence of gender or age bias. Implications The CSA allows testing learning theories and curricula, which supports the implementation of Computer Science as a school subject. The successful remote administration demonstrates that it can be used without geographical restrictions.","PeriodicalId":45844,"journal":{"name":"Computer Science Education","volume":"32 1","pages":"388 - 417"},"PeriodicalIF":3.0000,"publicationDate":"2021-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/08993408.2021.1956216","citationCount":"17","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Science Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/08993408.2021.1956216","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 17

Abstract

ABSTRACT Background and Context Despite the increasing implementation of coding in early curricula, there are few valid and reliable assessments of coding abilities for young children. This impedes studying learning outcomes and the development and evaluation of curricula. Objective Developing and validating a new instrument for assessing young children’s proficiency in the programming language ScratchJr, based on the Coding Stages framework. Method We used an iterative, design-based research approach to develop the Coding Stages Assessment (CSA), a one-on-one assessment capturing children’s technical skills and expressivity. We tested 118 five-to-eight-year-olds and used Classical Test Theory and Item Response Theory to evaluate the assessment’s psychometric properties. Findings The CSA has good to very good reliability. CSA scores were correlated with computational thinking ability, demonstrating construct validity. The items have good discrimination levels, and a variety of difficulty levels to capture different proficiency levels. Younger children tended to have lower scores, but even first graders can achieve the highest coding stage. There was no evidence of gender or age bias. Implications The CSA allows testing learning theories and curricula, which supports the implementation of Computer Science as a school subject. The successful remote administration demonstrates that it can be used without geographical restrictions.
编码阶段评估:开发和验证一种工具,用于评估幼儿对ScratchJr编程语言的熟练程度
摘要背景和背景尽管编码在早期课程中的应用越来越多,但对幼儿编码能力的有效和可靠评估却很少。这阻碍了学习成果的研究以及课程的制定和评估。目的基于编码阶段框架,开发并验证一种新的评估幼儿编程语言ScratchJr熟练程度的工具。方法我们使用迭代的、基于设计的研究方法来开发编码阶段评估(CSA),这是一种一对一的评估,捕捉儿童的技术技能和表达能力。我们测试了118名5至8岁的儿童,并使用经典测试理论和项目反应理论来评估评估的心理测量特性。调查结果CSA具有良好到非常好的可靠性。CSA得分与计算思维能力相关,证明了结构的有效性。这些项目具有良好的辨别能力,并有各种难度级别来捕捉不同的熟练程度。年龄较小的孩子往往得分较低,但即使是一年级学生也能达到最高的编码阶段。没有证据表明存在性别或年龄偏见。含义CSA允许测试学习理论和课程,这支持将计算机科学作为一门学校科目的实施。成功的远程管理表明,它可以在没有地域限制的情况下使用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computer Science Education
Computer Science Education EDUCATION & EDUCATIONAL RESEARCH-
CiteScore
6.90
自引率
3.70%
发文量
23
期刊介绍: Computer Science Education publishes high-quality papers with a specific focus on teaching and learning within the computing discipline. The journal seeks novel contributions that are accessible and of interest to researchers and practitioners alike. We invite work with learners of all ages and across both classroom and out-of-classroom learning contexts.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信