Markus Wolfgang Hermann Spitzer , Korbinian Moeller
{"title":"Performance increases in mathematics within an intelligent tutoring system during COVID-19 related school closures: a large-scale longitudinal evaluation","authors":"Markus Wolfgang Hermann Spitzer , Korbinian Moeller","doi":"10.1016/j.caeo.2024.100162","DOIUrl":"10.1016/j.caeo.2024.100162","url":null,"abstract":"<div><p>The closure of schools due to COVID-19 disrupted learning routines of thousands of students, resulting in reported performance decreases, especially among lower-performing students. However, some studies on students’ performance within intelligent tutoring systems (ITS) also found significant performance increases for times of school closures as compared to before. However, little is known about students’ longitudinal performance trajectories within ITS. Accordingly, we evaluated longitudinal data from German students (<em>n</em> ≈ 2,700 students; <em>n</em> ≈ 5 million problems) enrolled in an ITS for learning mathematics from January 2017 until the end of May 2021 to investigate the effect of periods of school closures (first and second) on students’ performance within the ITS during, between, and after school closures. We observed significant performance increases for both lower- and higher-performing students during, between, and after COVID-19 related school closures. Importantly, these improvements were more pronounced for lower-performing students compared to higher-performing students. Together, these results suggest that ITS may have helped to maintain mathematics learning, particularly for lower-performing students during COVID-19 related school closures and that these beneficial effects persisted at least for the following months when schools opened again. As such, the use of ITS for learning mathematics seems an appropriate approach for distance learning during times of crisis.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"6 ","pages":"Article 100162"},"PeriodicalIF":0.0,"publicationDate":"2024-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557324000041/pdfft?md5=7bacf1e18ef0c9d52063c7b813deff09&pid=1-s2.0-S2666557324000041-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139539583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Artificial intelligence literacy for technology education","authors":"Karin Stolpe, Jonas Hallström","doi":"10.1016/j.caeo.2024.100159","DOIUrl":"10.1016/j.caeo.2024.100159","url":null,"abstract":"<div><p>The interest in artificial intelligence (AI) in education has erupted during the last few years, primarily due to technological advances in AI. It is therefore argued that students should learn about AI, although it is debated exactly <em>how</em> it should be applied in education. AI literacy has been suggested as a way of defining competencies for students to acquire to meet a future everyday- and working life with AI. This study argues that researchers and educators need a framework for integrating AI literacy into technological literacy, where the latter is viewed as a multiliteracy. This study thus aims to critically analyse and discuss different components of AI literacy found in the literature in relation to technological literacy. The data consists of five AI literacy frameworks related to three traditions of technological knowledge: technical skills, technological scientific knowledge, and socio-ethical technical understanding. The results show that AI literacy for technology education emphasises technological scientific knowledge (e.g., knowledge about what AI is, how to recognise AI, and systems thinking) and socio-ethical technical understanding (e.g., AI ethics and the role of humans in AI). Technical skills such as programming competencies also appear but are less emphasised. Implications for technology education are also discussed, and a framework for AI literacy for technology education is suggested.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"6 ","pages":"Article 100159"},"PeriodicalIF":0.0,"publicationDate":"2024-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557324000016/pdfft?md5=3dbf07c312a64c8a45fd2076197c9e3a&pid=1-s2.0-S2666557324000016-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139394169","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Children's computational thinking as the development of a possibility space","authors":"Theodore J. Kopcha , Ceren Ocak","doi":"10.1016/j.caeo.2023.100156","DOIUrl":"https://doi.org/10.1016/j.caeo.2023.100156","url":null,"abstract":"<div><p>In this paper, we explore how the theoretical notion of <em>possibility space</em> offers a way to study how children's computational thinking develops as a process. Drawing on embodied notions of cognition, we first examine the literature that supports how children's computational thinking emerges as a <em>possibility space</em> that involves conceptualizing possible actions in a given moment, deciding which action to take by anticipating the results of a possible action, and learning from the actions that they have taken. We then use a grounded approach to analyze the problem-solving process of two 5th-grade children who engaged in an educational robotics activity over two 50-minute class periods. The findings lend support for approaching children's computational thinking as a cycle of action-taking that includes conceptualizing, anticipating, and taking action. The findings also support the pedagogical practice of having children predict the results of a computer program to enhance their computational thinking. Implications for the way that teachers can support children in learning to conceptualize what is possible and take action from it are discussed.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"5 ","pages":"Article 100156"},"PeriodicalIF":0.0,"publicationDate":"2023-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557323000344/pdfft?md5=4a4c901c1c10e00601fddc651e9d34ed&pid=1-s2.0-S2666557323000344-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138471710","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Renée A. Hendriks , Peter G.M. de Jong , Wilfried F. Admiraal , Marlies E.J. Reinders
{"title":"Motivation for learning in campus-integrated MOOCs: Self-determined students, grade hunters and teacher trusters","authors":"Renée A. Hendriks , Peter G.M. de Jong , Wilfried F. Admiraal , Marlies E.J. Reinders","doi":"10.1016/j.caeo.2023.100158","DOIUrl":"https://doi.org/10.1016/j.caeo.2023.100158","url":null,"abstract":"<div><p>Massive Open Online Course (MOOC) integration into campus education is rising, in many different forms. When integrating MOOCs, motivation to learn demands consideration as it is related to academic achievement and well-being. Student motivation in formal integrated MOOC learning is understudied. This study aimed to characterize the shape of motivation to learn in integrated MOOC learning. Motivation profiles of undergraduate students that learn in three different MOOC integration designs were explored, as was the distribution of profiles among integration designs. Finally, factors that underpin motivation were compared between integration designs. Six motivation profiles were recovered through a two-step cluster analysis: Self-determined students, highly self-determined students, grade hunters, and teacher trusters who are moderately, highly, or extremely trusting. Proportions of motivation profiles differed significantly between MOOC integration designs, and psychological needs were satisfied and frustrated significantly different between designs. Implications for future MOOC integration research and practice are discussed.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"6 ","pages":"Article 100158"},"PeriodicalIF":0.0,"publicationDate":"2023-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557323000368/pdfft?md5=3d180883645868bbd2ec4058b23eea88&pid=1-s2.0-S2666557323000368-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139100665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Teacher prototypes in technology-enhanced instruction in elementary school second language acquisition: Comparing routine and emergency learning in different cultures","authors":"Esti Schwartz, Tamar Shamir-Inbal, Ina Blau","doi":"10.1016/j.caeo.2023.100155","DOIUrl":"https://doi.org/10.1016/j.caeo.2023.100155","url":null,"abstract":"<div><p>Over the past decade, learning cultures worldwide have been affected differently by the rapid spread of educational technology. During emergency distance learning, teachers had to adapt themselves to a new mode of learning. The purpose of this study was to compare technology-integrated instructional strategies and teacher prototypes in three learning cultures during routine and emergency learning based on the <em>Five Spaces for Design in Education</em> framework (Weiner et al., 2020). The participants were 31 teachers from three regions - Eastern Europe, Western Europe, and Northern America, all integrating the same adaptive digital learning environment in second language instruction. Participants' interviews were coded according to a three level tier of instructional strategies (<em>n</em> = 938) denoting the student's place in the learning process and level of independence, as well as a categorization of four teacher prototypes representing the degree of teacher centrality in the classroom (<em>n</em> = 764): sage, facilitator, guide, and partner. Chi-square tests highlighted the differences in instructional strategies and teacher centrality between the learning cultures in the three regions. The findings of the teacher prototype analysis showed a similar distribution of prototypes among the three regions, both in routine learning and emergency times. Regarding instructional strategies, each culture showed a unique tendency to specific strategies, while in the transition to emergency learning there was a convergence to strategies with the medium level of teacher control over students and a certain degree of student independence.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"5 ","pages":"Article 100155"},"PeriodicalIF":0.0,"publicationDate":"2023-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557323000332/pdfft?md5=b350cd4c1dfaf40e673933cb3c14953c&pid=1-s2.0-S2666557323000332-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138465838","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Riddhi A. Divanji , Samantha Bindman , Allie Tung , Katharine Chen , Lisa Castaneda , Mike Scanlon
{"title":"A one stop shop? Perspectives on the value of adaptive learning technologies in K-12 education","authors":"Riddhi A. Divanji , Samantha Bindman , Allie Tung , Katharine Chen , Lisa Castaneda , Mike Scanlon","doi":"10.1016/j.caeo.2023.100157","DOIUrl":"https://doi.org/10.1016/j.caeo.2023.100157","url":null,"abstract":"<div><p>This study explored the value of Adaptive Learning Technologies (ALTs) in K-12 education by examining the advantages and challenges these tools create for teaching and learning from the perspectives of stakeholders involved in the use (Teachers), implementation (Teacher Support professionals), and development (EdTech professionals) of ALTs. We conducted qualitative thematic analysis on 25 stakeholder interviews using the Teacher Response Model as a guide for examining stakeholders’ perceptions of the advantages and challenges of ALTs. Analysis resulted in three overarching concepts (i.e., learning management, student agency and engagement, and implementation challenges), under which themes regarding stakeholder perspectives on the advantages and challenges of ALTs could be organized and contrasted with one another. Learning management themes suggest that stakeholders perceive features such as real-time student data and tailored learning content as creating value for teachers by supporting efficiency in their learning management, however that value is impacted by stakeholders’ concerns with ALT grading and data collection processes. Student agency and engagement themes highlight how certain user interaction features can create value or challenges for learners depending on whether the features were designed with students’ developmental and competence needs in mind. Finally, the implementation challenges themes suggest that for ALTs to create value in K-12 settings, stakeholders need better alignment around their ALT implementation goals and expectations. We leverage these data to make recommendations for future research and development so stakeholders can maximize the affordances of ALTs for K-12 students and teachers.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"5 ","pages":"Article 100157"},"PeriodicalIF":0.0,"publicationDate":"2023-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557323000356/pdfft?md5=c5cce9d141c81315602d85f67548d418&pid=1-s2.0-S2666557323000356-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138447975","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Noah L. Schroeder, William L. Romine, Sidney E. Kemp
{"title":"A scoping review of wrist-worn wearables in education","authors":"Noah L. Schroeder, William L. Romine, Sidney E. Kemp","doi":"10.1016/j.caeo.2023.100154","DOIUrl":"https://doi.org/10.1016/j.caeo.2023.100154","url":null,"abstract":"<div><p>Within the past ten years, the public's use of wearables, such as smartwatches and fitness trackers, has greatly increased. Recently, researchers have published systematic reviews to examine how wearables are used in educational settings. However, not all wearables are alike. Head-mounted wearables and exoskeletons may be viewed as invasive, whereas smartwatches and wristbands are commonly worn by the public. In this scoping review, we systematically review the literature around wrist-worn wearables (WWs) in educational settings. Our systematic search revealed 1,932 unique research items, of which 46 met the inclusion criteria and were analyzed. Our findings reveal the trends in the field, we discuss the vast heterogeneity seen in the field, and we make a call for further in-depth systematic reviews in the areas of WWs as educational interventions, of studies where the data from WWs is used to predict or classify different types of outcomes, and about data privacy, data security, ethics, and legal concerns around WWs in educational settings.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"5 ","pages":"Article 100154"},"PeriodicalIF":0.0,"publicationDate":"2023-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557323000320/pdfft?md5=2b4552eb5d4b99fd548ecdb5e6d0b0c3&pid=1-s2.0-S2666557323000320-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138413384","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Tim Fütterer , Ronja Steinhauser , Steffen Zitzmann , Katharina Scheiter , Andreas Lachner , Kathleen Stürmer
{"title":"Development and validation of a test to assess teachers' knowledge of how to operate technology","authors":"Tim Fütterer , Ronja Steinhauser , Steffen Zitzmann , Katharina Scheiter , Andreas Lachner , Kathleen Stürmer","doi":"10.1016/j.caeo.2023.100152","DOIUrl":"https://doi.org/10.1016/j.caeo.2023.100152","url":null,"abstract":"<div><p>To effectively adopt technology during teaching, teachers require knowledge of how to operate technology. Especially first-time technology users need knowledge of how to handle digital devices and software programs as a foundation to use technology in the classroom successfully. This knowledge has so far been assessed mainly using self-reports. However, self-assessments are insufficient for assessing knowledge as their validity is limited. Moreover, the few tests that exist to measure technological knowledge (TK) show weaknesses (e.g., lack of ecological validity, outdated items). We present a test assessing teachers' TK that is independent of specific operating systems, covers technology that is relevant in everyday teaching, and is grounded in acknowledged psychometric modeling principles. We iteratively developed a test (named T-TK) comprising 26 items, utilizing cognitive testing, expert feedback, and two studies (<em>N<sub>pilot study</sub></em> = 268 pre-service and in-service teachers, <em>N<sub>main study</sub></em> = 233 in-service teachers) to filter items that did not match in content and were not Rasch conform. T-TK showed a satisfactory Andrich's reliability (<em>Rel</em><sub>Andrich</sub> = 0.73). Using the sample <em>N<sub>main study</sub></em>, correlations between T-TK and technological knowledge (self-report, <em>r</em> = 0.52), pedagogical knowledge (test scores, <em>r</em> = 0.18), and technological pedagogical knowledge (self-report, <em>r</em> = 0.33; test scores, <em>r</em> = 0.46) indicated convergent and discriminant validity. Thus, the T-TK proves to be a reliable and valid instrument to capture teachers' TK. The T-TK can be used both by practitioners not requiring any statistical knowledge (e.g., for individual diagnostics) and in research (e.g., to analyze teachers' TK).</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"5 ","pages":"Article 100152"},"PeriodicalIF":0.0,"publicationDate":"2023-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557323000307/pdfft?md5=cb5e36063acae5ff1a22657274044c44&pid=1-s2.0-S2666557323000307-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138397210","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Factors that impact student frustration in digital learning environments","authors":"Elena Novak , Kerrie McDaniel , Jian Li","doi":"10.1016/j.caeo.2023.100153","DOIUrl":"10.1016/j.caeo.2023.100153","url":null,"abstract":"<div><p>The use of digital learning technologies and platforms has skyrocketed over the past decade. Although digital materials have many advantages, using them can be frustrating to students. Frustration is a negative achievement emotion that can serve as a barrier to learning. Therefore, understanding how frustration influences student learning and attitudes toward technology can help create more engaging and effective digital learning experiences. Previous research has identified three areas of frustration with academic e-textbooks (e-text frustration): (1) interactions with e-text interface, (2) technical difficulties, and (3) curriculum integration. This study investigated the relationships among e-text frustration and motivational, cognitive, attitudinal, academic, and demographic factors that impact frustration with e-texts in undergraduate biology classes. Extraneous cognitive load and motivation significantly predicted each of the three frustration constituents. Surprisingly, intrinsic cognitive load failed to predict e-text frustration. This study makes an important contribution to emotion research in education by examining the factors that impact learning in digital settings and emotions. Its implications are relevant for educators, researchers, and developers of digital learning materials and environments.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"5 ","pages":"Article 100153"},"PeriodicalIF":0.0,"publicationDate":"2023-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557323000319/pdfft?md5=01cbf0eef8d202e90baee14d48a8d3b5&pid=1-s2.0-S2666557323000319-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135765790","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Benjamin Luke Moorhouse , Marie Alina Yeo , Yuwei Wan
{"title":"Generative AI tools and assessment: Guidelines of the world's top-ranking universities","authors":"Benjamin Luke Moorhouse , Marie Alina Yeo , Yuwei Wan","doi":"10.1016/j.caeo.2023.100151","DOIUrl":"https://doi.org/10.1016/j.caeo.2023.100151","url":null,"abstract":"<div><p>The public release of generative artificial intelligence (GAI) tools (e.g., ChatGPT) has had a disruptive effect on the assessment practices of higher education institutions (HEIs) worldwide. Concerns have largely been associated with academic integrity, cheating and plagiarism. HEIs have had to develop guidelines in response to GAI. As many of these guidelines were developed in haste and could affect a large number of instructors and students, there is a need to examine their content, coverage and suitability. This review examines the extent to which the world's 50 top-ranking HEIs have developed or modified their assessment guidelines to address GAI use and, where guidelines exist, the primary content and advice given to guide instructors in their GAI assessment design and practices. The findings show that just under half of the institutions have developed publicly available guidelines. The guidelines cover three main areas: academic integrity, advice on assessment design and communicating with students. Amongst the suggestions for teachers on assessment design, two appear particularly pertinent in helping develop effective assessment tasks and developing learners’ AI literacy: first, running assessment tasks through GAI to check the extent to which the tool can accomplish the task and, second, having students use GAI as part of the assessment process. Overall, the review suggests that HEIs have come to accept the use of GAI and drafted assessment guidelines to advise instructors on its use. In the article, we argue that it may be beneficial to embrace GAI as a part of the assessment process since this is the reality of today's educational and job landscape. This will require instructors to develop a new competence - generative artificial intelligence assessment literacy - which is conceptualised in this article.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"5 ","pages":"Article 100151"},"PeriodicalIF":0.0,"publicationDate":"2023-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557323000290/pdfft?md5=b41a5f802390c7cbb48a295ca81bf744&pid=1-s2.0-S2666557323000290-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91775255","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}