LuEttaMae Lawrence , Emma Mercier , Taylor Tucker Parks , Nigel Bosch , Luc Paquette
{"title":"Accuracy and effectiveness of an orchestration tool on instructors’ interventions and groups’ collaboration","authors":"LuEttaMae Lawrence , Emma Mercier , Taylor Tucker Parks , Nigel Bosch , Luc Paquette","doi":"10.1016/j.caeo.2024.100203","DOIUrl":"10.1016/j.caeo.2024.100203","url":null,"abstract":"<div><p>This paper presents the development of a novel orchestration tool that predicts collaborative problem-solving (CPS) behaviors of undergraduate engineering groups and investigates the use of that tool by instructors. We explore the impact of receiving real-time, machine-learning, model-based prompts on 1) instructors’ orchestration strategies, which are strategies instructors use to manage and facilitate collaborative activities, and 2) groups’ participation, including how groups are engaged in CPS activities. The orchestration tool is a dashboard that notifies instructors of—and advises them on—monitoring and intervening with groups who may need collaborative support and guidance. We describe the accuracy of the models in predicting CPS behaviors and of instructors in identifying these behaviors in the classroom. We then describe how real-time prompts from models can affect instructors’ orchestration strategies and students’ participation. Our findings show that there is variability in the accuracy of our machine learning models and that instructors are better at identifying predictive behaviors as compared to the models. Instructors in this context engaged in orchestration strategies, like monitoring and probing when using the orchestration tool, and groups of students were largely talking while on-task across classes. We triangulate across data sources to examine the effectiveness of the orchestration tool in the classroom and share pedagogical and technical implications for the field.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"7 ","pages":"Article 100203"},"PeriodicalIF":4.1,"publicationDate":"2024-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557324000430/pdfft?md5=6b9fd7a9c2d1b77b394ebcf85b2fa65d&pid=1-s2.0-S2666557324000430-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141838799","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Teachers’ self-reported and actual content-related TPACK – new results on their relation and gender differences","authors":"Timo Kosiol, Stefan Ufer","doi":"10.1016/j.caeo.2024.100205","DOIUrl":"10.1016/j.caeo.2024.100205","url":null,"abstract":"<div><p>Measuring Technological Pedagogical and Content Knowledge (TPACK) in context is still a pertinent issue, as previously rather decontextualized self-reports have been the predominant measure, while knowledge test instruments are scarce. Self-reports can be interpreted as general measures of performance-related self-beliefs. Still, due to the contextualized nature of TPACK and potential biases, their use as proxies for actual knowledge has been criticized. Self-reports may be especially gender biased as women often underestimate their performance in STEM subjects. Drawing on a sample of <em>N</em> = 161 mathematics in-service and pre-service teachers, we aim to analyze (i) the structure of the self-reported knowledge and (ii) the relationship between self-reported and contextualized actual knowledge. To this end, we used general TPACK self-reports and a test instrument that infers the amount of knowledge separately for each dimension from performance over multiple authentic demands that teachers encounter teaching secondary school mathematics. The current study shows that the TPACK self-beliefs can be separated and measured reliably. Although all self-beliefs show bivariate relations to corresponding actual knowledge dimensions, this changes for PCK and TPCK self-beliefs when other actual knowledge dimensions are controlled. We interpret these findings that TCK self-belief and to a lesser degree CK self-belief seem to be calibrated according to corresponding actual knowledge, while PCK and TPCK self-beliefs are primarily calibrated according to non-pedagogy-related actual knowledge. Lastly, we do not find gender biases, but a small gender effect with lower actual and self-reported knowledge for female teachers over all dimensions.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"7 ","pages":"Article 100205"},"PeriodicalIF":4.1,"publicationDate":"2024-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557324000454/pdfft?md5=290ef98eebdb49df8a3d405754b18920&pid=1-s2.0-S2666557324000454-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141842187","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A systematic review and meta-analysis on TPACK-based interventions from a perspective of knowledge integration","authors":"Armin Fabian , Iris Backfisch , Kenneth Kirchner , Andreas Lachner","doi":"10.1016/j.caeo.2024.100200","DOIUrl":"10.1016/j.caeo.2024.100200","url":null,"abstract":"<div><p>Designing effective interventions that foster (pre-service) teachers' knowledge to teach with technologies is paramount in education research. Researchers have prominently relied on the TPACK-model as theoretical foundation to design such interventions. However, a myriad of distinct TPACK-based interventions emerged, which likely targeted the different knowledge components of TPACK to varying extents. Given this diversity and the lack of performance-based measures to estimate competence growth, little is known about the effectiveness of respective interventions. In the present synthesis study, we therefore sought to systemize TPACK-based interventions regarding targeted knowledge domains across various contexts. Accordingly, we scrutinized which of the TPACK-components were explicitly targeted in TPACK-based interventions within the framework of a systematic review. Further, we conducted a subsequent meta-analysis based on studies applying performance-based measures to investigate whether the targeted knowledge domains affected the effectiveness of interventions. Based on a set of <em>N</em> = 163 primary intervention studies and one theoretical contribution, our analyses suggest that Technological Knowledge was the most prominent targeted TPACK-component. Interestingly, in more than 20% of the interventions, specific training on Technological Pedagogical Content Knowledge (i.e., TPCK) was absent although TPCK is considered crucial for successful technology integration. Results further revealed that researchers do not seem to have adapted the design of interventions on instructional contexts (such as the expertise level of the target audience). The results of the subsequent meta-analysis (<em>N</em> = 8) further provided no clear evidence that targeted TPACK-components affected the effectiveness of interventions.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"7 ","pages":"Article 100200"},"PeriodicalIF":4.1,"publicationDate":"2024-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557324000405/pdfft?md5=e9fc829432bddb2d393bcbb223891c49&pid=1-s2.0-S2666557324000405-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141728649","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ha Nguyen , Jolien Marleen Mouw , Angeliki Mali , Jan-Willem Strijbos , Hanke Korpershoek
{"title":"Developing a Technological Pedagogical and Content Knowledge (TPACK) survey for university teachers","authors":"Ha Nguyen , Jolien Marleen Mouw , Angeliki Mali , Jan-Willem Strijbos , Hanke Korpershoek","doi":"10.1016/j.caeo.2024.100202","DOIUrl":"10.1016/j.caeo.2024.100202","url":null,"abstract":"<div><p>Existing Technological Pedagogical and Content Knowledge (TPACK) surveys target pre-service or K-12 teachers, whereas none have been specifically adapted for university teachers. To adequately measure TPACK-competences of university teachers, the specific characteristics of teaching in a university context need to be taken into account. Survey items that are not contextualized to the target participants increase the risk of measurement error and bias. Therefore, we adapted existing TPACK surveys to specifically measure university teachers’ competences for teaching with technology. We shortlisted five existing TPACK surveys and scrutinized their respective subscales and items. We then adapted these items to more adequately capture context-specific experiences for university teachers to ensure construct validity. We collected two waves of data to test our adapted TPACK survey, which comprises 31 items distributed across seven subscales, among teachers from various disciplines in a large university. With confirmatory factor analysis, we confirmed the seven-factor structure of the adapted TPACK survey in both data waves. Moreover, the seven subscales showed adequate internal consistency. An exploration of TPACK competences among teachers from different disciplines showed both similarities as well as dissimilarities. An example of similarities is that university teachers from all disciplines felt most competent in CK and PCK, while they reported relatively low competence ratings for TPCK and TPK. Besides, an example of dissimilarities is PK; teachers from the discipline of science and engineering reported the highest score compared to other disciplines in the prior wave, while they evaluated themselves third lowest in the latter wave.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"7 ","pages":"Article 100202"},"PeriodicalIF":4.1,"publicationDate":"2024-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557324000429/pdfft?md5=2195c53fdff60072bdd30a467dd5ccdd&pid=1-s2.0-S2666557324000429-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141639114","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Is contextual knowledge a key component of expertise for teaching with technology? A systematic literature review","authors":"Eliana Brianza , Mirjam Schmid , Jo Tondeur , Dominik Petko","doi":"10.1016/j.caeo.2024.100201","DOIUrl":"https://doi.org/10.1016/j.caeo.2024.100201","url":null,"abstract":"<div><p>The technological pedagogical content knowledge (TPACK) framework is a prominent framework for describing the knowledge teachers require for teaching in the digital era. Recently, the component of “context” was officially recognized as an additional domain of knowledge. Since then, this domain has started to gradually gain more attention in TPACK research. Yet research on contextual knowledge (XK) appears somewhat sporadic, indicating the need for greater clarity on this construct. As the domain representing the knowledge of educational contexts, the role of experience in educational contexts emerges as a key point for shedding light on this construct. The present systematic literature review aimed to offer an overview of the representations and functions associated with XK through the lens of experience and investigated this domain through comparing the empirical literature focusing on preservice teachers (less experienced) to that focusing on inservice teachers (more experienced). Systematically screening the literature resulted in a final sample of 15 studies conducted among preservice teachers and 23 on inservice teachers. Records were analyzed through qualitative codings and quantitative comparisons of these codes between these two groups of studies. Findings revealed a consistent multifaceted structure of XK across both inservice and preservice teacher studies with a distinctive greater focus on school-level factors in inservice teacher studies. In addition, across groups, studies provided evidence confirming XK as a domain supporting teachers’ practice, that can be developed, and that relates to other pedagogically relevant constructs. These findings are discussed with regards to their implications for researchers, practitioners, and stakeholders.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"7 ","pages":"Article 100201"},"PeriodicalIF":4.1,"publicationDate":"2024-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557324000417/pdfft?md5=f48cc8ec723b31ef2de54ad019397fd5&pid=1-s2.0-S2666557324000417-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141605449","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Data-related concepts for artificial intelligence education in K-12","authors":"Viktoriya Olari, Ralf Romeike","doi":"10.1016/j.caeo.2024.100196","DOIUrl":"10.1016/j.caeo.2024.100196","url":null,"abstract":"<div><p>Due to advances in Artificial Intelligence (AI), computer science education has rapidly started to include topics related to AI along K-12 education. Although this development is timely and important, it is also concerning because the elaboration of the AI field for K-12 is still ongoing. Current efforts may significantly underestimate the role of data, the fundamental component of an AI system. If the goal is to enable students to understand how AI systems work, knowledge of key concepts related to data processing is a prerequisite, as data collection, preparation, and engineering are closely linked to the functionality of AI systems. To advance the field, the following research provides a comprehensive collection of key data-related concepts relevant to K-12 computer science education. These concepts were identified through a theoretical review of the AI field, aligned through a review of AI curricula for school education, evaluated through interviews with domain experts and teachers, and structured hierarchically according to the data lifecycle. Computer science educators can use the elaborated structure as a conceptual guide for designing learning arrangements that aim to enable students to understand how AI systems are created and function.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"7 ","pages":"Article 100196"},"PeriodicalIF":4.1,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557324000363/pdfft?md5=aa55d4fd59c15d11c11d4497e1a05b07&pid=1-s2.0-S2666557324000363-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141622460","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Pre-service English teachers‘ approaches to technology-assisted teaching and learning: Associations with study level, self-efficacy and value beliefs","authors":"Andreas Hülshoff, Regina Jucks","doi":"10.1016/j.caeo.2024.100199","DOIUrl":"https://doi.org/10.1016/j.caeo.2024.100199","url":null,"abstract":"<div><p>Information and communications technology (ICT) plays an important role in teaching and learning English as a Foreign Language (EFL) at school. However, there are still relevant research gaps regarding (prospective) teachers’ attitudes and approaches towards ICT-assisted EFL teaching and learning. The present study examined possible different groups of pre-service teachers based on patterns regarding their approaches to ICT-assisted EFL teaching and learning and associations with study level and value and self-efficacy beliefs based on a sample of pre-service EFL teachers from various universities in North Rhine-Westphalia (Germany). Results from a cluster analysis identified three distinct clusters of pre-service teachers who differed significantly in their transmissive and constructivist approaches to ICT-assisted EFL teaching and learning. Cluster allocation varied significantly depending on participants’ study level. Further cluster comparisons also partly indicated significant associations between participants’ transmissive and constructivist beliefs and their value beliefs regarding ICT-assisted EFL teaching and learning. Participants’ self-efficacy beliefs regarding ICT-assisted EFL teaching did not vary significantly between different clusters of pre-service teachers. Possible implications are discussed conclusively.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"7 ","pages":"Article 100199"},"PeriodicalIF":4.1,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557324000399/pdfft?md5=751c61ee201268fbced9d72877196d4c&pid=1-s2.0-S2666557324000399-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141543564","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Markus W.H. Spitzer , Lisa Bardach , Younes Strittmatter , Jennifer Meyer , Korbinian Moeller
{"title":"Evaluating the content structure of intelligent tutor systems—A psychological network analysis","authors":"Markus W.H. Spitzer , Lisa Bardach , Younes Strittmatter , Jennifer Meyer , Korbinian Moeller","doi":"10.1016/j.caeo.2024.100198","DOIUrl":"https://doi.org/10.1016/j.caeo.2024.100198","url":null,"abstract":"<div><p>The adoption of intelligent tutoring systems (ITSs) worldwide has led to a considerable accumulation of process data as students interact with different learning topics within these systems. Typically, these learning topics are structured within ITSs (e.g., the fraction topic includes subtopics such as a fraction number line subtopic). However, there is a lack of methods that offer quick, data-driven insights into the content structure of ITSs, particularly through easily accessible visualizations. Here, we applied psychological network analysis to process data (230,241 students; 5,365,932 problem sets) from an ITS for learning mathematics to explore performance interdependencies between 40 different subtopics. We argue that the visualization of these content interdependencies allows for a quick empirical evaluation of the validity of the existing structuring of the respective learning content. These insights allow for deriving recommendations concerning potential changes in the ITS structure and are thus highly valuable for ITS developers. Our results are also relevant for researchers as the interdependencies illustrated through psychological network analysis can contribute towards a better understanding of the interplay between mathematical skills. Together, our results indicate that psychological network analysis represents a valuable data-driven method to evaluate and optimize ITSs.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"7 ","pages":"Article 100198"},"PeriodicalIF":4.1,"publicationDate":"2024-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557324000387/pdfft?md5=42fa45d70865909aecd605c7ab46ce98&pid=1-s2.0-S2666557324000387-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141433928","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Cody Pritchard , Conrad Borchers , Joshua, M. Rosenberg , Alexa K. Fox , Sondra M. Stegenga
{"title":"The datafication of student information on X (Twitter)","authors":"Cody Pritchard , Conrad Borchers , Joshua, M. Rosenberg , Alexa K. Fox , Sondra M. Stegenga","doi":"10.1016/j.caeo.2024.100197","DOIUrl":"10.1016/j.caeo.2024.100197","url":null,"abstract":"<div><p>The sharing of personally identifiable information (PII) through social media platforms poses known risks to children's online privacy and safety. While the risks of oversharing PII through a range of digital contexts are becoming better understood, limited research has documented the social media practices of educational institutions that have a fiduciary responsibility to children. This study seeks to understand the role of educational institutions in putting students’ privacy at risk by investigating their social media practices on X (formerly Twitter). This paper extends previous research (Rosenberg et al., 2022a) by exploring how often students' PII (e.g., names, images, and phone numbers) and other social identities (e.g., gender identity, religion, race, and ethnicity) are exposed on X. Additionally, we examine both images and <em>videos</em> of posts shared by educational institutions. Using a data set of approximately 20.6 million posts made by K-12 education institutions in the United States, we explore the extent to which students’ PII is shared with the public on X. Our analyses suggest that approximately 4 % of posts that contain images and videos (approximately 800,000 posts in the overall data set) included an identifiable face of a student or students along with their name(s) and 2.3 % ascribed students’ gender identity. Given the extent of disclosed PII and the potential privacy risks, this study provides additional insight for educational stakeholders to cultivate safer social media practices, seeking to mitigate potential risks to students' privacy and improve students’ digital rights.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"7 ","pages":"Article 100197"},"PeriodicalIF":0.0,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557324000375/pdfft?md5=3fd8bc71057540d938e75ec0c32f11d2&pid=1-s2.0-S2666557324000375-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141405000","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Googlization of the classroom: Is the UK effective in protecting children's data and rights?","authors":"","doi":"10.1016/j.caeo.2024.100195","DOIUrl":"10.1016/j.caeo.2024.100195","url":null,"abstract":"<div><p>There has been an explosion in uses of educational technology (EdTech) to support schools’ teaching, learning, assessment and administration. This article asks whether UK EdTech and data protection policies protect children's rights at school. It adopts a children's rights framework to explore how EdTech impacts children's rights to education, privacy and freedom from economic exploitation, taking Google Classroom as a case study. The research methods integrate legal research, interviews with UK data protection experts and education professionals working at various levels from national to local, and a socio-technical investigation of the flow of children's data through Google Classroom. The findings show that Google Classroom undermines children's privacy and data protection, potentially infringing children's other rights. However, they also show that regulation has impacted on Google's policy and practice. Specifically, we trace how various governments’ deployment of a range of legal arguments has enabled them to regulate Google's relationship with schools to improve its treatment of children's data. Although the UK government has not brought such actions, the data flow investigation shows that Google has also improved its protection of children's data in UK schools as a result of these international actions. Nonetheless, multiple problems remain, due both to Google's non-compliance with data protection regulations and schools’ practices of using Google Classroom. We conclude with a blueprint for the rights-respecting treatment of children's education data that identifies needed actions for the UK Department for Education, data protection authority, and industry, to mitigate against harmful practices and better support schools.</p></div>","PeriodicalId":100322,"journal":{"name":"Computers and Education Open","volume":"7 ","pages":"Article 100195"},"PeriodicalIF":4.1,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666557324000351/pdfft?md5=d6e31f193ffc4e4c432e57f8c197921f&pid=1-s2.0-S2666557324000351-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141277721","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}