{"title":"Investigating relationships among students’ affective, behavioral and cognitive engagement with peer feedback on EFL writing","authors":"Haitao Chen , Guangwei Hu","doi":"10.1016/j.stueduc.2024.101430","DOIUrl":"10.1016/j.stueduc.2024.101430","url":null,"abstract":"<div><div>This study adopted a mixed-methods design to examine how feedback givers’/receivers’ affective, behavioral and cognitive engagement with peer feedback were related to each other. One hundred and twenty-four English-major sophomores, purposively sampled based on their English proficiency and willingness to participate, responded to questionnaires administered at the beginning and the end of a 16-week writing course to gauge their engagement with peer feedback. Eight of them participated in stimulated recalls conducted to explore, in depth, the relationships among types of engagement with peer feedback. Analyses of the questionnaire data revealed significant positive and negative correlations of varying strength among different types of engagement for feedback givers and receivers. Analyses of the stimulated recalls yielded further evidence that feedback givers’/receivers’ behavioral, cognitive and affective engagement were interrelated in complex ways. These findings have pedagogical implications for the enhancement of students’ engagement with peer feedback in similar contexts.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"84 ","pages":"Article 101430"},"PeriodicalIF":2.6,"publicationDate":"2024-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143157887","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reliability, validity, and strictness of adult learner online self-rating based on teacher and achievement criteria for different individual characteristics and academic achievement","authors":"Chi-Cheng Chang, Ju-Shih Tseng","doi":"10.1016/j.stueduc.2024.101431","DOIUrl":"10.1016/j.stueduc.2024.101431","url":null,"abstract":"<div><div>Although many studies have shown that student self-assessment/rating is reliable or valid, many teachers still hesitate to implement student self-assessment/rating in their teaching. Therefore, whether or not student self-rating is reliable or valid has been a crucial concern. The study aimed to investigate the reliability, validity, and strictness of adult students’ online self-ratings by examining the consistency and difference between self-rating and teacher rating, and the consistency between self-rating and term project grade. There were 368 graduate students who used an online assessment platform to rate their own presentations. The results showed that adult students’ self-ratings had significant but low inter-rater consistency reliability and teacher-referenced validity, but inadequate teacher-referenced strictness, compared with teacher/expert criteria. Self-rating had significant but low achievement-referenced validity, compared with academic achievement criteria. Age, work experience, paper-pencil self-assessment experience, and online self-assessment experience affected the inter-rater consistency reliability and teacher-referenced validity of student self-rating. Individual characteristics and academic achievement had no effect on self-rating strictness. Implications and recommendations for academic theory and educational practice are proposed.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"84 ","pages":"Article 101431"},"PeriodicalIF":2.6,"publicationDate":"2024-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143158304","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Concurrent validity of scores from phone-based caregiver reports on early childhood development: Evidence from the Early Childhood Development Index 2030 implementation in Nepal","authors":"Kenji Kitamura , Filipa De Castro , Perman Gochyyev , Dipu Shakya , Claudia Cappa , Shyam Prasad Acharya , Devi Ram Acharya , Nicole Petrowski","doi":"10.1016/j.stueduc.2024.101428","DOIUrl":"10.1016/j.stueduc.2024.101428","url":null,"abstract":"<div><div>The Early Childhood Development Index 2030 (ECDI2030) is a caregiver-reported tool designed to monitor progress toward Sustainable Development Goal target 4.2, which aims to ensure universal access to quality early childhood development (ECD), care, and pre-primary education to prepare children for primary education and inform national policies. Using the ECDI2030 through phone-based administration for remote data collection is expected to contribute to efficient evidence generation. However, the existing evidence for caregiver-reported ECD measures are exclusively drawn from studies on assessments through face-to-face interviews. We conducted a validation trial in Nepal, comparing randomly divided in-person and telephone interviews groups. The results support the concurrent validity of phone-based ECDI2030 scores for measuring ECD at a group level while highlighting administrative challenges specific to the phone-based method. This study contributes to the literature on ECD measurement and provides insights into the practical implications of different modes of data collection.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"84 ","pages":"Article 101428"},"PeriodicalIF":2.6,"publicationDate":"2024-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143158303","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ignacio De los Ríos-Carmenado , Susana Sastre-Merino , Andr´es Díaz Lantada , Javier García-Martín , Priscila Nole Correa , Jorge E. P´erez-Martínez
{"title":"Corrigendum to: “Building world class universities through innovative teaching governance” [Studies in Educational Evaluation Volume 70, (2021) 1–13/ 101031]","authors":"Ignacio De los Ríos-Carmenado , Susana Sastre-Merino , Andr´es Díaz Lantada , Javier García-Martín , Priscila Nole Correa , Jorge E. P´erez-Martínez","doi":"10.1016/j.stueduc.2024.101427","DOIUrl":"10.1016/j.stueduc.2024.101427","url":null,"abstract":"","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101427"},"PeriodicalIF":2.6,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143179364","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A systematic literature review on authentic assessment in higher education: Best practices for the development of 21st century skills, and policy considerations","authors":"Dimitrios Vlachopoulos , Agoritsa Makri","doi":"10.1016/j.stueduc.2024.101425","DOIUrl":"10.1016/j.stueduc.2024.101425","url":null,"abstract":"<div><div>Authentic assessment methods involve the application of real-world tasks to evaluate students’ knowledge, skills, and attitudes in a way that replicates actual situations in which those would be utilized. This paper systematically reviews relevant literature from various disciplines in higher education, focusing on the development of 21st-century skills that can enhance students’ employability. The main objectives are to explore both reported effective implementation strategies of authentic assessment and the implications across different stakeholder groups-students, teaching staff, and policy makers. A sample of 94 articles was identified following the predefined inclusion criteria. Findings indicate that authentic assessment enhances key employability skills; at the same time, challenges have been identified for its effective implementation, including resistance from some stakeholders and the need for adequate training and resources. This study opens avenues for future research, presenting potential directions, as well as practical implications and policy recommendations emerging from a comprehensive thematic analysis.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101425"},"PeriodicalIF":2.6,"publicationDate":"2024-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142722614","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Preservice teachers’ pedagogical and psychological knowledge: Structure and learning opportunities","authors":"Judith Pollmeier , Thilo Kleickmann , Friederike Zimmermann , Jens Möller , Olaf Köller","doi":"10.1016/j.stueduc.2024.101424","DOIUrl":"10.1016/j.stueduc.2024.101424","url":null,"abstract":"<div><div>Pedagogical/psychological knowledge (PPK) is a crucial part of teachers’ professional knowledge. We examined the latent structure of preservice teachers’ PPK and its relationship to learning opportunities provided as part of university programs in teacher education: content covered in university courses, and teaching experience provided through internships. Based on a sample of 1036 participants, the results confirmed a four-dimensional structure of preservice teachers’ PPK. Course content explained differences in all dimensions of PPK. Teaching experience incrementally accounted for differences in the dimensions of <em>instruction</em> and <em>individual learning processes and motivation</em>, but not in the dimensions of <em>classroom management</em> or <em>assessment</em>.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101424"},"PeriodicalIF":2.6,"publicationDate":"2024-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142706202","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The effects of peer feedback provision and reception on lower-proficiency EFL learners’ writing development","authors":"Zeng Xiaomeng , Latha Ravindran","doi":"10.1016/j.stueduc.2024.101422","DOIUrl":"10.1016/j.stueduc.2024.101422","url":null,"abstract":"<div><div>Motivated by the growing reports of more benefits from feedback provision, the study increased the frequency of feedback provision and decreased that of feedback reception to find whether such manipulation affected lower-proficiency EFL learners’ writing performance. After the pre-test writing, the experimental group (n=79) took the role of feedback receivers for eight weeks and feedback providers for two weeks, while the control group (n=60) played the two roles for 10 weeks. Both groups then had the post-test writing and online survey. The result shows that all participants developed significantly in their post-test writing than in the pre-test writing. Noticeably, the experimental group improved significantly better than the control group in the post-test. The survey showed participants were generally positive about peer feedback. However, the control group was anxious about playing two roles in peer feedback. This indicates more benefits from peer feedback provision might also exist among lower-proficiency EFL learners.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101422"},"PeriodicalIF":2.6,"publicationDate":"2024-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142706284","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yingchun Liu , Guangru Xu , Shuo Yuan , Chu Zhou , Chengliang Wang
{"title":"Assessment as learning: Evidence based on meta-analysis and quantitative ethnography research","authors":"Yingchun Liu , Guangru Xu , Shuo Yuan , Chu Zhou , Chengliang Wang","doi":"10.1016/j.stueduc.2024.101423","DOIUrl":"10.1016/j.stueduc.2024.101423","url":null,"abstract":"<div><div>Assessment is crucial to both effective teaching and learning. To provide theoretical foundations and practical suggestions for teachers designing and conducting assessment activities, this study used meta-analysis and quantitative ethnography to show how student’s participation in assessment activities could promote learning. The meta-analysis of 59 papers indicated that the overall effect of students’ participation in assessment activities on learning was significant (d = 0.578), moderated by several factors. Empirical research of three peer assessments of teaching ability with quantitative ethnography demonstrated that such participation could foster the development of students’ cognitive abilities and facilitate the progression from common sense to advanced cognitive abilities. Data analysis revealed that students’ participation in appropriate assessment activities was an effective learning process and could enhance cognitive abilities, which aligned with the concept of “assessment as learning.” These findings provide a basis for teachers to design rich and appropriate assessment activities.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101423"},"PeriodicalIF":2.6,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142706651","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Assel Zholymbekova , Matthew Gordon Ray Courtney , Zamira Rakhymbayeva , Aidana Shilibekova , Aliya Ozhayeva
{"title":"Do children speaking indigenous and regional languages benefit equally from updated curricula? A report on a longitudinal quasi-experimental pilot study in Central Asia","authors":"Assel Zholymbekova , Matthew Gordon Ray Courtney , Zamira Rakhymbayeva , Aidana Shilibekova , Aliya Ozhayeva","doi":"10.1016/j.stueduc.2024.101421","DOIUrl":"10.1016/j.stueduc.2024.101421","url":null,"abstract":"<div><div>This study examined the effects of an updated curriculum on the literacy and numeracy development of indigenous and regional language speaking children in Kazakhstan. A quasi-experimentally designed pilot study involved 1717 students from 27 schools. Multilevel parallel linear growth models were used to analyze the impact of the updated curriculum on the co-developmental trajectories of numeracy and literacy from Grade 1 to 3. We found that the benefits of the updated curriculum were <em>experienced equally</em> for both the indigenous Kazakh- and Russian-speaking children. We suggest that modern reform efforts should not assume school-based inadequacies a priori but first test for the equivalent advantage of planned curricula across varying school conditions. We also suggest that other jurisdictions where multiple languages of instruction exist might consider adopting some of the changes implemented in Kazakhstan’s new curriculum for the purpose of improving literacy and numeracy outcomes in early elementary school.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101421"},"PeriodicalIF":2.6,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142653494","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Teaching quality and student achievement inequalities in low- and middle-income countries: A hierarchical linear model analysis","authors":"Jean-Baptiste M.B. Sanfo","doi":"10.1016/j.stueduc.2024.101419","DOIUrl":"10.1016/j.stueduc.2024.101419","url":null,"abstract":"<div><div>Teaching quality is associated with student achievement, though the strength of this association may vary. This study employs hierarchical linear modeling using PISA-D data to examine the association between teaching quality (teacher support, classroom management, and cognitive support) and mathematics achievement, while disaggregating the analysis by student gender and socioeconomic status (SES). Our findings indicate that cognitive support is negatively associated with student achievement in Ecuador, with no significant association in Cambodia, Guatemala, Honduras, Paraguay, Senegal, or Zambia. Additionally, we found a positive association between classroom management and mathematics in Cambodia, Ecuador, Honduras, and Zambia, but no association in other countries. Similarly, teacher support showed a negative association with mathematics in Ecuador and Honduras, but no significant association in other countries. Beyond these direct associations, our findings suggest that the influence of teaching quality may vary across student gender and SES. We also discuss the policy implications of these findings.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101419"},"PeriodicalIF":2.6,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142653493","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}