{"title":"Small-class effects on science achievement in secondary education","authors":"Ting Shen","doi":"10.1016/j.stueduc.2024.101368","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101368","url":null,"abstract":"<div><p>Small classes may affect students’ science achievement, but research evidence for small-class effects on science achievement in secondary education has been scarce. To fill this literature gap, this study examines small-class effects on 15-year-old students’ science achievement using the Program for International Student Assessment (PISA) 2015 data from 26 countries including 24 European countries plus U.S. and Canada. To reduce confounding factors and estimation bias, propensity score analysis was conducted to control significant differences between students in small versus non-small classes on important observed covariates. Results indicate that the effects of small classes on science achievement were statistically significant and negative in 9 countries (e.g., Germany) whereas in other 17 countries small-class effects were non-significant. Fixed-effects meta-analysis was utilized to combine effect sizes, and findings reveal that the effects of small classes were significant and negative, suggesting that students in non-small classes had higher science achievement, but the overall effect size was small.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"82 ","pages":"Article 101368"},"PeriodicalIF":3.1,"publicationDate":"2024-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141068267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"How schools affect equity in education: Teaching factors and extended day programs associated with average achievement and socioeconomic achievement gaps","authors":"Max Nachbauer","doi":"10.1016/j.stueduc.2024.101367","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101367","url":null,"abstract":"<div><p>The current study evaluates effects of teaching factors and extended day programs regarding both average achievement and socioeconomic achievement gaps. Analyses are based on data from the National Educational Panel Study in Germany. The sample comprises 1523 students in 120 classes in 71 secondary schools. The investigation period covers fifth grade to seventh grade. The dependent variable is mathematics achievement. Data are analyzed using intercept-and-slope-as-outcome models. Analyzes on teaching factors reveal that classroom management and cognitive activation increase average achievement. Forming heterogenous groups within the classroom reduces socioeconomic achievement gaps. Analyzes on extended day programs reveal that tutoring reduces socioeconomic achievement gaps. Homework supervision reduces average achievement and increases socioeconomic achievement gaps. Enrichment programs increase socioeconomic achievement gaps. Implications for research, policy and practice are drawn.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"82 ","pages":"Article 101367"},"PeriodicalIF":3.1,"publicationDate":"2024-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0191491X24000464/pdfft?md5=d333c2b8f08af7febb3c55714ec4092b&pid=1-s2.0-S0191491X24000464-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140825909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The how’s and how often’s of school harassment: How do they influence the academic achievement of adolescents over time?","authors":"Andrea Canales , Andrew Webb","doi":"10.1016/j.stueduc.2024.101358","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101358","url":null,"abstract":"<div><p>A vast body of literature shows that school harassment is negatively associated with academic achievement, particularly in elementary and middle schools. Few studies have examined the influence of forms and frequencies of harassment—whether relational, verbal, cyber, or physical—on academic performance in high schools. We investigate how the how’s and when’s of harassment are associated with the academic achievement of adolescents over time in Chile, using standardized test scores of a sample of schoolchildren (n = 80,117) and fixed effect models. We find that being physically bullied and cyberbullied are linked to poor academic performance, whereas verbal and social abuse are not. These results underline the significance of working with disaggregated measures of harassment in school interventions at different stages.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"82 ","pages":"Article 101358"},"PeriodicalIF":3.1,"publicationDate":"2024-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140557609","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Matthijs Krooi , Jill Whittingham , Simon Beausaert
{"title":"Introducing the 3P conceptual model of internal quality assurance in higher education: A systematic literature review","authors":"Matthijs Krooi , Jill Whittingham , Simon Beausaert","doi":"10.1016/j.stueduc.2024.101360","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101360","url":null,"abstract":"<div><p>Institutions of higher education engage in internal quality assurance for teaching and learning in order to demonstrate legitimacy in the face of (societal) expectations, as well as to maintain and improve the quality of education. While the topic of quality assurance in higher education is a growing academic specialty, the evidence base for its impact on educational quality remains limited. Developing a shared language and understanding of concepts that enable further investigation of this phenomenon are key. The systematic literature review was conducted to shed light on the conceptualisation of internal quality assurance for teaching and learning. The thematic analysis revealed three interconnected dimensions of internal quality assurance: purpose, people and process. Based on these findings, an all-inclusive definition and a conceptual model were developed: the 3P model. This model promotes taking a contextualised and integral approach towards internal quality assurance by aligning purposes, people, and processes.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"82 ","pages":"Article 101360"},"PeriodicalIF":3.1,"publicationDate":"2024-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0191491X24000397/pdfft?md5=b46865988824e24b75e32bf515d33070&pid=1-s2.0-S0191491X24000397-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140554899","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kingsley Okoye , Sandra Dennis Núñez Daruich , Raquel Castaño , José Francisco Enríquez de la O , Jose Escamilla , Samira Hosseini
{"title":"Analyzing the impact of digitized-education toward the future of education: A comparative study based on students’ evaluation of teaching data","authors":"Kingsley Okoye , Sandra Dennis Núñez Daruich , Raquel Castaño , José Francisco Enríquez de la O , Jose Escamilla , Samira Hosseini","doi":"10.1016/j.stueduc.2024.101359","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101359","url":null,"abstract":"<div><p>This study investigates the key factors that impact the <em>digitalized-education</em>, and what those mean for the new and emerging educational models of learning. The research is based on state-of-the-art education and assessment models for learning such as Descriptive decision theory, Futures Literacy (FLF), and 8-Affordances framework that theoretically addresses both the need to use multidisciplinary components in identifying the several challenges and opportunities to the use of digital technologies in education (digitized-education) and improvement of the student's learning outcomes. Through a quasi-experimental study design and comparative analysis of the students’ evaluation of teaching (SET) dataset (<em>n</em> = 3178) collected in a higher education setting; the study applies a multivariate analysis of covariance (MANCOVA) and multiple comparisons (post-hoc) tests to determine the impact or association that the evaluation period (between 2019–2021) and type of school or discipline have on the students’ learning performance and evaluation. The results show that students’ satisfaction and experiences with digitized-education have exponentially grown in recent times, and mainly varied across the years, and marginally by discipline or school. In addition, the study empirically sheds light on the importance of the key findings and results by considering their pedagogical, technological, economic infrastructure, and ethical implications for the future of education and sustainable educational practice.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"82 ","pages":"Article 101359"},"PeriodicalIF":3.1,"publicationDate":"2024-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140554900","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Instructional tools and curricular structures to facilitate students’ self-assessment and generation of self-feedback","authors":"Jessica To , Anna Serbati , Anastasiya Lipnevich","doi":"10.1016/j.stueduc.2024.101356","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101356","url":null,"abstract":"","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"81 ","pages":"Article 101356"},"PeriodicalIF":3.1,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140535335","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Measuring the quality of teacher professional development: A large-scale validation study of an 18-item instrument for daily use","authors":"Eric Richter , Dirk Richter","doi":"10.1016/j.stueduc.2024.101357","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101357","url":null,"abstract":"<div><p>This study introduces the Teacher Professional Development (TPD) Monitor, an 18-item instrument designed to assess the quality of formal learning opportunities (e.g. courses, workshops), for in-service teachers across all grade levels of general education. By evaluating these opportunities across four critical dimensions—clarity and structure, cognitive activation, collaboration, practical relevance—the TPD Monitor provides a comprehensive framework for assessing the effectiveness of professional development programs. Developed and validated with data from 2314 in-service teachers actively teaching in primary, secondary, special education, and vocational schools, each participating in one of 173 distinct TPD courses, this instrument is supported by multi-level confirmatory factor analysis that confirmed its structure, offering robust evidence of its validity and reliability. Furthermore, measurement invariance was achieved, allowing for meaningful comparisons between subgroups. The TPD Monitor is a valuable and practical tool enabling TPD providers to design effective courses and allowing to monitor and improve the quality of TPD programs.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"81 ","pages":"Article 101357"},"PeriodicalIF":3.1,"publicationDate":"2024-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0191491X24000361/pdfft?md5=f4e081a3013880424f5e1c8ca3f28fef&pid=1-s2.0-S0191491X24000361-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140533419","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Developing feedback literacy, scaffolded writing, and resilience through intervention on feedback processes for L2 writing students","authors":"Hanieh Shafiee Rad , Azizullah Mirzaei","doi":"10.1016/j.stueduc.2024.101354","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101354","url":null,"abstract":"<div><p>Recent research on feedback processes posits that furthering students’ feedback literacy leads to scaffolded learning by effectively engaging them in seeking, understanding, and using feedback information. This study examined effects of a social-constructionist approach to feedback literacy on students’ development of feedback literacy, scaffolded learning, and resilience. Accordingly, we raised students’ awareness of feedback dynamics within the Zone of Proximal Development (ZPD), while engaged in collaborative writing with co-writers. A mixed-methods design was adopted comprising measures of feedback literacy, writing, and resilience before and after the intervention. Semi-structured interviews were also held to probe students’ post-intervention attitudes. Posttest scores and ratings showed significant improvement in the experimental group’s feedback literacy, writing proficiency, and resilience. Further, interviews revealed that feedback literate students developed positive perceptions of feedback processes arising from scaffolded writing and that their enhanced awareness brought them opportunities for engagement, collaboration, graduated scaffolding in the ZPD, and sustained motivation for writing.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"81 ","pages":"Article 101354"},"PeriodicalIF":3.1,"publicationDate":"2024-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140343988","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The double-edged sword of de-tracking reforms in Germany: Using a Difference-in-Differences approach to estimate effects on students' educational aspirations and their association with students' socioeconomic backgrounds","authors":"Marlen Holtmann , Camilla Rjosk , Malte Jansen , Oliver Lüdtke","doi":"10.1016/j.stueduc.2024.101350","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101350","url":null,"abstract":"<div><p>Some German states recently reformed their tracking practices by reducing the number of secondary school track options from up to four to a two-path structure, in which students can continue their school career until they acquire the general university entrance qualification in both tracks (academic and comprehensive). We examine whether these <em>de-tracking</em> reforms were, as intended, associated with a change in students’ educational aspirations and whether they reduced socioeconomic disparities in students’ educational aspirations. We analyze representative data of around 65,000 ninth graders from states with and without reforms from pre- and post-reform periods (2012 to 2018), using a Difference-in-Differences approach and a regression of students’ educational aspirations on their socioeconomic backgrounds. Our results suggest that students’ educational aspirations have increased in the wake of the <em>de-tracking</em> reforms, but that socioeconomic disparities in students’ educational aspirations have increased rather than weakened. Implications for tracking practices and socioeconomic disparities are discussed.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"81 ","pages":"Article 101350"},"PeriodicalIF":3.1,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140339399","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Predicting undergraduate student evaluations of teaching using probabilistic machine learning: The importance of motivational climate","authors":"Brett D. Jones , Kazim Topuz , Sumeyra Sahbaz","doi":"10.1016/j.stueduc.2024.101353","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101353","url":null,"abstract":"<div><p>The purpose of this study was to understand the complex interactions within a course among motivational climate variables and student evaluations of teaching (SETs) by developing online simulators using probabilistic machine learning. We used data from 2938 undergraduate students in 30 classes to create online simulators based on Bayesian Belief Networks. We created bubble charts, line graphs, and radar charts to show the relationships between the study variables. Findings showed that (a) the motivational climate variables—as measured by the MUSIC Model of Motivation variables—are the largest predictors of SETs, (b) student interest (in the coursework and instructional methods) is the overall largest predictor of SETs, (c) the relationships between the motivational climate variables and SETS are nonlinear, (d) the ease of the course and demographic variables are only weakly associated with SETs, and (e) the largest predictors of instructor and course rating are similar, but somewhat different.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"81 ","pages":"Article 101353"},"PeriodicalIF":3.1,"publicationDate":"2024-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140321029","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}