{"title":"New evidence on the impact of learning in a foreign language on educational outcomes","authors":"Luis Pires , María-Jesús Mancebón , Mauro Mediavilla , José-María Gómez-Sancho","doi":"10.1016/j.stueduc.2024.101386","DOIUrl":"10.1016/j.stueduc.2024.101386","url":null,"abstract":"<div><p>A Content and Language Integrated Learning (CLIL) method, in which some subjects are taught in a foreign language (English), was initiated in Spain in 2005 and has progressively extended to half of public schools. The results have been very positive; however, it has been argued that studying subjects in a foreign language may reduce the educational outcomes of students. This paper evaluates this criticism in the Madrid bilingual program adopting a Propensity Score Matching approach, with the PISA 2015 and 2018 data. The model defines a homogenous student subsample from bilingual and nonbilingual schools in terms of the observable characteristics that may jointly influence both the selection of school type and educational scores. Our results, robust to the sample and unobservable hidden bias, indicate that the Madrid bilingual program, in addition to improving students' English level, does not reduce the skills of subjects taught in English or in Spanish.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101386"},"PeriodicalIF":2.6,"publicationDate":"2024-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0191491X24000658/pdfft?md5=c5de668aa4453e1ecd08f5c0bd14adfb&pid=1-s2.0-S0191491X24000658-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141960582","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Vivian E. Morssink-Santing , Symen van der Zee , Lida T. Klaver , Jaap de Brouwer , Patrick H.M. Sins
{"title":"The long-term effect of alternative education on self-regulated learning: A comparison between Montessori, Dalton, and traditional education","authors":"Vivian E. Morssink-Santing , Symen van der Zee , Lida T. Klaver , Jaap de Brouwer , Patrick H.M. Sins","doi":"10.1016/j.stueduc.2024.101380","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101380","url":null,"abstract":"<div><p>With the rise of secondary alternative schools in the Netherlands, such as Montessori and Dalton, research into its effectiveness has become crucial. Alternative schools’ greater focus on autonomy and independence may better equip students with the self-regulated learning (SRL) skills essential for higher education. The aim of this study is to investigate the transition of secondary (alternative) education to higher education. More specifically, former Dalton (<em>N</em> = 184), Montessori (<em>N</em> = 150), and regular (<em>N</em> = 8614) secondary education students are compared on the perceived fit between secondary education and higher education, for example in regard to learning to work together and work alone, and SRL skills in a bootstrapped hierarchical regression. Results show that former Dalton students rate the fit of their secondary education to their higher education significantly better than students who attended regular education. No other significant differences were found when comparing Montessori and regular education students regarding fit, or when comparing both Montessori and Dalton to regular education regarding the SRL skills of students. Alternative explanations regarding the differences between alternative and regular educations are discussed.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101380"},"PeriodicalIF":2.6,"publicationDate":"2024-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0191491X24000592/pdfft?md5=093d8493b1f1b5db3cde447c61b696d4&pid=1-s2.0-S0191491X24000592-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141541990","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Admission testing, pre-academic exam self-efficacy, and retention. A prospective cohort study","authors":"Lotte Dyhrberg O’Neill , Tine Nielsen","doi":"10.1016/j.stueduc.2024.101383","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101383","url":null,"abstract":"<div><p>Several studies have indicated the presence of a retention effect of admission testing in higher education, but so far little is known about the possible mechanisms behind such an effect. The aim of this study was to examine the associations between admission testing, selected psychological attributes, program performance and early dropout at university for two admission tracks (grade-based admission and test-based admission). Students from five faculties were surveyed at baseline in a prospective cohort study design. Multivariate logistic regression was used to model first-year dropout for 499 students. Results indicated the presence of a retention effect of pre-academic exam self-efficacy (PAE-SE) for the subgroup of students admitted via test-based admission. Implications of the results for research and admission testing practice are discussed.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101383"},"PeriodicalIF":2.6,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0191491X24000622/pdfft?md5=05f388d3d57524cdc972241d373e491d&pid=1-s2.0-S0191491X24000622-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141541988","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Unexpected gender differences in teacher ratings of academic skills and school track recommendations","authors":"Isa Steinmann","doi":"10.1016/j.stueduc.2024.101384","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101384","url":null,"abstract":"<div><p>Previous research suggests that girls get better school marks and are more often recommended for academic school tracks after primary school. Using data from a representative sample of 4529 students who were followed longitudinally between grades 1–4 in Germany, this study adds nuance to this picture. In simple logistic regression models, girls were found to get more favourable teacher ratings in terms of language and written skills and more favourable school track recommendations, while boys got better teacher ratings in terms of nature knowledge and mathematical skills. In models that included control variables (achievement test scores, teacher-rated ability to concentrate, teacher-rated social skills, and teacher-rated personality characteristics), gender gaps shifted to the boys’ advantage, with written skills remaining the only domain with female advantages. Linear growth models showed that in three out of four cases, gender gaps in teacher-rated skills widened over the course of primary school.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101384"},"PeriodicalIF":2.6,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0191491X24000634/pdfft?md5=22845738e1f998a37374c3e1304995a0&pid=1-s2.0-S0191491X24000634-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141541989","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Developing career-related skills through project-based learning","authors":"Yoonhee Lee, Bora Lee","doi":"10.1016/j.stueduc.2024.101378","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101378","url":null,"abstract":"<div><p>In the future world of work, problem-solving skills will continue to be important assets for youths. The present study tested the effectiveness of a 16-week and an additional 5-week project-based learning program designed for improving problem-solving skills. Data were collected from 97 youth (<em>M</em><sub>age</sub> = 23.03), who participated in the program, using three different sources of assessment (i.e., self, peer, rater) and two methods of measurement (i.e., survey questionnaires, task performance). A two-level hierarchical linear model was applied to data. Results from self-reports showed that problem-solving skills increased after 16-week participation, but no extra improvement was found by participating in an additional 5-week booster program. When using peers’ and raters’ reports, the participants’ skills also significantly improved throughout the 16-week program. The implications of the findings on theory are discussed.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101378"},"PeriodicalIF":2.6,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141480493","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Learning together through collaborative writing: The power of peer feedback and discussion in doctoral writing groups","authors":"Basil Cahusac de Caux , Lynette Pretorius","doi":"10.1016/j.stueduc.2024.101379","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101379","url":null,"abstract":"<div><p>This paper explores the power of collaborative peer feedback within doctoral writing groups by examining the effects of the feedback process that was implemented as part of a book project. Using <em>communities of practice</em> as a guiding theoretical framework, we identify that participants discovered how working together helped them foster collegiality, trust, and collective learning. Furthermore, writing group members felt that collaborative peer feedback helped them develop a shared repertoire and understanding of academic writing and publishing. Participants perceived collaborative peer feedback as a way to improve academic writing proficiency, build self-esteem, and foster confidence. Importantly, participants saw the experiential learning process applied in this book project as a way to discover previously tacit understandings or obscure practices in academia. Consequently, the findings of this study demonstrate that collaborative peer feedback within a safe space can foster learning-focused feedback when students are active and reflexive agents in the feedback process.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101379"},"PeriodicalIF":2.6,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0191491X24000580/pdfft?md5=409eb0fc4ad5d44c2dc5dedbc66593ce&pid=1-s2.0-S0191491X24000580-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141480491","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Denis Federiakin , Olga Zlatkin-Troitschanskaia , William B. Walstad
{"title":"Estimating the dimensionality of learning: The model for decomposed change","authors":"Denis Federiakin , Olga Zlatkin-Troitschanskaia , William B. Walstad","doi":"10.1016/j.stueduc.2024.101377","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101377","url":null,"abstract":"<div><p>Psychometrics traditionally has assumed that the changes occurring during learning have the same dimensionality as the targeted construct. This approach is akin to understanding learning as climbing a mountain: for each ability a student can increase their ability, decrease it, or not change it. However, an alternative approach has recently been suggested – learning score analysis. This analysis is grounded in the assumption that students “slide through” the curriculum rather than “climb it”: they forget something to learn something. This approach suggests that positive and negative dynamics can occur at the same time. This suggestion is also supported by the evidence from cognitive psychology that learning and forgetting are separate cognitive processes. Hence, we contrast the traditional approach to conceptualizing growth and change to the alternative approach. We use IRT-based modeling to compare the results from both approaches, and show that the alternative approach provides more insight into learning.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101377"},"PeriodicalIF":2.6,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0191491X24000567/pdfft?md5=37c8349e8748278ba6484be3b803adee&pid=1-s2.0-S0191491X24000567-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141480492","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yueyang Shao , Qimeng Liu , Yaoyao Dong , Jian Liu
{"title":"Perceived formative assessment practices in homework and creativity competence: The mediating effects of self-confidence in learning and intrinsic motivation","authors":"Yueyang Shao , Qimeng Liu , Yaoyao Dong , Jian Liu","doi":"10.1016/j.stueduc.2024.101376","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101376","url":null,"abstract":"<div><p>The aim of this study was to explore the impact mechanism of teachers' formative assessment on students' creativity competence. Herein, structural equation modeling (SEM) was utilized to investigate the potential mediating role of self-confidence in learning and intrinsic motivation based on large-scale longitudinal tracking data. The results indicate that, after controlling for pretests of creativity competence, socioeconomic status (SES), and gender, it was found that formative assessment practices have a direct and positive predictive power for creativity competence (the direct effect accounts for 39.4 %). Furthermore, formative assessment practices indirectly and positively predict creativity competence through the mediation of self-confidence in learning (the indirect effect accounts for 10.0 %) and intrinsic motivation (the indirect effect accounts for 50.6 %). We conclude that the main contribution from formative assessment to creativity may be in building an environment that fosters self-confidence in learning and intrinsic motivation.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101376"},"PeriodicalIF":2.6,"publicationDate":"2024-06-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141483720","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Magnus Österholm , Tomas Bergqvist , Yvonne Liljekvist , Jorryt van Bommel
{"title":"Professional development at national scale: Effects on teacher knowledge and practice","authors":"Magnus Österholm , Tomas Bergqvist , Yvonne Liljekvist , Jorryt van Bommel","doi":"10.1016/j.stueduc.2024.101381","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101381","url":null,"abstract":"<div><p>The purpose of this study is to examine the effects of a Swedish nation-wide professional development on participating teachers’ teaching practice and their knowledge, where collegial work, as a central part of the professional development, is taken into account as a factor to influence the outcome. We conducted statistical analyses (linear mixed models) on observational and interview data from a random selection of 105 teachers (grades 1–10/primary and secondary school). The results show effects on several aspects of teacher knowledge and teacher practice. However, the results show no connections between how the teachers have worked collegially and the observed changes in the teacher’s knowledge and practice.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101381"},"PeriodicalIF":2.6,"publicationDate":"2024-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0191491X24000609/pdfft?md5=5e6cf72343564bcfae5935f76453b074&pid=1-s2.0-S0191491X24000609-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141480490","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Classroom heterogeneity and assessment for learning: Evidence from 47 countries using TALIS 2018","authors":"Youngshin Lim","doi":"10.1016/j.stueduc.2024.101375","DOIUrl":"https://doi.org/10.1016/j.stueduc.2024.101375","url":null,"abstract":"<div><p>Despite extensive research on Assessment for Learning (AfL) in the classroom, the importance of contextual factors as perceived by teachers remains underexplored. This study examines the extent to which elements of the classroom context, in particular heterogeneity, influence the frequency of AfL. Using 2018 TALIS data from 47 countries, this study found that teachers who perceived higher levels of heterogeneity in their classrooms conducted more frequent classroom assessments. The degree of AfL was most significantly influenced by the perception of heterogeneity among academically gifted students, followed by socioeconomically disadvantaged students, immigrant students, students whose first language is different from the language of instruction, and students with behavioral problems. Interestingly, when teachers perceive a higher proportion of low-achieving students, the frequency of AfL tends to decrease. These findings suggest that AfL can be used not only as a tool in circumstances where learning processes are challenging, but also as an approach to understanding and addressing the diverse learning potentials and backgrounds in the classroom.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101375"},"PeriodicalIF":3.1,"publicationDate":"2024-06-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141303259","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}