Assessment in Education-Principles Policy & Practice最新文献

{"title":"Exploring the roles of academic self-concept and perseverance of effort in self-assessment practices","authors":"Lana T. Yang, Zi Yan, Di Zhang, D. Boud, J. A. Datu","doi":"10.1080/0969594X.2023.2191161","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2191161","url":null,"abstract":"ABSTRACT Based on the self-system processes model of motivation, we explored the mediating role of academic self-concept in the relationship between perseverance of effort and self-assessment. The results showed that perseverance of effort has a positive but not statistically significant association with self-assessment when controlling academic self-concept. The results supported our hypotheses that academic self-concept, whether at the domain-specific or component-specific level, significantly mediated the effect of the perseverance of effort on self-assessment, lending empirical support to the closer conceptual link between self-perceptions and self-assessment practices in learning. The results contribute to the literature of the three research lines (grit, academic self-concept and self-assessment) and suggest that academic self-concept enhancement interventions are beneficial not only to academic achievement based on the reciprocal relationship that has been well documented in the self-concept literature but also to self-assessment in the light of the self-system processes model of motivation.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2023-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86381719","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Examining the process of developing evaluative judgement in Japanese elementary schools—utilising the co-regulation and evaluative judgement model","authors":"Hideaki Yoshida, Kohei Nishizuka, Masahiro Arimoto","doi":"10.1080/0969594X.2023.2193332","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2193332","url":null,"abstract":"ABSTRACT To enhance the effectiveness of formative assessment and self-regulated learning, this study focused on evaluative judgement. A process for developing evaluative judgement and co-regulation had proposed. However, this co-regulation and evaluative judgement model lacks validation for use in classroom settings; the process of developing evaluative judgement remains unclear. Thus, this study aims to examine the processes of co-regulation and development of evaluative judgement by applying the co-regulation and evaluative judgement model in a Japanese elementary school. We confirmed that evaluative judgements are shared with students through co-regulation and that both evaluative judgements and learning outcomes are enhanced. The results support the co-regulation and evaluative judgement model and partially reveal the process of the development of evaluative judgement. Evaluative judgements are expected to expand the effectiveness of formative assessment and self-regulation.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2023-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79874673","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Pre-service and in-service assessment training: impacts on elementary teachers’ self-efficacy, attitudes, and data-driven decision making practice","authors":"Natalie Schelling, L. Rubenstein","doi":"10.1080/0969594X.2023.2202836","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2202836","url":null,"abstract":"ABSTRACT The purpose of this mixed-methods study is to examine the outcomes of assessment training for elementary teachers. Only 56% of the surveyed teachers (n = 283) had assessment training in their university courses, compared to 84% that received in-service training. The quantitative results indicate that frequency of assessment training is positively related to assessment self-efficacy, attitudes about assessment, and data-driven decision making practices. Within the qualitative data, teachers (n = 9) explained the conflicts within assessment training: idealism v. realism; pressure v. support; and technical competence v. transferrable understandings. This study demonstrates the importance of assessment training while providing several recommendations for enhancing the efficacy.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2023-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78057736","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Principals’ implementation of teacher evaluation and its relationship to intended purpose, perceived benefits, training and background variables","authors":"Barbara Fresko, Irit Levy-Feldman","doi":"10.1080/0969594X.2023.2166461","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2166461","url":null,"abstract":"ABSTRACT Teacher evaluation has evolved from a task used for administrative decisions to an activity whose main goal is the enhancement of student learning and well-being through the improvement of instruction. The actual implementation of teacher evaluation by school principals will determine greatly the extent to which it can achieve this goal. An attempt was made to examine how principals’ implementation of teacher evaluation was related to their reasons for evaluating (formative or summative), their perceptions of its benefits, their preparation for the evaluator role, and several background variables. Data were gathered by questionnaire from 219 school principals in Israel. Findings indicated that evaluating for improvement rather than for administrative reasons, believing teacher evaluation to benefit school functioning, and feeling adequately trained for the task significantly predicted fuller implementation of the teacher evaluation model. Implications of the findings for preparing and supporting school principals in their role as evaluators is discussed.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90917798","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Data literacy assessments: a systematic literature review","authors":"Yingqi Cui, Fu Chen, A. Lutsyk, Jacqueline P. Leighton, M. Cutumisu","doi":"10.1080/0969594X.2023.2182737","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2182737","url":null,"abstract":"ABSTRACT With the exponential increase in the volume of data available in the 21st century, data literacy skills have become vitally important in work places and everyday life. This paper provides a systematic review of available data literacy assessments targeted at different audiences and educational levels. The results can help researchers and practitioners better understand the current state of data literacy assessments in terms of issues related to 1) educational levels and audiences; 2) data literacy definitions and competencies; 3) assessment types and item formats; and 4) reliability and validity evidence. The results from the present review led us to conclude that teaching and assessing data literacy is still an emerging field in education. Therefore, high-quality assessment tools are greatly needed to provide valuable insights for students and instructors to monitor progress as well as facilitate and support teaching and learning.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75697879","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Feedback practices and transparency in data analysis","authors":"Therese N. Hopfenbeck","doi":"10.1080/0969594X.2023.2194706","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2194706","url":null,"abstract":"It has been well documented in the literature that feedback processes, when used timely and with high quality, can enhance students’ learning (Hattie & Timperley, 2007, Van Der Kleij & Lipnevich, 2021). Unfortunately, despite decades of research in feedback and formative assessment processes, we have few empirical studies investigating such feedback processes. We lack knowledge on how students act upon the feedback they receive, and even less studies apply experimental designs. The first article in this issue offers an important exception. Lipnevich et al. (2023) have conducted a study where the research team examined the influence of feedback comments and praise on student motivation and whether it had any impact on their performance. A total of 147 university students wrote an essay draft, received feedback (detailed comments, detailed comments and praise or control) before they revised their essays to address the feedback they had received. The study confirmed previous studies, documenting that those students who received the detailed feedback comments demonstrated higher motivation than students in the control group, but also greater improvement on their academic work. Further, students who received praise reported lower motivation and reduced improvement, compared to students who did not receive praise in addition to detailed comments. The research team discuss the paradoxical effects of praise and recommendations are provided on how to handle praise wisely in higher education. The second article published by Fresko and Levy-Feldman (2023) outlines the topic of teacher evaluation, an area which continues to be controversial across countries globally. In the current study, the researchers collected data from 219 school principals in Israel to investigate the purpose of teachers’ evaluations used. Analysis of the data indicated that teacher evaluations were mainly used for improvement rather than for administrative reasons. Further, it is reported that for teacher evaluation to benefit schools, principals believe adequate training for the task improves the processes. The research team discussthe implications of the findings and how to better support school principals in their role as evaluators. The third article in this issue tackle a controversial issue, with respect to sampling in OECD’s international assessment study, Programme for International Student Assessment (PISA). Andersson & Sandgren Massih (2023) have used data from PISA 2018 and investigated whether the students’ exclusions from PISA 2018 in Sweden followed the criteria set by the OECD. Since the inception of PISA in 2000, each of the participating countries have had to follow regulations on which students could be excluded (OECD, 2019a, b), and each country must report the exclusion rate of students. As such, some countries have reported higher exclusion rates than others. The authors of the current article have investigated what happened in Sweden when data were collected in 2","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78873427","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Anchored in praise? Potential manifestation of the anchoring bias in feedback reception","authors":"A. Lipnevich, F. J. Eßer, M. Park, N. Winstone","doi":"10.1080/0969594X.2023.2179956","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2179956","url":null,"abstract":"ABSTRACT Although feedback is one of the most important instructional techniques, strong empirical research on receiving feedback is scarce in comparison to research on feedback provision. In this experimental study, we examined the influence of detailed comments and praise on student motivation and change in performance. 147 university students wrote an essay draft, received feedback (detailed comments, detailed comments and praise, or control) and revised their essay based on feedback. First, we found that students who received detailed comments showed higher motivation and greater improvement compared to their counterparts in the control group. Second, we showed that students who received praise demonstrated lower motivation and reduced improvement, compared to students who did not receive praise in addition to detailed comments. This demonstration of paradoxical effects of praise in higher education is explained in the context of the anchoring bias suggesting that praise should be used wisely.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88574407","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"PISA 2018: did Sweden exclude students according to the rules?","authors":"C. Andersson, Sofia Sandgren Massih","doi":"10.1080/0969594X.2023.2189566","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2189566","url":null,"abstract":"ABSTRACT This study assesses whether student exclusions from PISA 2018 in Sweden followed the criteria set by the OECD. We do this using both qualitative and quantitative methods. Our conclusion is that the exclusions made in PISA 2018 in Sweden did not follow OECD criteria and were much too high. Furthermore, interviews with school coordinators indicate that many of them misunderstood the OECD criteria. We also conclude that the National Agency for Education did not sufficiently follow up on exclusions. A review of the Swedish exclusion rate made by the OECD did not present credible results but accepted the results. A recalculation of PISA 2018 scores for Sweden where we assume non-participating students to be low performers show that results are significantly affected.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73253104","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Teacher-made tests: why they matter and a framework for analysing mathematics exams","authors":"Sarah Wellberg","doi":"10.1080/0969594X.2023.2189565","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2189565","url":null,"abstract":"ABSTRACT Classroom assessment research in the United States has shifted away from the examination of teacher-made tests, but such tests are still widely used and have an enormous impact on students’ educational experiences. Given the major shifts in educational policy in the United States, including the widespread adoption of the Common Core State Standards, I argue that researchers should examine the tests and quizzes that teachers create and administer in order to determine whether those policies have had the intended impact of teachers’ assessment practices. Furthermore, these investigations should be grounded in discipline-specific conventions for developing and demonstrating knowledge. I then propose a research-based framework for analysing mathematics exams that focuses on alignment with learning goals, cognitive complexity, variety of task formats, attentiveness to culture and language, and clarity of expectation. This framework is meant to be used formatively, helping researchers, administrators, and teachers identify strengths and areas for growth.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79793384","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Current controversies in educational assessment","authors":"Therese N. Hopfenbeck","doi":"10.1080/0969594X.2022.2178602","DOIUrl":"https://doi.org/10.1080/0969594X.2022.2178602","url":null,"abstract":"As the global education community is adapting to life in a post-pandemic world, controversies in educational assessment continue to challenge researchers across countries and regions. Some of the controversies in educational assessment are linked to inequalities in the education system, and the fact that students do not have access to the same resources globally, which continues to impact them unfairly with respect to how they are assessed. Perhaps the most dramatic development in this respect is countries which continue to deny girls education, with Afghanistan as a recent example. It demonstrates how important it is to work even harder to reach the UN sustainable development goals, with aspiration for a world of peace, prosperity, and dignity where girls and women can live free from discrimination, and actively take part in education and sit exams for future higher education and careers. One of OECD’s ambitions is to provide evidence-based knowledge to policy makers about their education systems and to enhance equality for all students through their large-scale assessment studies such as PISA. Such ambition is thus dependent upon trust in the actual assessment and demands transparency in how concepts are measured and reported. In the first paper of this issue, Zieger et al. (2022) discusses the so-called ‘conditioning model’, which is part of the OECD’s Programme for International Student Assessment (PISA). The aim of the paper is to discuss this practice and use of the model, and what impact it has on the PISA results. PISA is widely used and cited globally after eight cycles of data collection in almost 100 countries, just during the first quarter of the century (Jerrim, 2023). Despite this prominence as the world’s largest and most known comparative international education study, the knowledge around how student background variables are used when deriving students’ achievement scores are less known. More specifically, in their paper, Zieger et al. (this issue) demonstrate that the conditioning model is sensitive to which background variables are included. In fact, changes to how background variables are used lead to changes in the ranking of countries and how they are compared in PISA. This was particularly the case with the variables around socioeconomic background, measures used to measure inequality on education. The authors understandably suggest this issue needs to be further addressed, both within and outside OECD, and results around comparisons of certain measures must be treated with caution. Debates around PISA and other international large-scale studies are not new, and controversial topics around calculations of scores and rankings have been an ongoing debate since the introduction of these studies (Goldstein, 2004). Nevertheless, the call for more openness around the use of different models and the impact it has on the rankings must be addressed, as such studies are dependent upon the public’s trust. ASSESSMENT IN EDUCATION: PRIN","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2022-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80916475","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}