Assessment in Education-Principles Policy & Practice最新文献

{"title":"Exploring the roles of academic self-concept and perseverance of effort in self-assessment practices","authors":"Lana T. Yang, Zi Yan, Di Zhang, D. Boud, J. A. Datu","doi":"10.1080/0969594X.2023.2191161","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2191161","url":null,"abstract":"ABSTRACT Based on the self-system processes model of motivation, we explored the mediating role of academic self-concept in the relationship between perseverance of effort and self-assessment. The results showed that perseverance of effort has a positive but not statistically significant association with self-assessment when controlling academic self-concept. The results supported our hypotheses that academic self-concept, whether at the domain-specific or component-specific level, significantly mediated the effect of the perseverance of effort on self-assessment, lending empirical support to the closer conceptual link between self-perceptions and self-assessment practices in learning. The results contribute to the literature of the three research lines (grit, academic self-concept and self-assessment) and suggest that academic self-concept enhancement interventions are beneficial not only to academic achievement based on the reciprocal relationship that has been well documented in the self-concept literature but also to self-assessment in the light of the self-system processes model of motivation.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"45 1","pages":"104 - 129"},"PeriodicalIF":3.2,"publicationDate":"2023-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86381719","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Examining the process of developing evaluative judgement in Japanese elementary schools—utilising the co-regulation and evaluative judgement model","authors":"Hideaki Yoshida, Kohei Nishizuka, Masahiro Arimoto","doi":"10.1080/0969594X.2023.2193332","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2193332","url":null,"abstract":"ABSTRACT To enhance the effectiveness of formative assessment and self-regulated learning, this study focused on evaluative judgement. A process for developing evaluative judgement and co-regulation had proposed. However, this co-regulation and evaluative judgement model lacks validation for use in classroom settings; the process of developing evaluative judgement remains unclear. Thus, this study aims to examine the processes of co-regulation and development of evaluative judgement by applying the co-regulation and evaluative judgement model in a Japanese elementary school. We confirmed that evaluative judgements are shared with students through co-regulation and that both evaluative judgements and learning outcomes are enhanced. The results support the co-regulation and evaluative judgement model and partially reveal the process of the development of evaluative judgement. Evaluative judgements are expected to expand the effectiveness of formative assessment and self-regulation.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"40 1","pages":"151 - 176"},"PeriodicalIF":3.2,"publicationDate":"2023-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79874673","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Pre-service and in-service assessment training: impacts on elementary teachers’ self-efficacy, attitudes, and data-driven decision making practice","authors":"Natalie Schelling, L. Rubenstein","doi":"10.1080/0969594X.2023.2202836","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2202836","url":null,"abstract":"ABSTRACT The purpose of this mixed-methods study is to examine the outcomes of assessment training for elementary teachers. Only 56% of the surveyed teachers (n = 283) had assessment training in their university courses, compared to 84% that received in-service training. The quantitative results indicate that frequency of assessment training is positively related to assessment self-efficacy, attitudes about assessment, and data-driven decision making practices. Within the qualitative data, teachers (n = 9) explained the conflicts within assessment training: idealism v. realism; pressure v. support; and technical competence v. transferrable understandings. This study demonstrates the importance of assessment training while providing several recommendations for enhancing the efficacy.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"71 1","pages":"177 - 202"},"PeriodicalIF":3.2,"publicationDate":"2023-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78057736","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Data literacy assessments: a systematic literature review","authors":"Yingqi Cui, Fu Chen, A. Lutsyk, Jacqueline P. Leighton, M. Cutumisu","doi":"10.1080/0969594X.2023.2182737","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2182737","url":null,"abstract":"ABSTRACT With the exponential increase in the volume of data available in the 21st century, data literacy skills have become vitally important in work places and everyday life. This paper provides a systematic review of available data literacy assessments targeted at different audiences and educational levels. The results can help researchers and practitioners better understand the current state of data literacy assessments in terms of issues related to 1) educational levels and audiences; 2) data literacy definitions and competencies; 3) assessment types and item formats; and 4) reliability and validity evidence. The results from the present review led us to conclude that teaching and assessing data literacy is still an emerging field in education. Therefore, high-quality assessment tools are greatly needed to provide valuable insights for students and instructors to monitor progress as well as facilitate and support teaching and learning.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"21 1","pages":"76 - 96"},"PeriodicalIF":3.2,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75697879","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Principals’ implementation of teacher evaluation and its relationship to intended purpose, perceived benefits, training and background variables","authors":"Barbara Fresko, Irit Levy-Feldman","doi":"10.1080/0969594X.2023.2166461","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2166461","url":null,"abstract":"ABSTRACT Teacher evaluation has evolved from a task used for administrative decisions to an activity whose main goal is the enhancement of student learning and well-being through the improvement of instruction. The actual implementation of teacher evaluation by school principals will determine greatly the extent to which it can achieve this goal. An attempt was made to examine how principals’ implementation of teacher evaluation was related to their reasons for evaluating (formative or summative), their perceptions of its benefits, their preparation for the evaluator role, and several background variables. Data were gathered by questionnaire from 219 school principals in Israel. Findings indicated that evaluating for improvement rather than for administrative reasons, believing teacher evaluation to benefit school functioning, and feeling adequately trained for the task significantly predicted fuller implementation of the teacher evaluation model. Implications of the findings for preparing and supporting school principals in their role as evaluators is discussed.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"15 1","pages":"18 - 32"},"PeriodicalIF":3.2,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90917798","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Feedback practices and transparency in data analysis","authors":"Therese N. Hopfenbeck","doi":"10.1080/0969594X.2023.2194706","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2194706","url":null,"abstract":"It has been well documented in the literature that feedback processes, when used timely and with high quality, can enhance students’ learning (Hattie & Timperley, 2007, Van Der Kleij & Lipnevich, 2021). Unfortunately, despite decades of research in feedback and formative assessment processes, we have few empirical studies investigating such feedback processes. We lack knowledge on how students act upon the feedback they receive, and even less studies apply experimental designs. The first article in this issue offers an important exception. Lipnevich et al. (2023) have conducted a study where the research team examined the influence of feedback comments and praise on student motivation and whether it had any impact on their performance. A total of 147 university students wrote an essay draft, received feedback (detailed comments, detailed comments and praise or control) before they revised their essays to address the feedback they had received. The study confirmed previous studies, documenting that those students who received the detailed feedback comments demonstrated higher motivation than students in the control group, but also greater improvement on their academic work. Further, students who received praise reported lower motivation and reduced improvement, compared to students who did not receive praise in addition to detailed comments. The research team discuss the paradoxical effects of praise and recommendations are provided on how to handle praise wisely in higher education. The second article published by Fresko and Levy-Feldman (2023) outlines the topic of teacher evaluation, an area which continues to be controversial across countries globally. In the current study, the researchers collected data from 219 school principals in Israel to investigate the purpose of teachers’ evaluations used. Analysis of the data indicated that teacher evaluations were mainly used for improvement rather than for administrative reasons. Further, it is reported that for teacher evaluation to benefit schools, principals believe adequate training for the task improves the processes. The research team discussthe implications of the findings and how to better support school principals in their role as evaluators. The third article in this issue tackle a controversial issue, with respect to sampling in OECD’s international assessment study, Programme for International Student Assessment (PISA). Andersson & Sandgren Massih (2023) have used data from PISA 2018 and investigated whether the students’ exclusions from PISA 2018 in Sweden followed the criteria set by the OECD. Since the inception of PISA in 2000, each of the participating countries have had to follow regulations on which students could be excluded (OECD, 2019a, b), and each country must report the exclusion rate of students. As such, some countries have reported higher exclusion rates than others. The authors of the current article have investigated what happened in Sweden when data were collected in 2","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"17 1","pages":"1 - 3"},"PeriodicalIF":3.2,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78873427","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Anchored in praise? Potential manifestation of the anchoring bias in feedback reception","authors":"A. Lipnevich, F. J. Eßer, M. Park, N. Winstone","doi":"10.1080/0969594X.2023.2179956","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2179956","url":null,"abstract":"ABSTRACT Although feedback is one of the most important instructional techniques, strong empirical research on receiving feedback is scarce in comparison to research on feedback provision. In this experimental study, we examined the influence of detailed comments and praise on student motivation and change in performance. 147 university students wrote an essay draft, received feedback (detailed comments, detailed comments and praise, or control) and revised their essay based on feedback. First, we found that students who received detailed comments showed higher motivation and greater improvement compared to their counterparts in the control group. Second, we showed that students who received praise demonstrated lower motivation and reduced improvement, compared to students who did not receive praise in addition to detailed comments. This demonstration of paradoxical effects of praise in higher education is explained in the context of the anchoring bias suggesting that praise should be used wisely.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"1 1","pages":"4 - 17"},"PeriodicalIF":3.2,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88574407","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"PISA 2018: did Sweden exclude students according to the rules?","authors":"C. Andersson, Sofia Sandgren Massih","doi":"10.1080/0969594X.2023.2189566","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2189566","url":null,"abstract":"ABSTRACT This study assesses whether student exclusions from PISA 2018 in Sweden followed the criteria set by the OECD. We do this using both qualitative and quantitative methods. Our conclusion is that the exclusions made in PISA 2018 in Sweden did not follow OECD criteria and were much too high. Furthermore, interviews with school coordinators indicate that many of them misunderstood the OECD criteria. We also conclude that the National Agency for Education did not sufficiently follow up on exclusions. A review of the Swedish exclusion rate made by the OECD did not present credible results but accepted the results. A recalculation of PISA 2018 scores for Sweden where we assume non-participating students to be low performers show that results are significantly affected.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"25 1","pages":"33 - 52"},"PeriodicalIF":3.2,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73253104","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Teacher-made tests: why they matter and a framework for analysing mathematics exams","authors":"Sarah Wellberg","doi":"10.1080/0969594X.2023.2189565","DOIUrl":"https://doi.org/10.1080/0969594X.2023.2189565","url":null,"abstract":"ABSTRACT Classroom assessment research in the United States has shifted away from the examination of teacher-made tests, but such tests are still widely used and have an enormous impact on students’ educational experiences. Given the major shifts in educational policy in the United States, including the widespread adoption of the Common Core State Standards, I argue that researchers should examine the tests and quizzes that teachers create and administer in order to determine whether those policies have had the intended impact of teachers’ assessment practices. Furthermore, these investigations should be grounded in discipline-specific conventions for developing and demonstrating knowledge. I then propose a research-based framework for analysing mathematics exams that focuses on alignment with learning goals, cognitive complexity, variety of task formats, attentiveness to culture and language, and clarity of expectation. This framework is meant to be used formatively, helping researchers, administrators, and teachers identify strengths and areas for growth.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"458 1","pages":"53 - 75"},"PeriodicalIF":3.2,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79793384","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Numeracy across grades – vertically scaling the Norwegian national numeracy tests","authors":"Henrik Galligani Ræder, Björn Andersson, R. Olsen","doi":"10.1080/0969594X.2022.2147483","DOIUrl":"https://doi.org/10.1080/0969594X.2022.2147483","url":null,"abstract":"ABSTRACT Enabling comparable scores across grades is of interest for policymakers to evaluate educational systems, for researchers to investigate substantive questions, and for teachers to infer student growth. This study implemented a vertical scaling design to numeracy tests given in grades 5 and 8 as part of the Norwegian national testing system. Our design bridges the gap between grades 5 and 8 with a linking test tailored for grades 6 and 7, without the need for new item development. The design combines the existing administration for all grade 5 and 8 students with additional tests for samples of grade 6 and 7 students. The findings indicate that vertically scaling existing tests is possible through a cost-effective design and that numeracy, as measured by the Norwegian national tests, is comparable across four grades. We discuss the implications of our study for creating vertical scales in the context of national assessment systems.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"7 1","pages":"653 - 673"},"PeriodicalIF":3.2,"publicationDate":"2022-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90440221","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}