Adam Klocek , Lenka Kollerová , Egle Havrdová , Monika Kotrbová , Jan Netík , Marek Pour
{"title":"捷克共和国 KiVa 反欺凌计划的效果:分组随机对照试验","authors":"Adam Klocek , Lenka Kollerová , Egle Havrdová , Monika Kotrbová , Jan Netík , Marek Pour","doi":"10.1016/j.evalprogplan.2024.102459","DOIUrl":null,"url":null,"abstract":"<div><h3>Aims</h3><p>One of the most widely used evidence-based anti-bullying programs, KiVa, originates from Finland and aims to change students’ peer context, activate teachers, and inform parents with two main components (universal preventive actions and indicated actions when bullying occurs), complemented by monitoring. Because research documented somewhat varied KiVa outcomes in different countries and because there is a lack of research focusing solely on the effectiveness of the universal and indicated actions, this study aimed to evaluate the effectiveness of KiVa main components when implemented in a new country. This two-arm parallel cluster randomized control trial (RCT) evaluated the effectiveness of the KiVa anti-bullying program in elementary schools in the Czech Republic. It examined the effects of the universal and indicated actions on self-reported bullying and victimization as primary outcomes and well-being as a secondary outcome, while keeping monitoring constant across the intervention and control schools. The study also examined the role of implementation fidelity on the proposed outcomes.</p></div><div><h3>Methods</h3><p>Schools were allocated via stratified randomization into a KiVa intervention group (12 schools, 35 classes, <em>N</em> = 407 students) or a wait-list control group (12 schools, 32 classes, <em>N</em> = 400 students). The study employed data from baseline and post-measurement waves, which were 10 months apart.</p></div><div><h3>Results</h3><p>The data were analyzed using linear mixed effects models, which showed no significant intervention or fidelity effects for bullying, victimization, and well-being. However, promising trends (at α < .10) were revealed, such as lower levels of bullying observed in the intervention group and in schools with high implementation fidelity. Additional analysis using Bayes factors supported these promising trends and provided moderate support for lower levels of victimization in the intervention group compared to the control schools.</p></div><div><h3>Conclusions</h3><p>Evaluation of effectiveness of anti-bullying programs could benefit from a more targeted fidelity assessment at the classroom or individual level and from distinguishing between the effects of the main components of the programs and the effects of monitoring. The promising yet non-significant intervention and fidelity effects suggest that schools may require enhanced support and longer implementation time frames than a single school year, especially when implementation faces structural obstacles, such as the Covid-19 pandemic.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"106 ","pages":"Article 102459"},"PeriodicalIF":1.5000,"publicationDate":"2024-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Effectiveness of the KiVa anti-bullying program in the Czech Republic: A cluster randomized control trial\",\"authors\":\"Adam Klocek , Lenka Kollerová , Egle Havrdová , Monika Kotrbová , Jan Netík , Marek Pour\",\"doi\":\"10.1016/j.evalprogplan.2024.102459\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Aims</h3><p>One of the most widely used evidence-based anti-bullying programs, KiVa, originates from Finland and aims to change students’ peer context, activate teachers, and inform parents with two main components (universal preventive actions and indicated actions when bullying occurs), complemented by monitoring. Because research documented somewhat varied KiVa outcomes in different countries and because there is a lack of research focusing solely on the effectiveness of the universal and indicated actions, this study aimed to evaluate the effectiveness of KiVa main components when implemented in a new country. This two-arm parallel cluster randomized control trial (RCT) evaluated the effectiveness of the KiVa anti-bullying program in elementary schools in the Czech Republic. It examined the effects of the universal and indicated actions on self-reported bullying and victimization as primary outcomes and well-being as a secondary outcome, while keeping monitoring constant across the intervention and control schools. The study also examined the role of implementation fidelity on the proposed outcomes.</p></div><div><h3>Methods</h3><p>Schools were allocated via stratified randomization into a KiVa intervention group (12 schools, 35 classes, <em>N</em> = 407 students) or a wait-list control group (12 schools, 32 classes, <em>N</em> = 400 students). The study employed data from baseline and post-measurement waves, which were 10 months apart.</p></div><div><h3>Results</h3><p>The data were analyzed using linear mixed effects models, which showed no significant intervention or fidelity effects for bullying, victimization, and well-being. However, promising trends (at α < .10) were revealed, such as lower levels of bullying observed in the intervention group and in schools with high implementation fidelity. Additional analysis using Bayes factors supported these promising trends and provided moderate support for lower levels of victimization in the intervention group compared to the control schools.</p></div><div><h3>Conclusions</h3><p>Evaluation of effectiveness of anti-bullying programs could benefit from a more targeted fidelity assessment at the classroom or individual level and from distinguishing between the effects of the main components of the programs and the effects of monitoring. The promising yet non-significant intervention and fidelity effects suggest that schools may require enhanced support and longer implementation time frames than a single school year, especially when implementation faces structural obstacles, such as the Covid-19 pandemic.</p></div>\",\"PeriodicalId\":48046,\"journal\":{\"name\":\"Evaluation and Program Planning\",\"volume\":\"106 \",\"pages\":\"Article 102459\"},\"PeriodicalIF\":1.5000,\"publicationDate\":\"2024-06-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Evaluation and Program Planning\",\"FirstCategoryId\":\"90\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0149718924000612\",\"RegionNum\":4,\"RegionCategory\":\"社会学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"SOCIAL SCIENCES, INTERDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Evaluation and Program Planning","FirstCategoryId":"90","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0149718924000612","RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"SOCIAL SCIENCES, INTERDISCIPLINARY","Score":null,"Total":0}
Effectiveness of the KiVa anti-bullying program in the Czech Republic: A cluster randomized control trial
Aims
One of the most widely used evidence-based anti-bullying programs, KiVa, originates from Finland and aims to change students’ peer context, activate teachers, and inform parents with two main components (universal preventive actions and indicated actions when bullying occurs), complemented by monitoring. Because research documented somewhat varied KiVa outcomes in different countries and because there is a lack of research focusing solely on the effectiveness of the universal and indicated actions, this study aimed to evaluate the effectiveness of KiVa main components when implemented in a new country. This two-arm parallel cluster randomized control trial (RCT) evaluated the effectiveness of the KiVa anti-bullying program in elementary schools in the Czech Republic. It examined the effects of the universal and indicated actions on self-reported bullying and victimization as primary outcomes and well-being as a secondary outcome, while keeping monitoring constant across the intervention and control schools. The study also examined the role of implementation fidelity on the proposed outcomes.
Methods
Schools were allocated via stratified randomization into a KiVa intervention group (12 schools, 35 classes, N = 407 students) or a wait-list control group (12 schools, 32 classes, N = 400 students). The study employed data from baseline and post-measurement waves, which were 10 months apart.
Results
The data were analyzed using linear mixed effects models, which showed no significant intervention or fidelity effects for bullying, victimization, and well-being. However, promising trends (at α < .10) were revealed, such as lower levels of bullying observed in the intervention group and in schools with high implementation fidelity. Additional analysis using Bayes factors supported these promising trends and provided moderate support for lower levels of victimization in the intervention group compared to the control schools.
Conclusions
Evaluation of effectiveness of anti-bullying programs could benefit from a more targeted fidelity assessment at the classroom or individual level and from distinguishing between the effects of the main components of the programs and the effects of monitoring. The promising yet non-significant intervention and fidelity effects suggest that schools may require enhanced support and longer implementation time frames than a single school year, especially when implementation faces structural obstacles, such as the Covid-19 pandemic.
期刊介绍:
Evaluation and Program Planning is based on the principle that the techniques and methods of evaluation and planning transcend the boundaries of specific fields and that relevant contributions to these areas come from people representing many different positions, intellectual traditions, and interests. In order to further the development of evaluation and planning, we publish articles from the private and public sectors in a wide range of areas: organizational development and behavior, training, planning, human resource development, health and mental, social services, mental retardation, corrections, substance abuse, and education.