Evaluation and Program Planning最新文献_第3页

The impact evaluation of short repeated programs: The case of parenting skills programs 短期重复计划的影响评估：育儿技能计划案例。

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-08-10 DOI: 10.1016/j.evalprogplan.2024.102476

{"title":"The impact evaluation of short repeated programs: The case of parenting skills programs","authors":"","doi":"10.1016/j.evalprogplan.2024.102476","DOIUrl":"10.1016/j.evalprogplan.2024.102476","url":null,"abstract":"<div><p>In this article, we estimate a series of models to evaluate the effects of a short program in a context where randomization is not feasible but the program follows a cyclical pattern. We will focus empirically on a case study involving parenting skills courses, which have become increasingly popular. In order to evaluate the impact of the program on parents’ and children outcomes, we employ two different methods. The first method compares the outcomes of families who have just finished the program with those who are about to start it; the second compares the outcomes of the same families over time. Furthermore, we propose a model to test whether families who enrolled early were systematically different from those who enrolled later. We find beneficial effects of the program on the importance of living in an area that offers opportunities and of having good quality relationships with friends and family; on the level of self-confidence in sharing one's experiences with other parents; and, in general, on the opinion that tablets and cell phones can be useful for learning, can give parents the opportunity to do something and can calm children. Moreover, we show that the families who access the course early are not random in every respect: they consistently assign higher importance to being well-integrated into a community and having access to culture for their well-being, and eventually, they utilize their time with children differently.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0149718924000788/pdfft?md5=075aa3d6601e7c8f3a3bfff3c7f9067a&pid=1-s2.0-S0149718924000788-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141996699","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Public healthcare efficiency in India: Estimates and determinants using two stage DEA approach 印度的公共医疗效率：使用两阶段 DEA 方法估算和决定因素

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-08-09 DOI: 10.1016/j.evalprogplan.2024.102472

{"title":"Public healthcare efficiency in India: Estimates and determinants using two stage DEA approach","authors":"","doi":"10.1016/j.evalprogplan.2024.102472","DOIUrl":"10.1016/j.evalprogplan.2024.102472","url":null,"abstract":"<div><h3>Background</h3><p>Nearly 400 million Indians (30 % of the total population) lack any financial protection for health which leads to very high out of pocket expenditure. In India more than 90 million people spend 10–25 % of household expenses on healthcare. This is a serious threat to Sustainable Development Goal 3, which aims at providing universal health coverage along with protection from catastrophic spending on health.</p></div><div><h3>Aim</h3><p>The aim of this paper is to estimate the efficiency and determinants of public health in India at subnational level.</p></div><div><h3>Methods</h3><p>To estimate the efficiency of public healthcare, input oriented bias corrected DEA model has been used. In this model life expectancy at birth and infant survival rate have been treated as outputs. Public health spending and per capita income are treated as inputs. In the second stage Tobit regression is used to analyse the determinants of efficiency.</p></div><div><h3>Results</h3><p>The mean bias corrected efficiency score across Indian states is 0.60, implying that on average there is a 40 % inefficiency in public healthcare in India. Maharashtra and Mizoram are the most and least efficient states with efficiency score of 0.921 and 0.218, respectively. Fourteen states have efficiency scores less than 0.60, two states have efficiency score of 0.60 and 15 states have the efficiency score greater than 0.60. Socio economic factors outweigh the medical factors in determining the public healthcare efficiency in India.</p></div><div><h3>Conclusion</h3><p>There are 40 % inefficiencies in public health in India implying significant wastages in public health. By improving public health efficiency, there would be savings of 48 % in terms of government expenditure on health per capita. It will also improve infant survival rate by 27.19 % and life expectancy by 20.65 %.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141990852","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Faculty Online Teaching Effectiveness Scale (FOTES): Instrument development and content validation 教师在线教学效果量表（FOTES）：工具开发与内容验证。

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-08-08 DOI: 10.1016/j.evalprogplan.2024.102474

{"title":"Faculty Online Teaching Effectiveness Scale (FOTES): Instrument development and content validation","authors":"","doi":"10.1016/j.evalprogplan.2024.102474","DOIUrl":"10.1016/j.evalprogplan.2024.102474","url":null,"abstract":"<div><p>This study aimed to develop and psychometrically test the Faculty Online Teaching Effectiveness Scale (FOTES) based upon both student and faculty perspectives of online teaching and learning in higher education. Online teaching effectiveness is a crucial component of quality education, but it has not been well-defined conceptually, and few studies have been conducted, using relevant domains, to accurately measure online teaching effectiveness. The impact of online course delivery on teaching effectiveness remains unclear. An exploratory sequential mixed methods design was employed with three phases of instrument development and psychometric testing. The FOTES comprises 50 items in seven domains: teaching philosophy, self-efficacy, relationships, course content, learning activities, teaching practices, and satisfaction. The instrument underwent initial testing, yielding positive expert appraisals with good-excellent psychometrics. All domains of the scale were significantly correlated, except for teaching philosophy. The preliminary results of the FOTES provide the empirical evidence to advance additional psychometric validation. This newly developed instrument has the potential to enhance faculty capacity and skill in self-evaluating their teaching effectiveness in online courses, providing a valid and reliable measure. The resulting instrument is poised to promote outcome evaluation and strengthen teaching and learning processes.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141976891","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Using Outcome Harvesting to evaluate socio-economic development and social innovation generated by Social Enterprises in complex areas. The case of BADAEL project in Lebanon 利用成果收获法评估复杂地区社会企业产生的社会经济发展和社会创新。黎巴嫩 BADAEL 项目案例。

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-08-08 DOI: 10.1016/j.evalprogplan.2024.102475

{"title":"Using Outcome Harvesting to evaluate socio-economic development and social innovation generated by Social Enterprises in complex areas. The case of BADAEL project in Lebanon","authors":"","doi":"10.1016/j.evalprogplan.2024.102475","DOIUrl":"10.1016/j.evalprogplan.2024.102475","url":null,"abstract":"<div><p>This paper delves into the utility of Outcome Harvesting as an effective methodology for evaluating development projects that seek to cultivate and advance social enterprises within intricate and multifaceted contexts. Amidst the ever-evolving socio-economic, political, and cultural dynamics characterizing complex environments, traditional evaluation approaches often fall short in capturing the nuanced outcomes of such projects. By adopting Outcome Harvesting, this study argues that evaluators gain a robust tool to systematically collect, analyze, and interpret the intended and unintended impacts of development initiatives in complex and changing contexts. The utilization of mixed methods in the gathering of both primary and secondary data to effectively implement the Outcome Harvesting method has been influenced by overarching theoretical frameworks in the realm of social enterprises. This approach resulted in a comprehensive research methodology that seeks to synergize the strengths of the Outcome Harvesting method within the broader context of understanding and advancing the concept of social entrepreneurship.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141914267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Technical efficiency and its determinants in healthcare systems of underdeveloped countries 不发达国家医疗系统的技术效率及其决定因素

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-08-08 DOI: 10.1016/j.evalprogplan.2024.102473

引用次数: 0

A theory of change evaluation of doctoral admission methods: A case study of a Chinese university 博士生招生方法的变革理论评估：中国大学案例研究。

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-07-31 DOI: 10.1016/j.evalprogplan.2024.102471

{"title":"A theory of change evaluation of doctoral admission methods: A case study of a Chinese university","authors":"","doi":"10.1016/j.evalprogplan.2024.102471","DOIUrl":"10.1016/j.evalprogplan.2024.102471","url":null,"abstract":"<div><p>In response to China's incentive for \"connotative development\" in doctoral education, universities are actively fostering creative and innovative PhD candidates with enhanced research productivity and superior educational quality. A Chinese university, aligning with this objective, has initiated significant reforms in its doctoral admission methods, introducing a new type of student and altering the proportion of existing ones. Recognizing the complexity and uncertainty inherent in the doctoral admission process, this theory-based study employs a Theory of Change framework to systematically evaluate the immediate, intermediate, and long-term outcomes of this university's interventions. It assesses the transformative impact of these changes by integrating secondary data with qualitative insights, including focus group discussions with twelve students and semi-structured interviews with three supervisors. The study reveals that while this university has made substantial progress in achieving short-term goals, these reforms have not uniformly benefited all student categories, presenting distinct challenges and opportunities for stakeholders. Consequently, it advocates for diversifying the student composition and emphasizes inclusive pedagogical strategies to facilitate high-quality doctoral education. Importantly, this research extends beyond this university, promoting a balanced mix of student profiles and a holistic approach to shaping effective policies and practices within doctoral admission, essential for navigating global competition.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141898655","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Impact of contextual factors on the evaluation outcomes of national virtual simulation experimental teaching projects in biology and medicine 背景因素对国家生物学和医学虚拟仿真实验教学项目评估结果的影响。

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-07-21 DOI: 10.1016/j.evalprogplan.2024.102470

{"title":"Impact of contextual factors on the evaluation outcomes of national virtual simulation experimental teaching projects in biology and medicine","authors":"","doi":"10.1016/j.evalprogplan.2024.102470","DOIUrl":"10.1016/j.evalprogplan.2024.102470","url":null,"abstract":"<div><p>The number of applications for National Virtual Simulation Experimental Teaching Projects (NVSETPs) in China has seen a significant increase. Consequently, the influence of contextual factors and their potential personal connections on the evaluation results, whether for national or non-national NVSETPs, has become a prominent concern. In this study, we employed a modified back-chaining method using logistic regression to examine whether contextual factors in NVSETP applications could explain the evaluation outcomes. Our analysis was based on data available on the open platform of China's Ministry of Education (MOE). We identified several significant influencing factors, including the score on a five-point rating system, the number of clicks on the application page, school quality, school region, and the gender, title, and position of the applicants. Our results shed light on the impact of contextual factors on the evaluation results of NVSETPs in the fields of biology and medicine, using a modified back-chaining method. We conclude that enhancing the transparency of the assessment process and implementing standardized, detailed scoring guidelines for NVSETPs would mitigate the negative influence of contextual factors.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141761705","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Development and validation of observational and qualitative study protocol reporting checklists for novice researchers (ObsQual checklist) 为新手研究人员开发和验证观察和定性研究协议报告核对表（ObsQual 核对表）

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-07-18 DOI: 10.1016/j.evalprogplan.2024.102468

引用次数: 0

Use of research evidence in U.S. federal policymaking: A reflexive report on intra-stage mixed methods 在美国联邦决策中使用研究证据：关于阶段内混合方法的反思性报告。

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-07-18 DOI: 10.1016/j.evalprogplan.2024.102469

{"title":"Use of research evidence in U.S. federal policymaking: A reflexive report on intra-stage mixed methods","authors":"","doi":"10.1016/j.evalprogplan.2024.102469","DOIUrl":"10.1016/j.evalprogplan.2024.102469","url":null,"abstract":"<div><p>The policymaking process is largely opaque, especially regarding the actual writing of the policy. To attempt to better understand this complex process, we utilized mixed methods in our evaluation of an intervention. However, the process of mixing methods can be messy, and thus may require recalibration during the evaluation itself. Yet, in comparison to reporting results, relatively little attention is paid to the effects of mixing methods on the evaluation process. In this article, we take a reflexive approach to reporting a mixed methods evaluation of an intervention on the use of research evidence in U.S. federal policymaking. We focus on the research process in a qualitative coding team, and the effects of mixing methods on that process. Additionally, we report in general terms how to interpret multinomial logistic regressions, an underused analysis type applicable to many evaluations. Thus, this reflexive piece contributes (1) findings from evaluation of the intervention on the policymaking process, (2) an example of mixing methods leading to unexpected findings and future directions, (3) a report about the evaluation process itself, and (4) a tutorial for those new to multinomial logistic regressions.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141761706","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Exploring the impact of digital concept mapping methods on nurse students’ learning anxiety, learning motivation 探索数字概念图方法对护生学习焦虑、学习动机的影响

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-07-14 DOI: 10.1016/j.evalprogplan.2024.102466

{"title":"Exploring the impact of digital concept mapping methods on nurse students’ learning anxiety, learning motivation","authors":"","doi":"10.1016/j.evalprogplan.2024.102466","DOIUrl":"10.1016/j.evalprogplan.2024.102466","url":null,"abstract":"<div><p>In involuntary distance education, like during epidemics and wars, students often feel heightened learning anxiety, impacting outcomes. Despite innovative teaching methods, many face hurdles in distance learning. We want to propose specific strategies to solve learning difficulties in distance education.</p></div><div><h3>Aim</h3><p>This study explored whether using digital concept maps (DCM) in physiology courses can reduce learning anxiety among nursing students.</p></div><div><h3>Design</h3><p>The study was quasi-experimental, including a pre-and post-test control group.</p></div><div><h3>Methods</h3><p>71 nursing students aged 16–18 enrolled in a physiology course were recruited in the study. DCM was the intervention as a tool for in-person learning (first 12 weeks) and distant learning (final six weeks). Each student was required to complete the assignments independently to compare learning outcomes. Questionnaires were administered, and an assignment evaluation was completed before and after the course's different formats.</p></div><div><h3>Results</h3><p>DCM using software using mobile vehicles (mobile, notebook, pad) is digital learning to help nursing students learn difficult subjects. DCM improved the students’ learning motivation and effectiveness more in distance learning than in-person learning, decreasing learning anxiety in both face-to-face and distance learning.</p></div><div><h3>Conclusions</h3><p>DCM promoted students’ self-regulated learning and positively affected learning outcomes by increasing motivation and reducing stress. This study offers a tailored teaching framework for international settings to reduce student anxiety and improve learning effectiveness.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141712006","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0