7个国家的退伍军人和急救人员异质性预防和/或早期干预项目评估和影响分析的生态系统方法。

IF 4.3 2区医学 Q1 PSYCHIATRY

Comprehensive psychiatry Pub Date : 2025-01-25 DOI:10.1016/j.comppsych.2025.152578

S. Lukersmith , L. Salvador-Carulla , C. Woods , T. Niyonsenga , M.R. Gutierrez-Colosia , I. Mohanty , C.R. Garcia-Alonso , D. Diaz-Milanes , J.A. Salinas-Perez , R. Davey , A. Aryani

{"title":"7个国家的退伍军人和急救人员异质性预防和/或早期干预项目评估和影响分析的生态系统方法。","authors":"S. Lukersmith , L. Salvador-Carulla , C. Woods , T. Niyonsenga , M.R. Gutierrez-Colosia , I. Mohanty , C.R. Garcia-Alonso , D. Diaz-Milanes , J.A. Salinas-Perez , R. Davey , A. Aryani","doi":"10.1016/j.comppsych.2025.152578","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><div>Cumulative exposure to critical incidents and life-threatening events leads to significant risk for Veterans and First Responders (VFRs) developing mental ill health and disorders. Philanthropic organisations, Movember and Distinguished Gentleman's Ride, funded 15 organisations to conduct early intervention Projects across seven countries. The Projects aim to improve the mental health and wellbeing of VFRs, their families/significant others. This paper describes the novel external evaluation and impact analysis methods to identify effective Projects having positive impact on VFRs and their families, provide return on investment and the overall Grant Program.</div></div><div><h3>Methods</h3><div>We take an ecosystem real-world approach, which recognises the context and aims to manage the complexities involved, uses a complexity and systems perspective, multi-step mixed methods and approaches. The evaluation is from three perspectives of: Projects; Project comparisons; Grant program. Embedded in the evaluation design are methods, knowledge sharing and organisational learning activities for all stakeholders. Data is collected by the Projects and evaluation team on input, throughputs, and output indicators. Analysis tools include Global Impact Analytics Framework, multi-layered statistical analysis, performance evaluation using an efficient decision support approach, Project and Grant program social return on investment, visual linking and data connection platform and assessment of gendered lens approaches.</div></div><div><h3>Implications</h3><div>The complexity and heterogeneity of Projects implemented in the real world continues to present significant evaluation challenges and limitations for project leads, stakeholders, researchers and evaluators. Our ecosystem approach and novel evaluation methodology will reduce the uncertainty around real world implementation, provide key learnings for project stakeholders and more broadly implementation researchers.</div></div>","PeriodicalId":10554,"journal":{"name":"Comprehensive psychiatry","volume":"138 ","pages":"Article 152578"},"PeriodicalIF":4.3000,"publicationDate":"2025-01-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An ecosystem approach to the evaluation and impact analysis of heterogeneous preventive and/or early interventions projects for veterans and first responders in seven countries\",\"authors\":\"S. Lukersmith , L. Salvador-Carulla , C. Woods , T. Niyonsenga , M.R. Gutierrez-Colosia , I. Mohanty , C.R. Garcia-Alonso , D. Diaz-Milanes , J.A. Salinas-Perez , R. Davey , A. Aryani\",\"doi\":\"10.1016/j.comppsych.2025.152578\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Background</h3><div>Cumulative exposure to critical incidents and life-threatening events leads to significant risk for Veterans and First Responders (VFRs) developing mental ill health and disorders. Philanthropic organisations, Movember and Distinguished Gentleman's Ride, funded 15 organisations to conduct early intervention Projects across seven countries. The Projects aim to improve the mental health and wellbeing of VFRs, their families/significant others. This paper describes the novel external evaluation and impact analysis methods to identify effective Projects having positive impact on VFRs and their families, provide return on investment and the overall Grant Program.</div></div><div><h3>Methods</h3><div>We take an ecosystem real-world approach, which recognises the context and aims to manage the complexities involved, uses a complexity and systems perspective, multi-step mixed methods and approaches. The evaluation is from three perspectives of: Projects; Project comparisons; Grant program. Embedded in the evaluation design are methods, knowledge sharing and organisational learning activities for all stakeholders. Data is collected by the Projects and evaluation team on input, throughputs, and output indicators. Analysis tools include Global Impact Analytics Framework, multi-layered statistical analysis, performance evaluation using an efficient decision support approach, Project and Grant program social return on investment, visual linking and data connection platform and assessment of gendered lens approaches.</div></div><div><h3>Implications</h3><div>The complexity and heterogeneity of Projects implemented in the real world continues to present significant evaluation challenges and limitations for project leads, stakeholders, researchers and evaluators. Our ecosystem approach and novel evaluation methodology will reduce the uncertainty around real world implementation, provide key learnings for project stakeholders and more broadly implementation researchers.</div></div>\",\"PeriodicalId\":10554,\"journal\":{\"name\":\"Comprehensive psychiatry\",\"volume\":\"138 \",\"pages\":\"Article 152578\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2025-01-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Comprehensive psychiatry\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0010440X25000057\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHIATRY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Comprehensive psychiatry","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0010440X25000057","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHIATRY","Score":null,"Total":0}

引用次数: 0

摘要

背景：严重事件和危及生命事件的累积暴露会导致退伍军人和急救人员（VFRs）出现精神疾病和精神障碍的重大风险。慈善组织“胡子月”和“杰出绅士之旅”资助了15个组织在7个国家开展早期干预项目。这些计划旨在改善自愿者、其家人/重要他人的心理健康和福祉。本文描述了新的外部评估和影响分析方法，以确定对自愿者及其家庭有积极影响的有效项目，提供投资回报和整体资助计划。方法：我们采用生态系统现实世界的方法，它识别上下文，旨在管理所涉及的复杂性，使用复杂性和系统的角度，多步骤混合方法和方法。评价从三个方面进行：项目；项目比较;授予程序。在评估设计中嵌入了所有利益相关者的方法、知识共享和组织学习活动。项目和评估小组收集有关投入、吞吐量和产出指标的数据。分析工具包括全球影响分析框架、多层统计分析、使用高效决策支持方法的绩效评估、项目和赠款计划的社会投资回报、视觉链接和数据连接平台以及性别视角方法的评估。含义：在现实世界中实施的项目的复杂性和异质性继续对项目领导、利益相关者、研究人员和评估人员提出重大的评估挑战和限制。我们的生态系统方法和新颖的评估方法将减少现实世界实施中的不确定性，为项目利益相关者和更广泛的实施研究人员提供关键的学习。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

An ecosystem approach to the evaluation and impact analysis of heterogeneous preventive and/or early interventions projects for veterans and first responders in seven countries

Background

Cumulative exposure to critical incidents and life-threatening events leads to significant risk for Veterans and First Responders (VFRs) developing mental ill health and disorders. Philanthropic organisations, Movember and Distinguished Gentleman's Ride, funded 15 organisations to conduct early intervention Projects across seven countries. The Projects aim to improve the mental health and wellbeing of VFRs, their families/significant others. This paper describes the novel external evaluation and impact analysis methods to identify effective Projects having positive impact on VFRs and their families, provide return on investment and the overall Grant Program.

Methods

We take an ecosystem real-world approach, which recognises the context and aims to manage the complexities involved, uses a complexity and systems perspective, multi-step mixed methods and approaches. The evaluation is from three perspectives of: Projects; Project comparisons; Grant program. Embedded in the evaluation design are methods, knowledge sharing and organisational learning activities for all stakeholders. Data is collected by the Projects and evaluation team on input, throughputs, and output indicators. Analysis tools include Global Impact Analytics Framework, multi-layered statistical analysis, performance evaluation using an efficient decision support approach, Project and Grant program social return on investment, visual linking and data connection platform and assessment of gendered lens approaches.

Implications

The complexity and heterogeneity of Projects implemented in the real world continues to present significant evaluation challenges and limitations for project leads, stakeholders, researchers and evaluators. Our ecosystem approach and novel evaluation methodology will reduce the uncertainty around real world implementation, provide key learnings for project stakeholders and more broadly implementation researchers.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Comprehensive psychiatry 医学-精神病学

CiteScore

12.50

自引率

1.40%

发文量

审稿时长

29 days

期刊介绍： "Comprehensive Psychiatry" is an open access, peer-reviewed journal dedicated to the field of psychiatry and mental health. Its primary mission is to share the latest advancements in knowledge to enhance patient care and deepen the understanding of mental illnesses. The journal is supported by a diverse team of international editors and peer reviewers, ensuring the publication of high-quality research with a strong focus on clinical relevance and the implications for psychopathology. "Comprehensive Psychiatry" encourages authors to present their research in an accessible manner, facilitating engagement with clinicians, policymakers, and the broader public. By embracing an open access policy, the journal aims to maximize the global impact of its content, making it readily available to a wide audience and fostering scientific collaboration and public awareness beyond the traditional academic community. This approach is designed to promote a more inclusive and informed dialogue on mental health, contributing to the overall progress in the field.