An ecosystem approach to the evaluation and impact analysis of heterogeneous preventive and/or early interventions projects for veterans and first responders in seven countries

IF 4.3 2区医学 Q1 PSYCHIATRY

Comprehensive psychiatry Pub Date : 2025-01-25 DOI:10.1016/j.comppsych.2025.152578

S. Lukersmith , L. Salvador-Carulla , C. Woods , T. Niyonsenga , M.R. Gutierrez-Colosia , I. Mohanty , C.R. Garcia-Alonso , D. Diaz-Milanes , J.A. Salinas-Perez , R. Davey , A. Aryani

{"title":"An ecosystem approach to the evaluation and impact analysis of heterogeneous preventive and/or early interventions projects for veterans and first responders in seven countries","authors":"S. Lukersmith , L. Salvador-Carulla , C. Woods , T. Niyonsenga , M.R. Gutierrez-Colosia , I. Mohanty , C.R. Garcia-Alonso , D. Diaz-Milanes , J.A. Salinas-Perez , R. Davey , A. Aryani","doi":"10.1016/j.comppsych.2025.152578","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><div>Cumulative exposure to critical incidents and life-threatening events leads to significant risk for Veterans and First Responders (VFRs) developing mental ill health and disorders. Philanthropic organisations, Movember and Distinguished Gentleman's Ride, funded 15 organisations to conduct early intervention Projects across seven countries. The Projects aim to improve the mental health and wellbeing of VFRs, their families/significant others. This paper describes the novel external evaluation and impact analysis methods to identify effective Projects having positive impact on VFRs and their families, provide return on investment and the overall Grant Program.</div></div><div><h3>Methods</h3><div>We take an ecosystem real-world approach, which recognises the context and aims to manage the complexities involved, uses a complexity and systems perspective, multi-step mixed methods and approaches. The evaluation is from three perspectives of: Projects; Project comparisons; Grant program. Embedded in the evaluation design are methods, knowledge sharing and organisational learning activities for all stakeholders. Data is collected by the Projects and evaluation team on input, throughputs, and output indicators. Analysis tools include Global Impact Analytics Framework, multi-layered statistical analysis, performance evaluation using an efficient decision support approach, Project and Grant program social return on investment, visual linking and data connection platform and assessment of gendered lens approaches.</div></div><div><h3>Implications</h3><div>The complexity and heterogeneity of Projects implemented in the real world continues to present significant evaluation challenges and limitations for project leads, stakeholders, researchers and evaluators. Our ecosystem approach and novel evaluation methodology will reduce the uncertainty around real world implementation, provide key learnings for project stakeholders and more broadly implementation researchers.</div></div>","PeriodicalId":10554,"journal":{"name":"Comprehensive psychiatry","volume":"138 ","pages":"Article 152578"},"PeriodicalIF":4.3000,"publicationDate":"2025-01-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Comprehensive psychiatry","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0010440X25000057","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHIATRY","Score":null,"Total":0}

引用次数: 0

Abstract

Background

Cumulative exposure to critical incidents and life-threatening events leads to significant risk for Veterans and First Responders (VFRs) developing mental ill health and disorders. Philanthropic organisations, Movember and Distinguished Gentleman's Ride, funded 15 organisations to conduct early intervention Projects across seven countries. The Projects aim to improve the mental health and wellbeing of VFRs, their families/significant others. This paper describes the novel external evaluation and impact analysis methods to identify effective Projects having positive impact on VFRs and their families, provide return on investment and the overall Grant Program.

Methods

We take an ecosystem real-world approach, which recognises the context and aims to manage the complexities involved, uses a complexity and systems perspective, multi-step mixed methods and approaches. The evaluation is from three perspectives of: Projects; Project comparisons; Grant program. Embedded in the evaluation design are methods, knowledge sharing and organisational learning activities for all stakeholders. Data is collected by the Projects and evaluation team on input, throughputs, and output indicators. Analysis tools include Global Impact Analytics Framework, multi-layered statistical analysis, performance evaluation using an efficient decision support approach, Project and Grant program social return on investment, visual linking and data connection platform and assessment of gendered lens approaches.

Implications

The complexity and heterogeneity of Projects implemented in the real world continues to present significant evaluation challenges and limitations for project leads, stakeholders, researchers and evaluators. Our ecosystem approach and novel evaluation methodology will reduce the uncertainty around real world implementation, provide key learnings for project stakeholders and more broadly implementation researchers.

查看原文本刊更多论文

求助全文

约1分钟内获得全文求助全文

来源期刊

Comprehensive psychiatry 医学-精神病学

CiteScore

12.50

自引率

1.40%

发文量

审稿时长

29 days

期刊介绍： "Comprehensive Psychiatry" is an open access, peer-reviewed journal dedicated to the field of psychiatry and mental health. Its primary mission is to share the latest advancements in knowledge to enhance patient care and deepen the understanding of mental illnesses. The journal is supported by a diverse team of international editors and peer reviewers, ensuring the publication of high-quality research with a strong focus on clinical relevance and the implications for psychopathology. "Comprehensive Psychiatry" encourages authors to present their research in an accessible manner, facilitating engagement with clinicians, policymakers, and the broader public. By embracing an open access policy, the journal aims to maximize the global impact of its content, making it readily available to a wide audience and fostering scientific collaboration and public awareness beyond the traditional academic community. This approach is designed to promote a more inclusive and informed dialogue on mental health, contributing to the overall progress in the field.