Hongtu Chen, Komatra Chuengsatiansup, Dylan R Wong, Siranee Sihapark, Thawatchai Krisanaprakornkit, Bussabong Wisetpholchai, Sirinart Tongsiri, Ladson Hinton, Dolores Gallagher-Thompson, Abraham Wandersman, Andrea H Marques, Andrea Lamont, Sue E Levkoff
{"title":"Commentary: Strengthening System Readiness for Health Interventions: Lessons for Implementing Interventions and Implementation Support in Low-And Middle-Income Countries.","authors":"Hongtu Chen, Komatra Chuengsatiansup, Dylan R Wong, Siranee Sihapark, Thawatchai Krisanaprakornkit, Bussabong Wisetpholchai, Sirinart Tongsiri, Ladson Hinton, Dolores Gallagher-Thompson, Abraham Wandersman, Andrea H Marques, Andrea Lamont, Sue E Levkoff","doi":"10.1177/01632787241295322","DOIUrl":"https://doi.org/10.1177/01632787241295322","url":null,"abstract":"<p><p>In low- and middle-income countries (LMICs), barriers such as low system readiness, contextual mismatches, and resource limitations impede effective implementation of evidence-based interventions. This commentary offers insights into overcoming these challenges with a case study of the PRISM project, designed to reduce behavioral and psychological symptoms of dementia in older adults living in Thailand. The case highlights how combining two evidence-based models - the <i>Reducing Disability in Alzheimer's Disease</i> clinical intervention and the <i>Getting To Outcomes</i> implementation science process enhances program success. Using interviews with stakeholders across various health system levels, we identify factors critical to successful program implementation: (1) integrating interventions into policy frameworks, (2) empowering local implementers, (3) fostering collaborative learning, and (4) adapting interventions to local contexts. The case demonstrates that building system readiness through local engagement and ownership is central to scaling up health programs in LMICs. This commentary's contribution lies in its emphasis on the role of implementation science as a vehicle for translating research into practice. It presents a practical, adaptive model for embedding interventions into routine health systems, thereby offering a pathway for successfully scaling up evidence-based programs in LMICs. Such findings provide lessons for overcoming barriers to implementation in resource-limited environments.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142567415","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Brian K Bumbarger, Julia E Moore, Margaret E Crane
{"title":"Evidence-Based Implementation Support: Considering Motivation and Capacity Within the Ecosystem of Training and Technical Assistance.","authors":"Brian K Bumbarger, Julia E Moore, Margaret E Crane","doi":"10.1177/01632787241293457","DOIUrl":"https://doi.org/10.1177/01632787241293457","url":null,"abstract":"<p><p>This invited commentary reflects on Wandersman and Scheier's (2024) call for a more evidence-based model of training and technical assistance (i.e. TTA or implementation support). Their clarion call prompts us to consider what steps need to be taken to refine and scale a solution that genuinely enhances the effectiveness of TTA through a re-imagined model of implementation support. We highlight eight priorities to re-imagine a more effective and efficient model of TTA that reflects best practice and simultaneously contributes to continuous, collective evidence-building. The eight priorities include: (1) an ecosystem of TTA connecting TTA research and practice; (2) TTA capacity building; (3) health equity, and equitable partnerships; (4) trust and relationships; (5) TTA evaluation; (6) continuous quality improvement; (7) implementation support mechanisms; and (8) cost-effective solutions. We advocate for an international, cross-disciplinary, applied agenda aimed at establishing a robust empirical foundation for TTA to foster a culture of continuous quality improvement and knowledge generation across government agencies and philanthropies that fund TTA Centers. We describe a potential scenario for how funders can initiate and support evidence-based TTA.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142557508","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Who's at the Table? A Scoping Review of Stakeholder Engagement in Medical Education Program Evaluation.","authors":"Juliette Macabrey, Laura-Lou Wuest, David Buetti","doi":"10.1177/01632787241286911","DOIUrl":"https://doi.org/10.1177/01632787241286911","url":null,"abstract":"<p><p>Program evaluation is essential for medical schools to demonstrate social accountability and identify areas for improvement in medical education (MEd). Although stakeholder engagement is crucial in program evaluation, no previous review has specifically examined the stakeholders involved in MEd program evaluation. This scoping review addresses this gap by identifying the stakeholders, their roles, and their levels of engagement in evaluating MEd programs, along with the facilitators and barriers to their participation. Through a systematic search across four databases, we identified 53 relevant studies out of 7206 screened. Our findings reveal seven primary stakeholder groups, with students and program directors being the most frequent participants. However, a significant gap exists in the representation of community members and patients, indicating a need for greater inclusion of these key stakeholders. Additionally, we found that stakeholders are primarily engaged as passive participants providing feedback rather than actively shaping the evaluation process. Facilitators and barriers to participation were identified from the participants' perspective, highlighting the need for further research to understand the viewpoints of active stakeholders, such as faculty and administrators. Future studies should also explore the impact of different evaluation approaches on stakeholder engagement to develop more inclusive and effective MEd program evaluations.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142544591","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jonathan B VanGeest, Timothy P Johnson, Evgenia Kapousouz
{"title":"Monetary Incentives in Clinician Surveys: An Analysis and Systematic Review With a Focus on Establishing Best Practices.","authors":"Jonathan B VanGeest, Timothy P Johnson, Evgenia Kapousouz","doi":"10.1177/01632787241295794","DOIUrl":"https://doi.org/10.1177/01632787241295794","url":null,"abstract":"<p><p>Surveys involving health care providers continue to be characterized by low and declining response rates (RRs), and researchers have utilized various strategies to increase survey participation. An important approach is to employ monetary incentives to improve survey response. Using a systematic review and analyses of 100 randomized comparisons (published in 48 papers) between monetary incentives and a non-incentive condition, this paper seeks to advance the understanding of best practices for using monetary incentives in clinician surveys. These analyses show even small incentives (≤$2) to be effective in improving clinician response relative to non-incentive subgroups, with diminished returns associated with serial incremental increases above that amount up to amounts greater than $25, at which point there is an appreciable improvement, supporting the use of higher incentives in this population. Cash and direct cash equivalents (e.g., cash cards and checks) produced greater odds of survey participation compared to vouchers, lotteries and charitable contributions, with lotteries and charities being the least effective forms of monetary incentive. Survey mode, timing and ethical considerations are also addressed. Noting the challenges associated with surveying clinicians, researchers must make every effort to improve access to this difficult-to-reach population by implementing appropriate incentive-based strategies designed to improve participation rates.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142497794","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Eva S Potharst, Petra Holtkamp, Lily Walliser, Agnes H Dommerholt, Maartje E N van den Heuvel, Indra Spierts, Marija Maric
{"title":"Improving Infant Mental Health: A Pilot Study on the Effectiveness, Acceptability and Feasibility of Eye Movement Desensitization and Reprocessing (EMDR) Storytelling in Infants With Post-traumatic Distress After Medical Procedures.","authors":"Eva S Potharst, Petra Holtkamp, Lily Walliser, Agnes H Dommerholt, Maartje E N van den Heuvel, Indra Spierts, Marija Maric","doi":"10.1177/01632787241268176","DOIUrl":"https://doi.org/10.1177/01632787241268176","url":null,"abstract":"<p><p>Although the prevalence of symptoms of post-traumatic stress disorder (PTSD) in infants and young children is similar as in older age groups, and PTSD intervention is as important in this age group, research on PTSD-treatment in infants is very scarce. Eye Movement Desensitization and Reprocessing (EMDR) Storytelling is a trauma-focused treatment that is being used by clinicians for infants with PTSD-symptoms. The aim was to assess the feasibility, acceptability and initial indications of effectiveness of EMDR Storytelling for infants aged 3-24 months with PTSD-symptoms after medical procedures. We included 6 infants and administered personalized items to assess PTSD-symptoms during the baseline, intervention and follow-up phase on a day-to-day basis. Furthermore, we measured PTSD-classification and symptoms at three and four measurement points, respectively. The data was analysed visually and quantitatively. EMDR Storytelling was shown to be feasible and acceptable for all participating families. Parent- and therapist-report showed that four out of the six infants included in the current study showed a clear reduction over time in PTSD-classification, -symptoms, and daily measured PTSD-symptoms. The results concerning the other two infants were mixed. Attention should be paid to cognitive (language) as well as interactional (infant-parent) mechanisms potentially underlying the benefits of EMDR Storytelling.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142497793","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Giovanni Piumatti, Manuel João Costa, Stefano Ardenghi, Anne Baroffio, Marta Elorduy, Margaret W Gerbase, Marie-Paule Gustin, Jordi Palés, Thelma Quince, Giulia Rampoldi, Maria Grazia Strepparava, Pia Thiemann, Montserrat Virumbrales, Patrício S Costa
{"title":"Cross-national Psychometric Evaluation of the Jefferson Scale of Empathy-Medical Student Version.","authors":"Giovanni Piumatti, Manuel João Costa, Stefano Ardenghi, Anne Baroffio, Marta Elorduy, Margaret W Gerbase, Marie-Paule Gustin, Jordi Palés, Thelma Quince, Giulia Rampoldi, Maria Grazia Strepparava, Pia Thiemann, Montserrat Virumbrales, Patrício S Costa","doi":"10.1177/01632787241296540","DOIUrl":"https://doi.org/10.1177/01632787241296540","url":null,"abstract":"<p><p>This study aimed to examine the factorial structure of the Jefferson Scale of Empathy-Medical student version (JSE-S) and assess items' discriminatory ability at higher and lower empathy levels in medical student populations from different countries and languages. JSE-S datasets were retrieved from previous studies of 4113 first- and/or second-year medical students from Switzerland, Portugal, Italy, Brazil, France, Spain, New Zealand, UK, Ireland, Mexico, and Peru. Parallel principal component analyses and item response theory were applied. Excluding item 18, the Compassionate Care subscale emerged in five samples (Switzerland, Portugal, Italy, France and UK/Ireland), Perspective Taking in three (Switzerland, Portugal and UK/Ireland) and Walking in Patient's Shoes in five (Switzerland, Portugal, Spain, UK/Ireland and Mexico/Peru). All subscales had items providing overlapping information. The JSE-S subscales had reliable high test performance at low empathy levels, while when the JSE-S increased, the standard error also increased. There was no consistent support across countries for the JSE-S three-factorial structure. Items provided redundant information and discriminatory power decreased when aiming to differentiate students at high empathy levels. A JSE-S revision to improve cross-cultural comparability, results' generalizability and validity should focus on suppressing or reformulating items that cannot differentiate medical students' empathy.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142497792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Andrea E Lamont, Amber Watson, Brittany S Cook, Andrew Romero, Kellen Schalter, Abigail Nellis, Kristina Clark, Ariel Domlyn, Abraham Wandersman
{"title":"Barriers and Facilitators to Adopting a Systematic, Proactive, Evidence-Informed Technical Assistance System.","authors":"Andrea E Lamont, Amber Watson, Brittany S Cook, Andrew Romero, Kellen Schalter, Abigail Nellis, Kristina Clark, Ariel Domlyn, Abraham Wandersman","doi":"10.1177/01632787241293756","DOIUrl":"https://doi.org/10.1177/01632787241293756","url":null,"abstract":"<p><p>This article describes (a) key elements of a high-quality technical assistance (TA) system; (b) the operationalization of a high-quality TA system (Getting To Outcomes-Technical Assistance; GTO-TA) being implemented in a training and TA center (TTAC) interested in transforming its support services to include an evidence-informed approach to TA; and (c) key lessons learned in successfully transitioning from \"TA-as-usual\" to an evidence-informed TA system. GTO-TA is one operationalization of a systematic, proactive, evidence-informed approach to TA. GTO-TA includes best practices and core elements for a comprehensive TA system; it aims to increase the readiness (reduce barriers and increase facilitators) of an organization to deliver an innovation (program, policy, practice, process new to an organization) with quality. We describe the collaboration between the Wandersman Center and the Geographic Health Equity Alliance team to co-design and implement the GTO-TA system. Data from surveys, interviews, and consensus conversations led to important lessons learned, which are applicable to other TTACs seeking to develop a more proactive and systematic approach to TA. Lessons include: changing internal operations to facilitate TA providers making necessary changes in providing TA and understanding the relative advantage perceptions about a new TA system that influence adoption and must be considered.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142461595","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lynn R Holdheide, David D Osher, Victoria L Cirks, Elizabeth Chagnon
{"title":"Developing a Set of Standardized Core Principles and Methods Across Multiple Training and Technical Assistance Centers.","authors":"Lynn R Holdheide, David D Osher, Victoria L Cirks, Elizabeth Chagnon","doi":"10.1177/01632787241291052","DOIUrl":"https://doi.org/10.1177/01632787241291052","url":null,"abstract":"<p><p>Despite a growing body of research demonstrating the value of using evidence-based programs and practices (EBPPs) to address health and education issues, the gap between research evidence and practice in education and human services continues to be a vexing problem. Technical assistance (TA) is widely accepted as a key strategy to support evidence-based programs and practices (EBPP) uptake and implementation. However, little is known about how TA practices are used in TA delivery. Moreover, little attention has been paid to building the capacity of TA providers and assessing the fidelity of the implementation of TA practices. The case example presented in this article describes one organization's efforts to develop common language and definitions of TA services, core principles, and methods, and to standardize the delivery of TA by enhancing the capacity and retention of TA providers. We conclude with recommendations about how like organizations can employ similar efforts to improve the quality and consistency of TA delivery, thereby establishing a foundation for building a strong evidence base.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142461598","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Collective Impact-Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers.","authors":"Lawrence M Scheier, Abraham H Wandersman","doi":"10.1177/01632787241295323","DOIUrl":"https://doi.org/10.1177/01632787241295323","url":null,"abstract":"<p><p>We introduce the second of two special issues that examine the science and practice of implementation support with takeaways for training and technical centers (TTACs). Major goals of both issues were to provide: rationale, concepts, and tools for evaluating training and technical assistance (TTA); an evidence-base for TTACs; and greater understanding of what is required to close the research-practice gap. To achieve these ambitious goals, we encouraged submissions from a broad array of individuals and groups involved in TTA. The seven articles in this second issue were written by a diverse mix of individuals affiliated with TTACs, federal agencies, research-oriented think tanks, and implementation scientists whose focus is on advancing the TTA literature. We felt that the collective wisdom garnered from their experiences would complement the first issue (June 2024) and collectively forge ahead and provide a vision of what is to come. We also thought it would be useful to provide perspectives on what it looks like when readers could examine both issues as a whole. Therefore, we included five commentaries-from the two editors and esteemed colleagues-who help provide a holistic perspective on the present and future of the science and practice of implementation support.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142461597","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Charting Progress in the Science of Technical Assistance for Implementation of Evidence-Based Interventions.","authors":"David A Chambers, Gila I Neta","doi":"10.1177/01632787241293447","DOIUrl":"https://doi.org/10.1177/01632787241293447","url":null,"abstract":"<p><p>Technical assistance (TA) has long been a strategy utilized to support implementation of a range of different evidence-based interventions within clinical, community and other service settings. Great progress has come in extending the evidence base to support TA's use across multiple contexts, the result of more extensive categorizing of implementation strategies to support systematic studies of their effectiveness in facilitating successful implementation. This commentary builds on that progress to suggest several opportunities for future investigation and collaborative activity among researchers, practitioners, policymakers and other key decision-makers in hopes of continuing to build the success highlighted in this special issue and elsewhere. Authors call for increased attention to operationalization and tailoring of TA, considering how TA services can be sustained over time and how to consider externally-provided TA versus that housed within an organization. In addition, the commentary suggests a few key areas for capacity-building that can increase the quality, reach, and impact of TA for the future.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142461596","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}