Raymond V Gutterswijk, Chris H Z Kuiper, Annemiek T Harder, Frank C P van der Horst, Bruno R Bocanegra, Peter Prinzie
{"title":"Reducing Behavioral Problems and Treatment Duration of Adolescents in Secure Residential Care: A Multiple Single-Case Experimental Design Study.","authors":"Raymond V Gutterswijk, Chris H Z Kuiper, Annemiek T Harder, Frank C P van der Horst, Bruno R Bocanegra, Peter Prinzie","doi":"10.1177/01632787241228552","DOIUrl":"https://doi.org/10.1177/01632787241228552","url":null,"abstract":"<p><p>Secure residential care (SRC) is criticized for several reasons. Therefore, in many countries, the general policy is to limit the length of stay of adolescents in SRC. However, research on length of stay and treatment effects of SRC on adolescents' behavioral problems is sparse. Using single case experimental designs with time-series, forty adolescents referred to SRC completed a questionnaire on behavioral and attention problems every two weeks during a baseline (A) and treatment period (B). Two-level regression analyses were used to investigate the effects of SRC on behavioral and attention problems. In addition, we tested whether length of stay moderated effectiveness. On the individual level, the treatment showed a positive statistically significant effect on the behavioral problems of 0%-8% of the adolescents and a statistically significant negative effect on behavioral problems was found in 3%-10% of the adolescents. On the group level, adolescents showed no significant decrease in problem behavior or attention problems from baseline to discharge. Length of stay did not moderate the results. Based on the results we conclude that most adolescents fail to improve. In addition, length of stay was not associated with effectiveness, nor could it be explained by adolescents' characteristics.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"1632787241228552"},"PeriodicalIF":2.2,"publicationDate":"2024-12-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142767603","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abraham Wandersman, Brittany S Cook, Kristina Clark, Paul Flaspohler, Amber Watson, Andrea E Lamont
{"title":"Commentary: Bridging and Reducing the Gaps Between Research and Practice: Pathways to Outcomes and the Interactive Systems Framework for Dissemination and Implementation 2.0.","authors":"Abraham Wandersman, Brittany S Cook, Kristina Clark, Paul Flaspohler, Amber Watson, Andrea E Lamont","doi":"10.1177/01632787241299820","DOIUrl":"10.1177/01632787241299820","url":null,"abstract":"<p><p>There are many ways proposed to achieve better societal outcomes (e.g., in health, education, and well-being) including: (1) bridging research and practice, (2) building the motivation and capacity of service delivery organizations (e.g., schools, hospitals, clinics, and community-based organizations) to innovate, and (c) providing service delivery systems with high-quality support via training and technical assistance. The Interactive Systems Framework for Dissemination and Implementation (ISF) was developed to describe how relevant systems, organizations, and processes can interact and work toward these goals. Stimulated by the 13 articles contained in the two special issues of <i>Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers</i>, we describe several enhancements to the ISF including: how service delivery systems can operate better, how motivation and capacity can be built, and how training and technical assistance centers can provide more evidence-informed technical assistance and other promising innovations. ISF 2.0 incorporates these and other enhancements with the goal of achieving better outcomes. We conclude that the actions and accountability of funders and of organizations and systems to funders would accelerate progress in the systems to achieve outcomes-and result in improving the science and practice of implementation support.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"494-506"},"PeriodicalIF":2.2,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142617856","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lynn R Holdheide, David D Osher, Victoria L Cirks, Elizabeth Chagnon
{"title":"Developing a Set of Standardized Core Principles and Methods Across Multiple Training and Technical Assistance Centers.","authors":"Lynn R Holdheide, David D Osher, Victoria L Cirks, Elizabeth Chagnon","doi":"10.1177/01632787241291052","DOIUrl":"10.1177/01632787241291052","url":null,"abstract":"<p><p>Despite a growing body of research demonstrating the value of using evidence-based programs and practices (EBPPs) to address health and education issues, the gap between research evidence and practice in education and human services continues to be a vexing problem. Technical assistance (TA) is widely accepted as a key strategy to support evidence-based programs and practices (EBPP) uptake and implementation. However, little is known about how TA practices are used in TA delivery. Moreover, little attention has been paid to building the capacity of TA providers and assessing the fidelity of the implementation of TA practices. The case example presented in this article describes one organization's efforts to develop common language and definitions of TA services, core principles, and methods, and to standardize the delivery of TA by enhancing the capacity and retention of TA providers. We conclude with recommendations about how like organizations can employ similar efforts to improve the quality and consistency of TA delivery, thereby establishing a foundation for building a strong evidence base.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"420-436"},"PeriodicalIF":2.2,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142461598","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hongtu Chen, Komatra Chuengsatiansup, Dylan R Wong, Siranee Sihapark, Thawatchai Krisanaprakornkit, Bussabong Wisetpholchai, Sirinart Tongsiri, Ladson Hinton, Dolores Gallagher-Thompson, Abraham Wandersman, Andrea H Marques, Andrea E Lamont, Sue E Levkoff
{"title":"Commentary: Strengthening System Readiness for Health Interventions: Lessons for Implementing Interventions and Implementation Support in Low-And Middle-Income Countries.","authors":"Hongtu Chen, Komatra Chuengsatiansup, Dylan R Wong, Siranee Sihapark, Thawatchai Krisanaprakornkit, Bussabong Wisetpholchai, Sirinart Tongsiri, Ladson Hinton, Dolores Gallagher-Thompson, Abraham Wandersman, Andrea H Marques, Andrea E Lamont, Sue E Levkoff","doi":"10.1177/01632787241295322","DOIUrl":"10.1177/01632787241295322","url":null,"abstract":"<p><p>In low- and middle-income countries (LMICs), barriers such as low system readiness, contextual mismatches, and resource limitations impede effective implementation of evidence-based interventions. This commentary offers insights into overcoming these challenges with a case study of the PRISM project, designed to reduce behavioral and psychological symptoms of dementia in older adults living in Thailand. The case highlights how combining two evidence-based models - the <i>Reducing Disability in Alzheimer's Disease</i> clinical intervention and the <i>Getting To Outcomes</i> implementation science process enhances program success. Using interviews with stakeholders across various health system levels, we identify factors critical to successful program implementation: (1) integrating interventions into policy frameworks, (2) empowering local implementers, (3) fostering collaborative learning, and (4) adapting interventions to local contexts. The case demonstrates that building system readiness through local engagement and ownership is central to scaling up health programs in LMICs. This commentary's contribution lies in its emphasis on the role of implementation science as a vehicle for translating research into practice. It presents a practical, adaptive model for embedding interventions into routine health systems, thereby offering a pathway for successfully scaling up evidence-based programs in LMICs. Such findings provide lessons for overcoming barriers to implementation in resource-limited environments.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"475-483"},"PeriodicalIF":2.2,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142567415","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Andrea E Lamont, Amber Watson, Brittany S Cook, Andrew Romero, Kellen Schalter, Abigail Nellis, Kristina Clark, Ariel Domlyn, Abraham Wandersman
{"title":"Barriers and Facilitators to Adopting a Systematic, Proactive, Evidence-Informed Technical Assistance System.","authors":"Andrea E Lamont, Amber Watson, Brittany S Cook, Andrew Romero, Kellen Schalter, Abigail Nellis, Kristina Clark, Ariel Domlyn, Abraham Wandersman","doi":"10.1177/01632787241293756","DOIUrl":"10.1177/01632787241293756","url":null,"abstract":"<p><p>This article describes (a) key elements of a high-quality technical assistance (TA) system; (b) the operationalization of a high-quality TA system (Getting To Outcomes-Technical Assistance; GTO-TA) being implemented in a training and TA center (TTAC) interested in transforming its support services to include an evidence-informed approach to TA; and (c) key lessons learned in successfully transitioning from \"TA-as-usual\" to an evidence-informed TA system. GTO-TA is one operationalization of a systematic, proactive, evidence-informed approach to TA. GTO-TA includes best practices and core elements for a comprehensive TA system; it aims to increase the readiness (reduce barriers and increase facilitators) of an organization to deliver an innovation (program, policy, practice, and process new to an organization) with quality. We describe the collaboration between the Wandersman Center and the Geographic Health Equity Alliance team to co-design and implement the GTO-TA system. Data from surveys, interviews, and consensus conversations led to important lessons learned, which are applicable to other TTACs seeking to develop a more proactive and systematic approach to TA. Lessons include: changing internal operations to facilitate TA providers making necessary changes in providing TA and understanding the relative advantage perceptions about a new TA system that influence adoption and must be considered.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"353-368"},"PeriodicalIF":2.2,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142461595","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Collective Impact-Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers.","authors":"Lawrence M Scheier, Abraham Wandersman","doi":"10.1177/01632787241295323","DOIUrl":"10.1177/01632787241295323","url":null,"abstract":"<p><p>We introduce the second of two special issues that examine the science and practice of implementation support with takeaways for training and technical centers (TTACs). Major goals of both issues were to provide: rationale, concepts, and tools for evaluating training and technical assistance (TTA); an evidence-base for TTACs; and greater understanding of what is required to close the research-practice gap. To achieve these ambitious goals, we encouraged submissions from a broad array of individuals and groups involved in TTA. The seven articles in this second issue were written by a diverse mix of individuals affiliated with TTACs, federal agencies, research-oriented think tanks, and implementation scientists whose focus is on advancing the TTA literature. We felt that the collective wisdom garnered from their experiences would complement the first issue (June 2024) and collectively forge ahead and provide a vision of what is to come. We also thought it would be useful to provide perspectives on what it looks like when readers could examine both issues as a whole. Therefore, we included five commentaries-from the two editors and esteemed colleagues-who help provide a holistic perspective on the present and future of the science and practice of implementation support.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"347-352"},"PeriodicalIF":2.2,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142461597","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ayana R Stanley, Calla Jamison, Alice Chen, Lindsey Barranco, Delaney Welsh, Katie Jones
{"title":"Embracing Complexity: Developing a Framework for Evaluating a Multi-Faceted Training and Technical Assistance System.","authors":"Ayana R Stanley, Calla Jamison, Alice Chen, Lindsey Barranco, Delaney Welsh, Katie Jones","doi":"10.1177/01632787241269069","DOIUrl":"10.1177/01632787241269069","url":null,"abstract":"<p><p>The benefits of training and technical assistance (TTA) have been well documented. There is limited literature that explores how complex systems of TTA are implemented and evaluated particularly in the violence prevention field. The Violence Prevention Practice and Translation Branch (VPPTB) within the Centers for Disease Control and Prevention's (CDC) Division of Violence Prevention funds multiple technical assistance providers who are tasked with building the capacity of program recipients to implement comprehensive approaches to prevent multiple forms of violence. VPPTB designed the Violence Prevention Technical Assistance Center (VPTAC) with the goal of implementing and evaluating comprehensive TTA efforts that integrates the work of multiple TTA providers to build the capacity of recipients to plan, implement, and evaluate violence prevention efforts. The VPTAC evaluation incorporates data from program recipients, TTA providers, and TTA modalities enabling the VPPTB staff to show improvement in technical knowledge, gather examples of enhanced implementation, and facilitate proactive TTA planning. An important step in the process of evaluating VPTAC from a system-level perspective required an expansion beyond evaluating a single TTA event, provider, or engagement. This is essential to understand how a diverse set of TTA activities and partners work together in their efforts to build capacity.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":"47 4","pages":"437-445"},"PeriodicalIF":2.2,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11686402/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142738984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Charting Progress in the Science of Technical Assistance for Implementation of Evidence-Based Interventions.","authors":"David A Chambers, Gila I Neta","doi":"10.1177/01632787241293447","DOIUrl":"10.1177/01632787241293447","url":null,"abstract":"<p><p>Technical assistance (TA) has long been a strategy utilized to support implementation of a range of different evidence-based interventions within clinical, community and other service settings. Great progress has come in extending the evidence base to support TA's use across multiple contexts, the result of more extensive categorizing of implementation strategies to support systematic studies of their effectiveness in facilitating successful implementation. This commentary builds on that progress to suggest several opportunities for future investigation and collaborative activity among researchers, practitioners, policymakers and other key decision-makers in hopes of continuing to build the success highlighted in this special issue and elsewhere. Authors call for increased attention to operationalization and tailoring of TA, considering how TA services can be sustained over time and how to consider externally-provided TA versus that housed within an organization. In addition, the commentary suggests a few key areas for capacity-building that can increase the quality, reach, and impact of TA for the future.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"484-487"},"PeriodicalIF":2.2,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142461596","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Brian K Bumbarger, Julia E Moore, Margaret E Crane
{"title":"Evidence-Based Implementation Support: Considering Motivation and Capacity Within the Ecosystem of Training and Technical Assistance.","authors":"Brian K Bumbarger, Julia E Moore, Margaret E Crane","doi":"10.1177/01632787241293457","DOIUrl":"10.1177/01632787241293457","url":null,"abstract":"<p><p>This invited commentary reflects on Wandersman and Scheier's (2024) call for a more evidence-based model of training and technical assistance (i.e. TTA or implementation support). Their clarion call prompts us to consider what steps need to be taken to refine and scale a solution that genuinely enhances the effectiveness of TTA through a re-imagined model of implementation support. We highlight eight priorities to re-imagine a more effective and efficient model of TTA that reflects best practice and simultaneously contributes to continuous, collective evidence-building. The eight priorities include: (1) an ecosystem of TTA connecting TTA research and practice; (2) TTA capacity building; (3) health equity, and equitable partnerships; (4) trust and relationships; (5) TTA evaluation; (6) continuous quality improvement; (7) implementation support mechanisms; and (8) cost-effective solutions. We advocate for an international, cross-disciplinary, applied agenda aimed at establishing a robust empirical foundation for TTA to foster a culture of continuous quality improvement and knowledge generation across government agencies and philanthropies that fund TTA Centers. We describe a potential scenario for how funders can initiate and support evidence-based TTA.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"488-493"},"PeriodicalIF":2.2,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142557508","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Matthew J Valente, Jinyong Pang, Judith J M Rijnhart, John Ferron, Milica Miočević
{"title":"Estimating Mediation Effects in ABAB Reversal Designs.","authors":"Matthew J Valente, Jinyong Pang, Judith J M Rijnhart, John Ferron, Milica Miočević","doi":"10.1177/01632787231217000","DOIUrl":"10.1177/01632787231217000","url":null,"abstract":"<p><p>Single-Case Experimental Designs (SCEDs), or N-of-1 trials, are commonly used to estimate intervention effects in many disciplines including in the treatment of youth mental health problems. SCEDs consist of repeated measurements of an outcome over time for a single case (e.g., student or patient) throughout one or more baseline phases and throughout one or more intervention phases. The manipulation of the baseline and intervention phase make the SCED a type of interrupted time series design, which is considered one of the most effective experimental designs for causal inference. An important step towards understanding why interventions are effective at producing a change in the outcome is through the investigation of mediating mechanisms. Hypotheses of mediating mechanisms involve an intervention variable which is hypothesized to affect an outcome through its effect on a mediating variable. Little work has attempted to combine mediation analysis and ABAB reversal designs. Therefore, the goals of this paper are to define, estimate, and interpret mediation effects for ABAB reversal designs. An empirical example is used to demonstrate how to estimate and interpret the mediation effects. R code is provided for researchers interested in estimating mediation effects in single-case reversal designs.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"1632787231217000"},"PeriodicalIF":2.2,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142667625","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}