Seo Youn Choi, Amy Rusch, Annalise Lane, Celeste Liebrecht, Emily L Bilek, Daniel Eisenberg, Carolyn Andrews, Morgan Perry, Shawna N Smith
{"title":"Individual and organizational factors as predictors of early evidence-based practice adoption in Michigan high schools: Baseline data from an implementation trial.","authors":"Seo Youn Choi, Amy Rusch, Annalise Lane, Celeste Liebrecht, Emily L Bilek, Daniel Eisenberg, Carolyn Andrews, Morgan Perry, Shawna N Smith","doi":"10.1177/26334895231159429","DOIUrl":"10.1177/26334895231159429","url":null,"abstract":"<p><strong>Background: </strong>Adolescents increasingly access mental health services in schools. School mental health professionals (SPs; school counselors, social workers, etc.) can offer evidence-based mental health practices (EBPs) in schools, which may address access gaps and improve clinical outcomes. Although some studies have assessed factors associated with EBP adoption in schools, additional research focusing on SP- and school-level factors is warranted to support EBP implementation as SPs' mental health delivery grows.</p><p><strong>Methods: </strong>Baseline data were collected from SPs at Michigan high schools participating in a statewide trial to implement SP-delivered cognitive behavioral therapy (CBT) to students. Models examined factors associated with attitudes about EBPs, implementation climate, and implementation leadership, and their associations with CBT knowledge, training attendance, and pre-training CBT delivery.</p><p><strong>Results: </strong>One hundred ninety-eight SPs at 107 schools (87%) completed a baseline survey. The mean Evidence-Based Practice Attitude Scale (EBPAS) total score was 2.9, and school-aggregated mean scores of the Implementation Climate Scale (ICS) and Implementation Leadership Scale (ILS) were 1.83 and 1.77, respectively, all on a scale ranging from 0 (<i>low</i>) to 4 (<i>high</i>). ICS and ILS scores were lower than typically reported in clinical settings, while EBPAS scores were higher. School characteristics were not significantly associated with EBPAS, ICS, or ILS scores, but scores did differ by SP role. Higher EBPAS scores were associated with more CBT knowledge (average marginal effect for 1 <i>SD</i> change [AME] = 0.15 points) and a higher probability of training completion (AME = 8 percentage points). Higher ICS scores were associated with a higher probability of pre-training CBT delivery (AME = 6 percentage points), and higher ILS scores were associated with higher probability of training completion (AME = 10 percentage points).</p><p><strong>Conclusions: </strong>Our findings suggest that SPs' attitudes toward EBPs and organizational support were positively associated with early signs of implementation success. As schools increasingly fill the adolescent mental healthcare access gap, efforts to strengthen both provider attitudes toward EBP and strategic organizational factors supporting EBP delivery will be key to encouraging EBP uptake in schools.</p><p><strong>Plain language summary: </strong>Schools are an important setting in which adolescents receive mental healthcare. We need to better understand how to implement evidence-based practices (EBPs) in this setting to improve student mental health. This study examined the attitudes and perceptions of school professionals (SPs) as key contributors to the implementation of a particular EBP, the delivery of cognitive behavioral therapy (CBT) in schools. The study found that implementation climate and leadership scores in participating ","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"4 ","pages":"26334895231159429"},"PeriodicalIF":0.0,"publicationDate":"2023-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/2f/44/10.1177_26334895231159429.PMC10052498.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9757384","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Eve M Nagler, Mangesh Pednekar, Dhirendra Narain Sinha, Anne M Stoddard, Sameer Narake, Keyuri Adhikari, Leah Jones, Harry Lando, Mary Vriniotis, Prakash Gupta, Glorian Sorensen
{"title":"Implementation of an evidence-based tobacco control intervention for school teachers in India: Evaluating the effects of a capacity-building strategy.","authors":"Eve M Nagler, Mangesh Pednekar, Dhirendra Narain Sinha, Anne M Stoddard, Sameer Narake, Keyuri Adhikari, Leah Jones, Harry Lando, Mary Vriniotis, Prakash Gupta, Glorian Sorensen","doi":"10.1177/26334895231159428","DOIUrl":"10.1177/26334895231159428","url":null,"abstract":"<p><strong>Background: </strong><i>Tobacco-Free Teachers, Tobacco-Free Society</i> (TFT-TFS) is an evidence-based intervention that promotes tobacco use cessation among teachers and tobacco control policies among schools in India. This study tested an implementation model to build Bihar Department of Education (DOE) capacity to support and deliver TFT-TFS within schools, leveraging DOE training infrastructure.</p><p><strong>Method: </strong>We used a training-of-trainers (TOT) \"cascade\" implementation strategy to embed the TFT-TFS program into the Bihar DOE infrastructure. We trained 46 Cluster Coordinators to train and support Headmasters to implement TFT-TFS in their schools over one academic year. We selected three school districts, representing approximately 46 clusters and 219 schools. We used the RE-AIM framework to assess program adoption (Headmaster participation in at least one of six TFT-TFS trainings), implementation (of four core program components), and reach (teachers' participation in three or more group discussions). Using a non-inferiority design, we hypothesized that program adoption, implementation, and reach would not be inferior to the high standards demonstrated when TFT-TFS was originally tested in the Bihar School Teachers Study. We used self-reported checklists to measure outcomes and SPSS Version 25 to analyze data.</p><p><strong>Results: </strong>For adoption, 94% of Headmasters attended the first training, although participation declined by the sixth training. Among the 112 schools out of 219 with complete Headmaster checklist data, all met our minimum criteria for implementing TFT-TFS. Over 99% of schools posted a school tobacco control policy and distributed quit booklets. However, only 69% of schools met our criteria for program reach.</p><p><strong>Conclusions: </strong>This study outlines the processes for taking a tobacco control intervention to scale and implementing it through the Bihar DOE infrastructure. These findings provide a foundation for other Indian states and low- and middle-income countries to implement tobacco control and other health programs for schoolteachers.</p><p><strong>Trial registration: </strong>NCT05346991.</p><p><strong>Plain language summary: </strong>Each year in India, more than 1.2 million people die from tobacco-related causes, and India has the world's highest oral cancer burden. The world needs more evidence on how to bring cost-effective tobacco control interventions to scale, especially in low- and middle-income countries (LMICs). To address this gap, from 2017 to 2021, we examined the process of scaling up <i>Tobacco-Free Teachers, Tobacco-Free Society</i> (TFT-TFS), an evidence-based intervention promoting tobacco use cessation among teachers and tobacco control policies in schools. Our study tested an implementation model aimed at building the Bihar State Department of Education (DOE) capacity to support and deliver TFT-TFS. We used a training-of-trainers model to embed TFT-T","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"4 ","pages":"26334895231159428"},"PeriodicalIF":0.0,"publicationDate":"2023-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/3b/aa/10.1177_26334895231159428.PMC10037724.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9742163","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Renee M Cloutier, Evan S Cole, Brianna L McDonough, Daniel A Lomauro, John P Miller, Abigail L Talbert, Todd M Bear, Nora C Bridges, Abigail L Foulds, Rachel Taber, Adam J Gordon, Gerald T Cochran, Julie Kmiec, Julie M Donohue, David Kelley, Ellen DiDomenico, Dale Adair, Janice L Pringle
{"title":"Strategies to recruit rural primary care providers to implement a medication for opioid use disorder (MOUD) focused integrated care model.","authors":"Renee M Cloutier, Evan S Cole, Brianna L McDonough, Daniel A Lomauro, John P Miller, Abigail L Talbert, Todd M Bear, Nora C Bridges, Abigail L Foulds, Rachel Taber, Adam J Gordon, Gerald T Cochran, Julie Kmiec, Julie M Donohue, David Kelley, Ellen DiDomenico, Dale Adair, Janice L Pringle","doi":"10.1177/26334895231152808","DOIUrl":"10.1177/26334895231152808","url":null,"abstract":"<p><strong>Background: </strong>Access to providers and programs that provide medications for opioid use disorder (MOUD) remains a systemic barrier for patients with opioid use disorder (OUD), particularly if they live in rural areas. The Rural Access to Medication Assisted Treatment (MAT) in Pennsylvania Project (Project RAMP) addressed this problem with a multisystem partnership that recruited, trained, and supported rural primary care providers to provide MOUD and implement an integrated care model (ICM) for patients with OUD. Given the demonstrated efficacy of Project RAMP, this article summarizes our recruitment strategies, including feasibility concerns for further expansion into other regions.</p><p><strong>Methods: </strong>The approach for recruiting implementation sites included two phases: partner outreach and site identification. Once recruited, the Systems Transformation Framework guided planning and implementation activities. Recruitment and implementation activities were assessed with implementation trackers and evaluated by providers via key informant interviews (KIIs).</p><p><strong>Results: </strong>Project RAMP recruited 26 primary care practices from 13 counties, including nine health systems and two private practice groups-exceeding the original target of 24 sites. There was a median of 49 days from first contact to project onboarding. A total of 108 primary care practices spanning 22 health systems declined participation. Findings from the KIIs highlighted the value of engaging PCPs by connecting to a shared vision (i.e., improving the quality of patient care) as well as addressing perceived participation barriers (e.g., offering concierge technical assistance to address lack of training or resources).</p><p><strong>Conclusion: </strong>Findings highlight how successful recruitment activities should leverage the support of health system leadership. Findings also emphasize that aiding recruitment and engagement efforts successfully addressed prescribers' perceived barriers to providing MOUD as well as facilitating better communication among administrators, PCPs, behavioral health professionals, care managers, and patients.<b>Plain Language Summary:</b> Opioid use disorder (OUD) is one of the leading causes of preventable illness and death. The standard of care for OUD is the provision of medications for opioid use disorder (MOUD) and the application of an integrative integrated care model (ICM) where behavioral health is blended with specialized medical services. Unfortunately, access to providers and healthcare facilities that provide MOUD or apply an ICM remains a systemic barrier for patients with OUD, particularly if they live in rural areas. Although there is no one-size-fits-all approach to implementing MOUD in primary care, findings from Project The Rural Access to Medication Assisted Treatment (MAT) in Pennsylvania Project (Project RAMP) highlight strategies that may improve future MOUD and ICM implementation efforts ","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"4 ","pages":"26334895231152808"},"PeriodicalIF":0.0,"publicationDate":"2023-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/06/f9/10.1177_26334895231152808.PMC9978659.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9757381","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Daina M Tagavi, Kaitlyn Ahlers, Alice Bravo, Alana J McVey, Jill Locke
{"title":"Concordance of multiple informant assessment of school-based social skills intervention and association with child outcomes: Results from a randomized trial.","authors":"Daina M Tagavi, Kaitlyn Ahlers, Alice Bravo, Alana J McVey, Jill Locke","doi":"10.1177/26334895231154289","DOIUrl":"10.1177/26334895231154289","url":null,"abstract":"<p><strong>Background: </strong>Fidelity, or the degree to which an intervention is implemented as designed, is essential for effective implementation. There has been a growing emphasis on assessing fidelity of evidence-based practices for autistic children in schools. Fidelity measurement should be multidimensional and focus on core intervention components and assess their link with program outcomes. This study evaluated the relation between intervention fidelity ratings from multiple sources, tested the relation between fidelity ratings and child outcomes, and determined the relations between core intervention components and child outcomes in a study of an evidence-based psychosocial intervention designed to promote inclusion of autistic children at school, Remaking Recess.</p><p><strong>Method: </strong>This study extends from a larger randomized controlled trial examining the effect of implementation support on Remaking Recess fidelity and child outcomes. Schools were randomized to receive the intervention or the intervention plus implementation support. Observers, intervention coaches, and school personnel completed fidelity measures to rate completion and quality of intervention delivery. A measure of peer engagement served as the child outcome. Pearson correlation coefficients were calculated to determine concordance between raters. Two sets of hierarchical linear models were conducted using fidelity indices as predictors of peer engagement.</p><p><strong>Results: </strong>Coach- and self-rated completion and quality scores, observer- and self-rated quality scores, and observer- and coach-rated quality fidelity scores were significantly correlated. Higher observer-rated completion and quality fidelity scores were predictors of higher peer engagement scores. No single intervention component emerged as a significant predictor of peer engagement.</p><p><strong>Conclusions: </strong>This study demonstrates the importance of using a multidimensional approach for measuring fidelity, testing the link between fidelity and child outcomes, and examining how core intervention components may be associated with child outcomes. Future research should clarify how to improve multi-informant reports to provide \"good enough\" ratings of fidelity that provide meaningful information about outcomes in community settings.</p><p><strong>Plain language summary: </strong>Fidelity is defined as how closely an intervention is administered in the way the creators intended. Fidelity is important because it allows researchers to determine what exactly is leading to changes. In recent years, there has been an interest in examining fidelity of interventions for autistic children who receive services in school. This study looked at the relationship between fidelity ratings from multiple individuals, the relationship between fidelity and child outcomes, and the relationship between individual intervention component and child changes in a study of Remaking Recess, an interve","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"4 ","pages":"26334895231154289"},"PeriodicalIF":0.0,"publicationDate":"2023-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/1c/50/10.1177_26334895231154289.PMC9978620.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9388667","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
James L Merle, Clayton R Cook, Jill J Locke, Mark G Ehrhart, Eric C Brown, Chayna J Davis, Aaron R Lyon
{"title":"Teacher attitudes toward evidence-based practices: Exploratory and confirmatory analyses of the school-adapted evidence-based practice attitude scale.","authors":"James L Merle, Clayton R Cook, Jill J Locke, Mark G Ehrhart, Eric C Brown, Chayna J Davis, Aaron R Lyon","doi":"10.1177/26334895221151026","DOIUrl":"https://doi.org/10.1177/26334895221151026","url":null,"abstract":"Background The Evidence-Based Practice Attitudes Scale (EBPAS) is widely used in implementation research, but it has not been adapted and validated for use among general education teachers, who are most likely to deliver evidence-based prevention programs in schools, the most common setting where youth access social, emotional, and behavioral health services. Method School-based stakeholders and a research team comprised of experts in the implementation of evidence-based practices in schools adapted the EBPAS for teachers (the S-EBPAS). The adapted instrument was administered to a representative sample (n = 441) of general education teachers (grades K—5) to assess the reliability and internal consistency via factor analyses. The S-EBPAS included two forms (i.e., EBP-agnostic and EBP-specific item referents), therefore, a multiple-group confirmatory factor analysis (CFA) was also performed to establish measurement invariance between the two forms. Results After adaptation and refinement, a 9-item, 3-factor structure was confirmed, with the final model supporting three first-order factors that load onto a second-order factor capturing attitudes toward adopting evidence-based practices. Multiple-group CFA analyses of measurement invariance indicated there were no significant differences between the two forms. Conclusions Overall, this study provides a brief, flexible instrument capturing attitudes toward adopting EBPs that has high reliability and internal consistency, which support its use among general education teachers in school settings implementing evidence-based practices. Plain Language Summary The Evidence-Based Practice Attitudes Scale (EBPAS) is a popular instrument for measuring attitudes toward evidence-based practices (EBPs). This instrument provides valuable information during implementation initiatives, such as whether providers or front-line implementers have favorable attitudes toward a given practice. The EBPAS has been used in many different settings, such as in community-based mental health clinics, medical hospitals, and in child welfare. However, it's use in schools has been limited, and it has not yet been tested with general education teachers, who are key implementers of evidence-based practices in schools. In order to trust that the scores from an instrument are accurate, it needs to be evaluated when scaling it out to new populations and settings. One popular method to determine this is to use factor analysis, which was employed in this study. This study fills the identified gap by assessing the reliability (i.e., accuracy) and internal consistency of the EBPAS among a representative sample of general education teachers. Findings from this study indicate that the school-adapted EBPAS (S-EBPAS) is a brief, nine-item instrument that provides a reliable estimate of teachers’ attitudes toward evidence-based practices. Our results also provide evidence that the S-EBPAS can be used to capture attitudes toward specific EBPs as w","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"4 ","pages":"26334895221151026"},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/1e/50/10.1177_26334895221151026.PMC9924278.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9388666","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Elizabeth Peacock-Chambers, Michael Moran, Maria Carolina Clark, Jessica L Borelli, Nancy Byatt, Peter D Friedmann, Nancy E Suchman, Emily Feinberg
{"title":"Adaptation of an evidence-based parenting intervention for integration into maternal-child home-visiting programs: Challenges and solutions.","authors":"Elizabeth Peacock-Chambers, Michael Moran, Maria Carolina Clark, Jessica L Borelli, Nancy Byatt, Peter D Friedmann, Nancy E Suchman, Emily Feinberg","doi":"10.1177/26334895221151029","DOIUrl":"10.1177/26334895221151029","url":null,"abstract":"<p><strong>Background: </strong>The objective of this study was to assess potential challenges, prioritize adaptations, and develop an implementation and research approach to integrate and study a parenting intervention for mothers in recovery from substance use disorders in community-based home-visiting programs.</p><p><strong>Method: </strong>An explanatory mixed-methods design, guided by process mapping with Failure Modes and Effects Analysis tools, and an Advisory Panel of 15 community members, identified potential implementation challenges and recommended solutions for the proposed intervention within five pre-specified domains. Thematic content analysis identified themes from detailed field notes.</p><p><strong>Results: </strong>The Advisory Panel identified 44 potential challenges across all domains. They determined that the recruitment domain was most likely to create challenges. Regarding the potential challenges, two cross-domain themes emerged: (1) development of mistrust in the community and (2) difficulty initiating and sustaining engagement. Potential solutions and adaptations to protocols are reported.</p><p><strong>Conclusion: </strong>Mistrust in the community was cited as a potentially important challenge for the delivery and study of an evidence-based parenting intervention for mothers in recovery through home-visiting programs. Adaptations to research protocols and intervention delivery strategies are needed to prioritize the psychological safety of families, particularly for groups that have been historically stigmatized.</p>","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"4 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/68/c2/10.1177_26334895221151029.PMC9924283.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9330247","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Factors that influence clinical decisions about offering parent coaching for autistic youth served within the Medicaid system.","authors":"Diondra Straiton, Kyle Frost, Brooke Ingersoll","doi":"10.1177/26334895231153631","DOIUrl":"10.1177/26334895231153631","url":null,"abstract":"<p><strong>Background: </strong>Parent coaching is an evidence-based practice for young autistic children, but it is underutilized in lower-resourced community settings like the Medicaid system (Straiton et al., 2021b). Clinicians often struggle to implement parent coaching with low-income and marginalized families (Tomczuk et al., 2022), but little is known about which factors influence clinician decision making processes about providing parent coaching to this population.</p><p><strong>Methods: </strong>This qualitative analysis used the framework method and thematic analysis. We used the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework (Aarons et al., 2011) to identify factors in the clinical decision-making process that community providers use when offering parent coaching to families of Medicaid-enrolled autistic children. Interviews with 13 providers and a focus group with 13 providers were analyzed.</p><p><strong>Results: </strong>The following themes emerged: 1) Policies drive provider task priorities and affect competing demands; 2) Providers are more likely to use parent coaching when agency leaders monitor parent coaching benchmarks, though this is rarely done; 3) Logistical factors like scheduling and treatment location affect perceived feasibility of using parent coaching; 4) Previous experience or coursework in parent coaching and/or family systems supports the quality of parent coaching implementation; 5) Provider perceptions of \"parent readiness\" are initially indicated by overt expressions of parent interest.</p><p><strong>Conclusions: </strong>In the absence of outer-context and inner-context policies, providers have more decision-making power to offer parent coaching based on their own judgements and preferences, which may result in fewer families being offered parent coaching and increased bias related to which families are offered this service. State-, agency-, and clinician-level recommendations are provided for increasing equitable provision of this evidence-based practice for autism.</p>","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"4 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/8d/f2/10.1177_26334895231153631.PMC9978664.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9330248","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Amy G Huebschmann, Shelly Johnston, Rachel Davis, Bethany M Kwan, Elvin Geng, Debra Haire-Joshu, Brittney Sandler, Demetria M McNeal, Ross C Brownson, Borsika A Rabin
{"title":"Promoting rigor and sustainment in implementation science capacity building programs: A multi-method study.","authors":"Amy G Huebschmann, Shelly Johnston, Rachel Davis, Bethany M Kwan, Elvin Geng, Debra Haire-Joshu, Brittney Sandler, Demetria M McNeal, Ross C Brownson, Borsika A Rabin","doi":"10.1177/26334895221146261","DOIUrl":"10.1177/26334895221146261","url":null,"abstract":"<p><strong>Background: </strong>The field of Implementation science (IS) continues to evolve, and the number and type of IS capacity building Programs (ISCBPs) are in flux. These changes push the field to revisit the accepted IS competencies and to guide sustainment of ISCBPs. Our objectives were: (1) compare characteristics of current ISCBPs; (2) identify recommendations to support ISCBP sustainment; (3) measure how often ISCBPs address IS competencies; (4) identify novel and important IS competencies for the field.</p><p><strong>Method: </strong>This multi-method study included ISCBPs delivering structured, longitudinal IS training, excluding single courses and brief workshops. We used three complementary methods to meet our objectives. First, we identified ISCBPs via an internet search and snowball sampling methods. Second, we surveyed these ISCBPs to identify areas of program focus, types of trainees, IS competencies addressed, and recommendations to sustain ISCBPs. Third, we conducted a modified Delphi process with IS researchers/leaders to reach consensus on the IS competencies that were both important and novel as compared to the IS competencies published to date.</p><p><strong>Results: </strong>Among 74 eligible ISCBPs identified, 46 responded (62% response rate). Respondent ISCBPs represented diverse areas of focus (e.g., global health, cardiopulmonary disease) and trainee stages (e.g., graduate students, mid-career faculty). While most respondent ISCBPs addressed core IS methods, targeting IS competencies was less consistent (33% for nongraduate/non-fellowship ISCBPs; >90% for graduate/national ISCBPs). Our modified Delphi process identified eight novel and important IS competencies related to increasing health equity or the speed of translation. Recommendations to sustain ISCBPs included securing financial administrative support.</p><p><strong>Conclusions: </strong>Current ISCBPs train learners across varying career stages in diverse focus areas. To promote rigor, we recommend ISCBPs address specific IS competencies, with consideration of these eight novel/emerging competencies. We also recommend ISCBPs report on their IS competencies, focus area(s), and trainee characteristics. ISCBP programs need administrative financial support.</p><p><strong>Plain language summary: </strong>There is a limited workforce capacity to conduct implementation science (IS) research. To address this gap, the number and type of IS capacity building Programs (ISCBPs) focusing on training researchers and practitioners in IS methods continue to increase. Our efforts to comprehensively identify and describe ISCBPs for researchers and practitioners highlighted four implications for leaders of ISCBPs related to program sustainment and rigor. First, we identified a range of contextual characteristics of ISCBPs, including the research topics, methods, and IS competencies addressed, and the types of trainees accepted. Second, given the variability of trainee types a","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"3 ","pages":"26334895221146261"},"PeriodicalIF":0.0,"publicationDate":"2022-12-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9924281/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9444876","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Meagan Pilar, Eliot Jost, Callie Walsh-Bailey, Byron J Powell, Stephanie Mazzucca, Amy Eyler, Jonathan Purtle, Peg Allen, Ross C Brownson
{"title":"Quantitative measures used in empirical evaluations of mental health policy implementation: A systematic review.","authors":"Meagan Pilar, Eliot Jost, Callie Walsh-Bailey, Byron J Powell, Stephanie Mazzucca, Amy Eyler, Jonathan Purtle, Peg Allen, Ross C Brownson","doi":"10.1177/26334895221141116","DOIUrl":"10.1177/26334895221141116","url":null,"abstract":"<p><strong>Background: </strong>Mental health is a critical component of wellness. Public policies present an opportunity for large-scale mental health impact, but policy implementation is complex and can vary significantly across contexts, making it crucial to evaluate implementation. The objective of this study was to (1) identify quantitative measurement tools used to evaluate the implementation of public mental health policies; (2) describe implementation determinants and outcomes assessed in the measures; and (3) assess the pragmatic and psychometric quality of identified measures.</p><p><strong>Method: </strong>Guided by the Consolidated Framework for Implementation Research, Policy Implementation Determinants Framework, and Implementation Outcomes Framework, we conducted a systematic review of peer-reviewed journal articles published in 1995-2020. Data extracted included study characteristics, measure development and testing, implementation determinants and outcomes, and measure quality using the Psychometric and Pragmatic Evidence Rating Scale.</p><p><strong>Results: </strong>We identified 34 tools from 25 articles, which were designed for mental health policies or used to evaluate constructs that impact implementation. Many measures lacked information regarding measurement development and testing. The most assessed implementation determinants were readiness for implementation, which encompassed training (<i>n</i> = 20, 57%) and other resources (<i>n</i> = 12, 34%), actor relationships/networks (<i>n</i> = 15, 43%), and organizational culture and climate (<i>n</i> = 11, 31%). Fidelity was the most prevalent implementation outcome (<i>n</i> = 9, 26%), followed by penetration (<i>n</i> = 8, 23%) and acceptability (<i>n</i> = 7, 20%). Apart from internal consistency and sample norms, psychometric properties were frequently unreported. Most measures were accessible and brief, though minimal information was provided regarding interpreting scores, handling missing data, or training needed to administer tools.</p><p><strong>Conclusions: </strong>This work contributes to the nascent field of policy-focused implementation science by providing an overview of existing measurement tools used to evaluate mental health policy implementation and recommendations for measure development and refinement. To advance this field, more valid, reliable, and pragmatic measures are needed to evaluate policy implementation and close the policy-to-practice gap.</p><p><strong>Plain language summary: </strong>Mental health is a critical component of wellness, and public policies present an opportunity to improve mental health on a large scale. Policy implementation is complex because it involves action by multiple entities at several levels of society. Policy implementation is also challenging because it can be impacted by many factors, such as political will, stakeholder relationships, and resources available for implementation. Because of these factors","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"3 ","pages":"26334895221141116"},"PeriodicalIF":0.0,"publicationDate":"2022-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/d4/39/10.1177_26334895221141116.PMC9924289.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10349287","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Megan A O'Grady, Rina Randrianarivony, Keith Martin, Yaberci Perez-Cubillan, David C Collymore, Dina Shapiro-Luft, Alexa Beacham, Nyasia Heyward, Belinda Greenfield, Charles J Neighbors
{"title":"Together in care: Lessons learned at the intersection of integrated care, quality improvement, and implementation practice in opioid treatment programs.","authors":"Megan A O'Grady, Rina Randrianarivony, Keith Martin, Yaberci Perez-Cubillan, David C Collymore, Dina Shapiro-Luft, Alexa Beacham, Nyasia Heyward, Belinda Greenfield, Charles J Neighbors","doi":"10.1177/26334895221135265","DOIUrl":"10.1177/26334895221135265","url":null,"abstract":"<p><strong>Background: </strong>Integrated care programs that systematically and comprehensively address both behavioral and physical health may improve patient outcomes. However, there are few examples of such programs in addiction treatment settings. This article is a practical implementation report describing the implementation of an integrated care program into two opioid treatment programs (OTPs).</p><p><strong>Method: </strong>Strategies used to implement integrated care into two OTPs included external facilitation, quality improvement (QI) processes, staff training, and an integrated organizational structure. Service, implementation, and client outcomes were examined using qualitative interviews with program staff (n = 16), program enrollment data, and client outcome data (n = 593) on mental health (MH), physical health, and functional indicators.</p><p><strong>Results: </strong>Staff found the program to generally be acceptable and appropriate, but also noted that the new services added to already busy workflows and more staffing were needed to fully reach the program's potential. The program had a high level of penetration (∼60%-70%), enrolling over 1,200 clients. Staff noted difficulties in connecting clients with some services. Client general functioning and MH symptoms improved, and heavy smoking decreased. The organizational structure and QI activities provided a strong foundation for interactive problem-solving and adaptations that were needed during implementation.</p><p><strong>Conclusions: </strong>This article highlights an example of the intersection of QI and implementation practice. Simplified QI processes, consistent post-implementation meetings, and change teams and champions facilitated implementation; however, ongoing training and support, especially related to data are needed. The OTP setting provided a strong foundation to build integrated care, but careful consideration of new workflows and changes in philosophy for staff is necessary.<b>Plain Language Summary:</b> Providing medical and behavioral health treatment services in the same clinic using coordinated treatment teams, also known as integrated care, improves outcomes among those with chronic physical and behavioral health conditions. However, there are few practical examples of implementation of such programs in addiction treatment settings, which are promising, yet underutilized settings for integrated care programs. A multi-sectoral team used quality improvement (QI) and implementation strategies to implement integrated care into two opioid treatment programs (OTPs). The program enrolled over 1,200 clients and client general functioning and mental health (MH) symptoms improved, and heavy smoking decreased. Qualitative interviews provided important information about the barriers, facilitators, and context around implementation of this program. The OTP setting provided a strong foundation to build integrated care, but careful consideration of new workflows a","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"3 ","pages":"26334895221135265"},"PeriodicalIF":0.0,"publicationDate":"2022-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/98/84/10.1177_26334895221135265.PMC9924288.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9388976","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}