Aricca D. Van Citters, Madge E. Buus-Frank, Joel R. King, Michael Seid, Megan M. Holthoff, Raouf S. Amin, Maria T. Britto, Eugene C. Nelson, Bruce C. Marshall, Kathryn A. Sabadosa
{"title":"The Cystic Fibrosis Learning Network: A mixed methods evaluation of program goals, attributes, and impact","authors":"Aricca D. Van Citters, Madge E. Buus-Frank, Joel R. King, Michael Seid, Megan M. Holthoff, Raouf S. Amin, Maria T. Britto, Eugene C. Nelson, Bruce C. Marshall, Kathryn A. Sabadosa","doi":"10.1002/lrh2.10356","DOIUrl":"10.1002/lrh2.10356","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>The Cystic Fibrosis (CF) Foundation sponsored the design, pilot testing, and implementation of the CF Learning Network (CFLN) to explore how the Foundation's Care Center Network (CCN) could become a learning health system. Six years after the design, the Foundation commissioned a formative mixed methods evaluation of the CFLN to assess: CFLN participants' understanding of program goals, attributes, and perceptions of current and future impact.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We performed semi-structured interviews with CFLN participants to identify perceived goals, attributes, and impact of the network. Following thematic analyses, we developed and distributed a survey to CFLN members and a matched sample of CCN programs to understand whether the themes were unique to the CFLN.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>Interviews with 24 CFLN participants were conducted. Interviewees identified the primary CFLN goal as improving outcomes for people living with CF, with secondary goals of providing training in quality improvement (QI), creating a learning community, engaging all stakeholders in improvement, and spreading best practices to the CCN. Project management, use of data, common QI methods, and the learning community were seen as critical to success. Survey responses were collected from 103 CFLN members and 25 CCN members. The data revealed that CFLN respondents were more likely than CCN respondents to connect with other CF programs, routinely use data for QI, and engage patient and family partners in QI.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>Our study suggests that the CFLN provides value beyond that achieved by the CCN. Key questions remain about whether spread of the CFLN could improve outcomes for more people living with CF.</p>\u0000 </section>\u0000 </div>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"7 3","pages":""},"PeriodicalIF":3.1,"publicationDate":"2022-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/e3/71/LRH2-7-e10356.PMC10508326.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41147457","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Thida Ong, Dana Albon, Raouf S. Amin, Julianna Bailey, Srujana Bandla, Maria T. Britto, Jonathan Flath, Breck Gamel, Michael Powers, Kathryn A. Sabadosa, Anna K. Saulitis, Lacrecia K. Thomas, Sophia Thurmond, Michael Seid, the Cystic Fibrosis Learning Network
{"title":"Establishing a Cystic Fibrosis Learning Network: Interventions to promote collaboration and data-driven improvement at scale","authors":"Thida Ong, Dana Albon, Raouf S. Amin, Julianna Bailey, Srujana Bandla, Maria T. Britto, Jonathan Flath, Breck Gamel, Michael Powers, Kathryn A. Sabadosa, Anna K. Saulitis, Lacrecia K. Thomas, Sophia Thurmond, Michael Seid, the Cystic Fibrosis Learning Network","doi":"10.1002/lrh2.10354","DOIUrl":"10.1002/lrh2.10354","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>A learning health network is a type of learning health system in which stakeholders use network organization to improve health and health care. Building on existing resources in the cystic fibrosis (CF) community, the Cystic Fibrosis Learning Network (CFLN) was designed to improve medical outcomes and quality of life through an intentional focus on achieving reliable evidence-based chronic care delivery and creating a system for data-driven collaborative learning.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We describe the development and growth of the CFLN considering six domains of a Network Maturity Grid: system leadership; governance and policy management; quality improvement (QI); engagement and community building; data and analytics; and research. We illustrate the impact of the CFLN experience on chronic care processes and indicators of collaborative infrastructure.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>The CFLN represents 36 accredited care centers in the CF Foundation Care Center Network caring for over 6300 patients. Of 6779 patient clinical care visits/quarter, 77% are entered into the CF Foundation Patient Registry within 30 days, providing timely means to track outcomes. Collaborative visit planning is occurring in 93% of clinical care visits to share agenda setting with patients and families. Almost all CFLN teams (94%, n = 34) have a patient/family partner (PFP), and 74% of PFPs indicate they are actively participating, taking ownership of, or leading QI initiatives with the interdisciplinary care team. In 2022, 97% of centers reported completing 1–13 improvement cycles per month, and 82% contributed to monthly QI progress reports to share learning.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>The CFLN is a maturing, collaborative infrastructure. CFLN centers practice at an advanced level of coproduction. The CFLN fosters interdisciplinary and PFP leadership and the performance of consistent data-driven improvement cycles. CFLN centers are positioned to respond to rapid changes in evidence-based care and advance the practice of QI and implementation science on a broader scale.</p>\u0000 </section>\u0000 </div>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"7 3","pages":""},"PeriodicalIF":3.1,"publicationDate":"2022-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/92/9b/LRH2-7-e10354.PMC10336485.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9812909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shea Polancich, Patricia Patrician, Rebecca Miltner, Katherine Meese, Amy Armstrong, Shannon Layton, Ross Vander Noot, Terri Poe, Allyson G. Hall
{"title":"Reducing hospital acquired pressure injury in a learning health center: Making the case for quality","authors":"Shea Polancich, Patricia Patrician, Rebecca Miltner, Katherine Meese, Amy Armstrong, Shannon Layton, Ross Vander Noot, Terri Poe, Allyson G. Hall","doi":"10.1002/lrh2.10355","DOIUrl":"10.1002/lrh2.10355","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>The purpose of this descriptive study is to examine a learning health system (LHS) continuous improvement and learning approach as a case for increased quality, standardized processes, redesigned workflows, and better resource utilization. Hospital acquired pressure injuries (HAPI) commonly occur in the hospitalized patient and are costly and preventable. This study examines the effect of a LHS approach to reducing HAPI within a large academic medical center.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>Our learning health center implemented a 6-year series of iterative improvements that included both process and technology changes, with robust data and analytical reforms. In this descriptive, observational study, we retrospectively examined longitudinal data from April 1, 2018 to March 31, 2022, examining the variables of total number of all-stage HAPI counts and average length of stay (ALOS). We also analyzed patient characteristics observed/expected mortality ratios, as well as total patient days, and the case-mix index to determine whether these factors varied over the study period. We used the Agency for Healthcare Research and Quality cost estimates to identify the estimated financial benefit of HAPI reductions on an annualized basis.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>HAPI per 1000 patient days for FY 20 (October 1-September 30) and FY 21, decreased from 2.30 to 1.30 and annualized event AHRQ cost estimates for HAPI decreased by $4 786 980 from FY 20 to FY 21. A strong, statistically significant, negative and seemingly counterintuitive correlation was found (<i>r</i> = −.524, <i>P</i> = .003) between HAPI and ALOS.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>The LHS efforts directed toward HAPI reduction led to sustained improvements during the study period. These results demonstrate the benefits of a holistic approach to quality improvement offered by the LHS model. The LHS model goes beyond a problem-based approach to process improvement. Rather than targeting a specific problem to solve, the LHS system creates structures that yield process improvement benefits over a continued time period.</p>\u0000 </section>\u0000 </div>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"7 3","pages":""},"PeriodicalIF":3.1,"publicationDate":"2022-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/lrh2.10355","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9812910","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Hurdles of innovation—insights from a new healthcare delivery innovation program","authors":"Shoshana Bardach, Amanda Perry, Lillian Powell, Nirav Kapadia, Amber Barnato","doi":"10.1002/lrh2.10353","DOIUrl":"10.1002/lrh2.10353","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>Healthcare systems are actively working to innovate their care delivery models, seeking to improve service quality, improve patient and provider satisfaction, and reduce cost.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>By critically evaluating our experiences to date, this article highlights challenges systems may face in the process of trying to redesign healthcare and offers insights on how to navigate hurdles. We identify barriers to—and ultimately approaches to promote—rapid, scalable, sustainable, and transformative care redesign.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>Dedicated electronic health record IT and analytic support, and ongoing leadership engagement and communication, play a valuable role in enabling redesign efforts. Flexible, but guided, innovation support helps teams stay accountable and motivated, while accommodating new project needs and directions. Understanding the change ecosystem and evaluating and sharing outcomes on an ongoing basis, enables teams to adapt as needed. Facilitation and support help realize the value of diverse, engaged teams; novel approaches and techniques draw out innovative perspectives and promote creative thinking.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>Although not an exhaustive list of challenges or strategies to overcome them, we hope these insights will contribute to a culture of innovation and support other institutions in their healthcare redesign initiatives.</p>\u0000 </section>\u0000 </div>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"7 3","pages":""},"PeriodicalIF":3.1,"publicationDate":"2022-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/dc/e3/LRH2-7-e10353.PMC10336483.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10302731","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jamie McCusker, Leslie D. McIntosh, Chris Shaffer, Peter Boisvert, James Ryan, Vivek Navale, Umit Topaloglu, Rachel L. Richesson
{"title":"Guiding principles for technical infrastructure to support computable biomedical knowledge","authors":"Jamie McCusker, Leslie D. McIntosh, Chris Shaffer, Peter Boisvert, James Ryan, Vivek Navale, Umit Topaloglu, Rachel L. Richesson","doi":"10.1002/lrh2.10352","DOIUrl":"10.1002/lrh2.10352","url":null,"abstract":"<p>Over the past 4 years, the authors have participated as members of the Mobilizing Computable Biomedical Knowledge Technical Infrastructure working group and focused on conceptualizing the infrastructure required to use computable biomedical knowledge. Here, we summarize our thoughts and lay the foundation for future work in the development of CBK infrastructure, including: explaining the difference between computable knowledge and data, and contextualizing the conversation with the Learning Health Systems and the FAIR principles. Specifically, we provide three guiding principles to advance the development of CBK infrastructure: (a) Promote interoperable systems for data and knowledge to be findable, accessible, interoperable, and reusable. (b) Enable stable, trustworthy knowledge representations that are human and machine readable. (c) Computable knowledge resources should, when possible, be open. Standards supporting computable knowledge infrastructures must be open.</p>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"7 3","pages":""},"PeriodicalIF":3.1,"publicationDate":"2022-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/lrh2.10352","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10180361","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Robert El-Kareh, David A. Brenner, Christopher A. Longhurst
{"title":"Developing a highly-reliable learning health system","authors":"Robert El-Kareh, David A. Brenner, Christopher A. Longhurst","doi":"10.1002/lrh2.10351","DOIUrl":"10.1002/lrh2.10351","url":null,"abstract":"<p>Multiple independent frameworks to support continuous improvement have been proposed to guide healthcare organizations. Two of the most visible are High-reliability Health care, (Chassin et al., 2013) which is emphasized by The Joint Commission, and Learning Health Systems, (Institute of Medicine, 2011) highlighted by the National Academy of Medicine. We propose that organizations consider tightly linking these two models, creating a “Highly-reliable Learning Health System.” We describe several efforts at our organization that has resulted from this combined model and have helped our organization weather the COVID-19 pandemic. The organizational changes created using this framework will enable our health system to support a culture of quality across our teams and better fulfill our tripartite mission of high-quality care, effective education of trainees, and dissemination of important innovations.</p>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"7 3","pages":""},"PeriodicalIF":3.1,"publicationDate":"2022-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/7c/ad/LRH2-7-e10351.PMC10336486.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10180365","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Unpacking the challenges of conducting embedded, learning health system research: The winning entries of a Challenge Contest sponsored by AcademyHealth","authors":"","doi":"10.1002/lrh2.10346","DOIUrl":"10.1002/lrh2.10346","url":null,"abstract":"Project : injuries (PrIs) worsen patient morbidity and increase hospital costs. Early recognition is imperative for reducing preventable harm. A process improvement project, TIC DOWN PrI, was undertaken to decrease PrIs by increasing the performance of a 2-RN skin assessment within 24 hours of admission using video technology and TeleICU RNs. TeleICU RNs docu-ment assessment findings, review PrI prevention best practices, and discuss missed opportunities with the bedside RNs. Wound Ostomy Continence RNs are consulted for validating skin alter-ations, when necessary. The project is being conducted in three medical ICUs (79 beds) within the BJC Healthcare System from October 2021 to March 2023. No funding was received for the project.","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"6 4","pages":""},"PeriodicalIF":3.1,"publicationDate":"2022-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/02/6a/LRH2-6-e10346.PMC9576245.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40560277","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Patricia D. Franklin, Denise Drane, Lauren Wakschlag, Ronald Ackerman, Abel Kho, David Cella
{"title":"Development of a learning health system science competency assessment to guide training and proficiency assessment","authors":"Patricia D. Franklin, Denise Drane, Lauren Wakschlag, Ronald Ackerman, Abel Kho, David Cella","doi":"10.1002/lrh2.10343","DOIUrl":"10.1002/lrh2.10343","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>Learning health systems (LHS) science is fundamentally a transdisciplinary field. To capture the breadth of the competencies of an LHS scientist, AHRQ and national experts defined a series of 42 competencies across seven domains that support success. Clinicians, researchers, and leaders who are new to the LHS field can identify and prioritize proficiency development among these domains. In addition, existing leaders and researchers will assemble teams of experts who together represent the LHS science domains. To serve LHS workforce development and proficiency assessment, the AHRQ-funded ACCELERAT K12 training program recruited domain experts and trainees to define and operationalize items to include in an LHS Competency Assessment to support emerging and existing LHS scientists in prioritizing and monitoring proficiency development.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>Sequential interviews with 18 experts iteratively defined skills and tasks to illustrate stage in proficiency, and its progression, for each of 42 competencies in the seven LHS expertise domains: systems science; research questions and standards of scientific evidence; research methods; informatics; ethics of research and implementation in health systems; improvement and implementation science; and engagement, leadership, and research management. An educational assessment expert and LHS scientist refined the assessment criteria at each stage to use parallel language across domains. Last, current trainees reviewed and pilot tested the assessment and the LHS Competency Assessment was further refined using their feedback. The assessment framework was informed by Bloom's revised taxonomy of educational objectives (Anderson and Krathwohl, A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives, 2001) where learning progresses from recalling, defining, understanding, and awareness at the lower levels of the taxonomy, to applying and adopting and finally to creating, designing, and critiquing at the upper levels of the taxonomy. We also developed assessment criteria that could be used for longer term assessment of direct performance. Van der Vleuten et al. (Best Pract Res Clin Obstetr Gynaecol. 2010;24(6):703-719) define longer term direct assessment methods as assessment that occurs over a period ranging from weeks to even years and involves multiple assessment methods and exposure to the learner's work over an extended period.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>This experience report describes the content of the LHS Competency Assessment. For each domain and competency, the ass","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"6 4","pages":""},"PeriodicalIF":3.1,"publicationDate":"2022-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/da/a0/LRH2-6-e10343.PMC9576243.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9896404","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kristen M.J. Azar, Mark J. Pletcher, Sarah M. Greene, Alice R. Pressman
{"title":"Learning health system, positive deviance analysis, and electronic health records: Synergy for a learning health system","authors":"Kristen M.J. Azar, Mark J. Pletcher, Sarah M. Greene, Alice R. Pressman","doi":"10.1002/lrh2.10348","DOIUrl":"10.1002/lrh2.10348","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>Over the past decade, numerous efforts have encouraged the realization of the learning health system (LHS) in the United States. Despite these efforts, and promising aims of the LHS, the full potential and value of research conducted within LHSs have yet to be realized. New technology coupled with a catalyzing global pandemic have spurred momentum. In addition, the LHS has lacked a consistent framework within which “best evidence” can be identified. Positive deviance analysis, itself reinvigorated by recent advances in health information technology (IT) and ubiquitous adoption of electronic health records (EHRs), may finally provide a framework through which LHSs can be operationalized and optimized.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We describe the synergy between positive deviance and the LHS and how they may be integrated to achieve a continuous cycle of health system improvement.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>As we describe below, the positive deviance approach focuses on learning from high-performing teams and organizations.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>Such learning can be enabled by EHRs and health IT, providing a lens into how digital clinical interventions are successfully developed and deployed.</p>\u0000 </section>\u0000 </div>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"7 3","pages":""},"PeriodicalIF":3.1,"publicationDate":"2022-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/72/60/LRH2-7-e10348.PMC10336479.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10180364","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Gary Groot, Stephanie Witham, Andreea Badea, Susan Baer, Michelle Dalidowicz, Bruce Reeder, John Froh, Tracey Carr
{"title":"Evaluating a learning health system initiative: Lessons learned during COVID-19 in Saskatchewan, Canada","authors":"Gary Groot, Stephanie Witham, Andreea Badea, Susan Baer, Michelle Dalidowicz, Bruce Reeder, John Froh, Tracey Carr","doi":"10.1002/lrh2.10350","DOIUrl":"10.1002/lrh2.10350","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>Evaluating a learning health system (LHS) encourages continuous system improvement and collaboration within the healthcare system. Although LHS is a widely accepted concept, there is little knowledge about evaluating an LHS. To explore the outputs and outcomes of an LHS model, we evaluated the COVID-19 Evidence Support Team (CEST) in Saskatchewan, Canada, an initiative to rapidly review scientific evidence about COVID-19 for decision-making. By evaluating this program during its formation, we explored how and to what extent the CEST initiative was used by stakeholders. An additional study aim was to understand how CEST could be applied as a functional LHS and the value of similar knowledge-to-action cycles.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>Using a formative evaluation design, we conducted qualitative interviews with key informants (KIs) who were involved with COVID-19 response strategies in Saskatchewan. Transcripts were analyzed using reflexive thematic analysis to identify key themes. A program logic model was created to represent the inputs, activities, outputs, and outcomes of the CEST initiative.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>Interview data from 11 KIs were collated under three overarching categories: (1) outputs, (2) short-term outcomes, and (3) long-term outcomes from the CEST initiative. Overall, participants found the CEST initiative improved speed and access to reliable information, supported and influenced decision-making and public health strategies, leveraged partnerships, increased confidence and reassurance, and challenged misinformation. Themes relating to the long-term outcomes of the initiative included improving coordination, awareness, and using good judgment and planning to integrate CEST sustainably into the health system.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>This formative evaluation demonstrated that CEST was a valued program and a promising LHS model for Saskatchewan. The future direction involves addressing program recommendations to implement this model as a functional LHS in Saskatchewan.</p>\u0000 </section>\u0000 </div>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"7 3","pages":""},"PeriodicalIF":3.1,"publicationDate":"2022-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/lrh2.10350","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10149137","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}