Development of a generalised tool for evaluating success of clinical practice guidelines implementation (A-GIST).

Abstract

Objectives: To develop a generalised tool to evaluate the success of implementation of clinical practice guidelines (CPGs).

Design and setting: Systematic review, group brainstorming discussion and modified Delphi method.

Participants: A steering group (3 members) was assembled responsible for the guidance and ensuring stakeholder's involvement. A tool development group (24 members) of leading experts provided expertise in refining the frame and items during the development and participated in the Delphi process. And a secretary group (7 members) was responsible for the organization and coordination, systematic reviewing, drafting of the preliminary list of items, documenting and revising the tool according to the suggestions of the development group.

Interventions: Four process stages were employed. First, the project was launched with core groups formed for the development. Second, based on the Reach Effectiveness Adoption Implementation Maintenance framework, a systematic review of existing methods for evaluating the success of CPGs implementation and a brainstorming discussion were conducted to form a preliminary list. Third, a modified Delphi method was organised, integrating a multidisciplinary face-to-face consultation meeting with two rounds of online Delphi consultations. Fourth, the tool was revised and finalised incorporating all expert suggestions.

Results: Development teams comprising multidisciplinary experts were formed. In the systematic review, 7 biomedical literature databases were searched, and 208 pieces of literature were included. After three rounds of brainstorming discussions on items identified in the literature, a 23-item preliminary list was produced. In the modified Delphi method, 14 experts made 23 main suggestions in the face-to-face meeting on the list. 13 experts participated in the first round of Delphi consultation, reached agreement on 20 items, removed 4 items and added 1 new item. 11 experts attended the second-round consultation and had an agreement to include 20 items after revision.

Conclusions: The Guideline Implementation Success Assessment Tool (A-GIST) was systematically developed as a comprehensive tool to assess the success of CPGs implementation. It comprises 5 dimensions, Reach, Adoption, Implementation, Effectiveness and Maintenance, encompassing 20 items that integrate perspectives from both clinicians and patients. A-GIST is designed to facilitate evaluating, benchmarking and cross-comparison of implementation success between guidelines, facilities and regions. Additionally, it provides evidence-based insights to inform the development of targeted strategies for optimising guideline implementation practices.