Using Mixed Methods to Evaluate Risk Minimisation Programs in Europe and the USA: An Innovative Blueprint.

IF 4 2区医学 Q1 PHARMACOLOGY & PHARMACY

Drug Safety Pub Date : 2025-03-12 DOI:10.1007/s40264-025-01533-w

Meredith Y Smith, Rachel Davis, Priya Bahri, Delphine Saragoussi, Viviana Nguyen, Gita A Toyserkani, Alison Hamilton

{"title":"Using Mixed Methods to Evaluate Risk Minimisation Programs in Europe and the USA: An Innovative Blueprint.","authors":"Meredith Y Smith, Rachel Davis, Priya Bahri, Delphine Saragoussi, Viviana Nguyen, Gita A Toyserkani, Alison Hamilton","doi":"10.1007/s40264-025-01533-w","DOIUrl":null,"url":null,"abstract":"Background: Significant methodological shortcomings have been documented to date in risk minimisation program evaluations for medicinal products, including overreliance on survey methods alone. Recently updated guidances from the Food and Drug Administration (FDA) and the European Medicines Agency (EMA) recommend the use of frameworks and mixed methods designs to improve the rigor of these assessments.Objective: The purpose of this paper was to exemplify how a mixed methods approach, guided by an implementation science framework, can be used to design the evaluation of a risk minimisation program.Methods: We selected the Practical, Robust, Implementation and Sustainability Model (PRISM) as the implementation science framework to guide our mixed methods approach. PRISM provides a comprehensive and systematic approach to measuring the key domains relevant to the implementation and outcomes of a risk minimisation program. We mapped the PRISM domains to the evaluation dimensions described in the EMA and FDA guidances. We then specified a mixed methods evaluation design and data collection methods using a fictitious risk minimisation program as a case study for illustrative purposes.Results: On the basis of our case study, we developed quantitative and qualitative measures, including specific items for surveys and interviews, for both formative and summative evaluations. For both the formative and summative evaluations, measures focussed on assessing (1) contextual factors that could affect program implementation and impact and (2) outcomes including implementability and acceptability as well as degree of program reach, adoption, implementation, effectiveness and maintenance.Conclusions: Mixed methods, guided by a well-established implementation science framework, can be applied to ensure comprehensive formative and summative evaluations that provide fit-for-purpose information that may inform regulatory decision-making.","PeriodicalId":11382,"journal":{"name":"Drug Safety","volume":" ","pages":""},"PeriodicalIF":4.0000,"publicationDate":"2025-03-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Drug Safety","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s40264-025-01533-w","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PHARMACOLOGY & PHARMACY","Score":null,"Total":0}

引用次数: 0

Abstract

Background: Significant methodological shortcomings have been documented to date in risk minimisation program evaluations for medicinal products, including overreliance on survey methods alone. Recently updated guidances from the Food and Drug Administration (FDA) and the European Medicines Agency (EMA) recommend the use of frameworks and mixed methods designs to improve the rigor of these assessments.

Objective: The purpose of this paper was to exemplify how a mixed methods approach, guided by an implementation science framework, can be used to design the evaluation of a risk minimisation program.

Methods: We selected the Practical, Robust, Implementation and Sustainability Model (PRISM) as the implementation science framework to guide our mixed methods approach. PRISM provides a comprehensive and systematic approach to measuring the key domains relevant to the implementation and outcomes of a risk minimisation program. We mapped the PRISM domains to the evaluation dimensions described in the EMA and FDA guidances. We then specified a mixed methods evaluation design and data collection methods using a fictitious risk minimisation program as a case study for illustrative purposes.

Results: On the basis of our case study, we developed quantitative and qualitative measures, including specific items for surveys and interviews, for both formative and summative evaluations. For both the formative and summative evaluations, measures focussed on assessing (1) contextual factors that could affect program implementation and impact and (2) outcomes including implementability and acceptability as well as degree of program reach, adoption, implementation, effectiveness and maintenance.

Conclusions: Mixed methods, guided by a well-established implementation science framework, can be applied to ensure comprehensive formative and summative evaluations that provide fit-for-purpose information that may inform regulatory decision-making.

查看原文本刊更多论文

求助全文

约1分钟内获得全文求助全文

来源期刊

Drug Safety 医学-毒理学

CiteScore

7.60

自引率

7.10%

发文量

112

审稿时长

6-12 weeks

期刊介绍： Drug Safety is the official journal of the International Society of Pharmacovigilance. The journal includes: Overviews of contentious or emerging issues. Comprehensive narrative reviews that provide an authoritative source of information on epidemiology, clinical features, prevention and management of adverse effects of individual drugs and drug classes. In-depth benefit-risk assessment of adverse effect and efficacy data for a drug in a defined therapeutic area. Systematic reviews (with or without meta-analyses) that collate empirical evidence to answer a specific research question, using explicit, systematic methods as outlined by the PRISMA statement. Original research articles reporting the results of well-designed studies in disciplines such as pharmacoepidemiology, pharmacovigilance, pharmacology and toxicology, and pharmacogenomics. Editorials and commentaries on topical issues. Additional digital features (including animated abstracts, video abstracts, slide decks, audio slides, instructional videos, infographics, podcasts and animations) can be published with articles; these are designed to increase the visibility, readership and educational value of the journal’s content. In addition, articles published in Drug Safety Drugs may be accompanied by plain language summaries to assist readers who have some knowledge of, but not in-depth expertise in, the area to understand important medical advances.