Katharina Abraham, Isaac Corro Ramos, C Louwrens Braal, Talitha Feenstra, Anne Kleijburg, George A K van Voorn, Carin Uyl-de Groot
{"title":"Under-reporting of Validation Efforts for Health Economic Models Persists Despite the Availability of Validation Tools: A Systematic Review.","authors":"Katharina Abraham, Isaac Corro Ramos, C Louwrens Braal, Talitha Feenstra, Anne Kleijburg, George A K van Voorn, Carin Uyl-de Groot","doi":"10.1007/s40273-025-01491-2","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>In this study we aimed to identify possible changes over time in validation efforts and the way in which they are reported for model-based health economic (HE) evaluations, given the introduction of several new validation tools and methods in the past decade.</p><p><strong>Methods: </strong>A systematic review was conducted using PubMed and Embase on published HE models for early breast cancer (EBC) for the period 2016 to 2024. AdViSHE-consisting of four validation categories that cover the main HE model aspects-was utilized to systematically evaluate the reported evaluation efforts. The percentage of studies reporting validation per category was compared with the review by de Boer et al. that covers the years 2008 to 2015.</p><p><strong>Results: </strong>Of the 2199 records, 78 studies fulfilled the eligibility criteria. Reported validation efforts did not significantly improve compared with the previous period, except for the validation of input data by experts. Reporting on the validation of the conceptual model remained low with around 10% of the studies providing validation. Validation of the computerized model and validation against outcomes using alternative input data were the most underreported validation categories with < 4% of the studies. The validation of model outcomes, specifically cross validity and the comparison with empirical data, remained the most reported categories in this review also, with 52% and 36%, respectively. When validation efforts were reported, this was done in a non-systematic manner, and the tests and results were rarely detailed.</p><p><strong>Conclusion: </strong>Overall reporting of validation efforts for model-based HE evaluations in the past decade did not significantly change compared with the previous decade.</p>","PeriodicalId":19807,"journal":{"name":"PharmacoEconomics","volume":" ","pages":"849-858"},"PeriodicalIF":4.4000,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12255658/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"PharmacoEconomics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s40273-025-01491-2","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/4/28 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"ECONOMICS","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: In this study we aimed to identify possible changes over time in validation efforts and the way in which they are reported for model-based health economic (HE) evaluations, given the introduction of several new validation tools and methods in the past decade.
Methods: A systematic review was conducted using PubMed and Embase on published HE models for early breast cancer (EBC) for the period 2016 to 2024. AdViSHE-consisting of four validation categories that cover the main HE model aspects-was utilized to systematically evaluate the reported evaluation efforts. The percentage of studies reporting validation per category was compared with the review by de Boer et al. that covers the years 2008 to 2015.
Results: Of the 2199 records, 78 studies fulfilled the eligibility criteria. Reported validation efforts did not significantly improve compared with the previous period, except for the validation of input data by experts. Reporting on the validation of the conceptual model remained low with around 10% of the studies providing validation. Validation of the computerized model and validation against outcomes using alternative input data were the most underreported validation categories with < 4% of the studies. The validation of model outcomes, specifically cross validity and the comparison with empirical data, remained the most reported categories in this review also, with 52% and 36%, respectively. When validation efforts were reported, this was done in a non-systematic manner, and the tests and results were rarely detailed.
Conclusion: Overall reporting of validation efforts for model-based HE evaluations in the past decade did not significantly change compared with the previous decade.
期刊介绍:
PharmacoEconomics is the benchmark journal for peer-reviewed, authoritative and practical articles on the application of pharmacoeconomics and quality-of-life assessment to optimum drug therapy and health outcomes. An invaluable source of applied pharmacoeconomic original research and educational material for the healthcare decision maker.
PharmacoEconomics is dedicated to the clear communication of complex pharmacoeconomic issues related to patient care and drug utilization.
PharmacoEconomics offers a range of additional features designed to increase the visibility, readership and educational value of the journal’s content. Each article is accompanied by a Key Points summary, giving a time-efficient overview of the content to a wide readership. Articles may be accompanied by plain language summaries to assist readers who have some knowledge of, but not in-depth expertise in, the area to understand the scientific content and overall implications of the article.