Impact of covariate model building methods on their clinical relevance evaluation in population pharmacokinetic analyses: comparison of the full model, stepwise covariate model (SCM) and SCM+ approaches - further results based on more conventional practices.
Morgane Philipp, Simon Buatois, Sylvie Retout, France Mentré
{"title":"Impact of covariate model building methods on their clinical relevance evaluation in population pharmacokinetic analyses: comparison of the full model, stepwise covariate model (SCM) and SCM+ approaches - further results based on more conventional practices.","authors":"Morgane Philipp, Simon Buatois, Sylvie Retout, France Mentré","doi":"10.1007/s10928-025-10002-x","DOIUrl":null,"url":null,"abstract":"<p><p>Covariate clinical relevance (CCR) is commonly assessed in population pharmacokinetics using forest plots visualizing parameter changes across covariate values. In our previous work (Philipp et al. 2024), CCR was evaluated using a [0.80-1.20] reference area and a 90% confidence interval for both relevance and significance assessment. However, more conventional thresholds include a broader reference area of [0.80-1.25] and the use of a 5% type I error to assess statistical significance. This commentary extends our previous analysis by evaluating CCR decisions under these more conventional thresholds, in order to assess whether the full model, the stepwise covariate modeling (SCM) and its enhanced version SCM+ remain robust. A comparison with the previous results is also provided. The revised CCR evaluation gave satisfactory results across all three approaches. For covariates with a simulated effect, the full model and SCM/SCM+ provided consistent conclusions with those of the true model. For covariates without a simulated effect, the full model mainly found them non-relevant (NR) non-significant or insufficient information (II) non-significant, while SCM/SCM+ mainly did not select them. These results align with our previous findings. Conclusions for covariates with a simulated effect were almost unchanged. For covariates without a simulated effect, the more conventional threshold allowed the full model to conclude more frequently to their NR instead of II, likely due to the broader reference area and stricter type I error control. Overall, the consistency of our results across different thresholds demonstrates their robustness and supports their generalizability.</p>","PeriodicalId":16851,"journal":{"name":"Journal of Pharmacokinetics and Pharmacodynamics","volume":"52 5","pages":"54"},"PeriodicalIF":2.8000,"publicationDate":"2025-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Pharmacokinetics and Pharmacodynamics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s10928-025-10002-x","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"PHARMACOLOGY & PHARMACY","Score":null,"Total":0}
引用次数: 0
Abstract
Covariate clinical relevance (CCR) is commonly assessed in population pharmacokinetics using forest plots visualizing parameter changes across covariate values. In our previous work (Philipp et al. 2024), CCR was evaluated using a [0.80-1.20] reference area and a 90% confidence interval for both relevance and significance assessment. However, more conventional thresholds include a broader reference area of [0.80-1.25] and the use of a 5% type I error to assess statistical significance. This commentary extends our previous analysis by evaluating CCR decisions under these more conventional thresholds, in order to assess whether the full model, the stepwise covariate modeling (SCM) and its enhanced version SCM+ remain robust. A comparison with the previous results is also provided. The revised CCR evaluation gave satisfactory results across all three approaches. For covariates with a simulated effect, the full model and SCM/SCM+ provided consistent conclusions with those of the true model. For covariates without a simulated effect, the full model mainly found them non-relevant (NR) non-significant or insufficient information (II) non-significant, while SCM/SCM+ mainly did not select them. These results align with our previous findings. Conclusions for covariates with a simulated effect were almost unchanged. For covariates without a simulated effect, the more conventional threshold allowed the full model to conclude more frequently to their NR instead of II, likely due to the broader reference area and stricter type I error control. Overall, the consistency of our results across different thresholds demonstrates their robustness and supports their generalizability.
协变量临床相关性(CCR)通常在群体药代动力学中进行评估,使用森林图可视化各协变量值的参数变化。在我们之前的工作(Philipp et al. 2024)中,CCR的评估使用[0.80-1.20]参考区域和90%的置信区间进行相关性和显著性评估。然而,更传统的阈值包括更广泛的参考区域[0.80-1.25],并使用5%的I型误差来评估统计显著性。这篇评论通过在这些更传统的阈值下评估CCR决策来扩展我们之前的分析,以评估完整模型、逐步协变量建模(SCM)及其增强版本SCM+是否保持健壮性。并与以往的计算结果进行了比较。修订后的CCR评估在所有三种方法中都给出了令人满意的结果。对于具有模拟效应的协变量,全模型和SCM/SCM+得出的结论与真模型一致。对于没有模拟效果的协变量,full模型主要认为它们是非相关的(NR)不显著或信息不足(II)不显著,而SCM/SCM+主要不选择它们。这些结果与我们之前的发现一致。具有模拟效应的协变量的结论几乎没有变化。对于没有模拟效应的协变量,更常规的阈值使整个模型更频繁地得出它们的NR,而不是II,可能是由于更广泛的参考区域和更严格的I型误差控制。总体而言,我们的结果在不同阈值之间的一致性证明了它们的鲁棒性并支持它们的普遍性。
期刊介绍:
Broadly speaking, the Journal of Pharmacokinetics and Pharmacodynamics covers the area of pharmacometrics. The journal is devoted to illustrating the importance of pharmacokinetics, pharmacodynamics, and pharmacometrics in drug development, clinical care, and the understanding of drug action. The journal publishes on a variety of topics related to pharmacometrics, including, but not limited to, clinical, experimental, and theoretical papers examining the kinetics of drug disposition and effects of drug action in humans, animals, in vitro, or in silico; modeling and simulation methodology, including optimal design; precision medicine; systems pharmacology; and mathematical pharmacology (including computational biology, bioengineering, and biophysics related to pharmacology, pharmacokinetics, orpharmacodynamics). Clinical papers that include population pharmacokinetic-pharmacodynamic relationships are welcome. The journal actively invites and promotes up-and-coming areas of pharmacometric research, such as real-world evidence, quality of life analyses, and artificial intelligence. The Journal of Pharmacokinetics and Pharmacodynamics is an official journal of the International Society of Pharmacometrics.