Stefanie Schoenen, Nicole Heussen, Johan Verbeeck, Ralf-Dieter Hilgers
{"title":"在采用多种测试策略的多终点临床试验中,分配偏差对测试决策的影响。","authors":"Stefanie Schoenen, Nicole Heussen, Johan Verbeeck, Ralf-Dieter Hilgers","doi":"10.1186/s12874-024-02335-x","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Considering multiple endpoints in clinical trials provide a more comprehensive understanding of treatment effects and may lead to increased power or reduced sample size, which may be beneficial in rare diseases. Besides the small sample sizes, allocation bias is an issue that affects the validity of these trials. We investigate the impact of allocation bias on testing decisions in clinical trials with multiple endpoints and offer a tool for selecting an appropriate randomization procedure (RP).</p><p><strong>Methods: </strong>We derive a model for quantifying the effect of allocation bias depending on the RP in the case of two-arm parallel group trials with continuous multiple endpoints. We focus on two approaches to analyze multiple endpoints, either the Šidák procedure to show efficacy in at least one endpoint and the all-or-none procedure to show efficacy in all endpoints.</p><p><strong>Results: </strong>To evaluate the impact of allocation bias on the test decision we propose a biasing policy for multiple endpoints. The impact of allocation on the test decision is measured by the family-wise error rate of the Šidák procedure and the type I error rate of the all-or-none procedure. Using the biasing policy we derive formulas to calculate these error rates. In simulations we show that, for the Šidák procedure as well as for the all-or-none procedure, allocation bias leads to inflation of the mean family-wise error and mean type I error, respectively. The strength of this inflation is affected by the choice of the RP.</p><p><strong>Conclusion: </strong>Allocation bias should be considered during the design phase of a trial to increase validity. The developed methodology is useful for selecting an appropriate RP for a clinical trial with multiple endpoints to minimize allocation bias effects.</p>","PeriodicalId":9114,"journal":{"name":"BMC Medical Research Methodology","volume":"24 1","pages":"223"},"PeriodicalIF":3.9000,"publicationDate":"2024-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11441119/pdf/","citationCount":"0","resultStr":"{\"title\":\"The impact of allocation bias on test decisions in clinical trials with multiple endpoints using multiple testing strategies.\",\"authors\":\"Stefanie Schoenen, Nicole Heussen, Johan Verbeeck, Ralf-Dieter Hilgers\",\"doi\":\"10.1186/s12874-024-02335-x\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Considering multiple endpoints in clinical trials provide a more comprehensive understanding of treatment effects and may lead to increased power or reduced sample size, which may be beneficial in rare diseases. Besides the small sample sizes, allocation bias is an issue that affects the validity of these trials. We investigate the impact of allocation bias on testing decisions in clinical trials with multiple endpoints and offer a tool for selecting an appropriate randomization procedure (RP).</p><p><strong>Methods: </strong>We derive a model for quantifying the effect of allocation bias depending on the RP in the case of two-arm parallel group trials with continuous multiple endpoints. We focus on two approaches to analyze multiple endpoints, either the Šidák procedure to show efficacy in at least one endpoint and the all-or-none procedure to show efficacy in all endpoints.</p><p><strong>Results: </strong>To evaluate the impact of allocation bias on the test decision we propose a biasing policy for multiple endpoints. The impact of allocation on the test decision is measured by the family-wise error rate of the Šidák procedure and the type I error rate of the all-or-none procedure. Using the biasing policy we derive formulas to calculate these error rates. In simulations we show that, for the Šidák procedure as well as for the all-or-none procedure, allocation bias leads to inflation of the mean family-wise error and mean type I error, respectively. The strength of this inflation is affected by the choice of the RP.</p><p><strong>Conclusion: </strong>Allocation bias should be considered during the design phase of a trial to increase validity. The developed methodology is useful for selecting an appropriate RP for a clinical trial with multiple endpoints to minimize allocation bias effects.</p>\",\"PeriodicalId\":9114,\"journal\":{\"name\":\"BMC Medical Research Methodology\",\"volume\":\"24 1\",\"pages\":\"223\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2024-09-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11441119/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"BMC Medical Research Methodology\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1186/s12874-024-02335-x\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"HEALTH CARE SCIENCES & SERVICES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Medical Research Methodology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12874-024-02335-x","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
摘要
背景:在临床试验中考虑多个终点,可以更全面地了解治疗效果,并可提高功率或减少样本量,这对罕见病可能是有益的。除了样本量小之外,分配偏差也是影响这些试验有效性的一个问题。我们研究了分配偏差对多终点临床试验中测试决策的影响,并提供了一种选择适当随机化程序(RP)的工具:我们推导了一个模型,用于量化分配偏差对连续多终点双臂平行组试验中随机化程序的影响。我们将重点放在分析多终点的两种方法上,即至少在一个终点上显示疗效的希达克程序和在所有终点上显示疗效的全或无程序:为了评估分配偏差对试验决策的影响,我们提出了一种针对多终点的偏差政策。分配对测试决策的影响通过希达克程序的全族误差率和全或无程序的 I 型误差率来衡量。利用偏置策略,我们得出了计算这些误差率的公式。模拟结果表明,对于希达克程序和全或无程序,分配偏差分别会导致平均族内误差和平均 I 类误差的膨胀。这种膨胀的强度受 RP 选择的影响:结论:在试验设计阶段应考虑分配偏差,以提高有效性。所开发的方法有助于为具有多个终点的临床试验选择合适的 RP,以尽量减少分配偏差的影响。
The impact of allocation bias on test decisions in clinical trials with multiple endpoints using multiple testing strategies.
Background: Considering multiple endpoints in clinical trials provide a more comprehensive understanding of treatment effects and may lead to increased power or reduced sample size, which may be beneficial in rare diseases. Besides the small sample sizes, allocation bias is an issue that affects the validity of these trials. We investigate the impact of allocation bias on testing decisions in clinical trials with multiple endpoints and offer a tool for selecting an appropriate randomization procedure (RP).
Methods: We derive a model for quantifying the effect of allocation bias depending on the RP in the case of two-arm parallel group trials with continuous multiple endpoints. We focus on two approaches to analyze multiple endpoints, either the Šidák procedure to show efficacy in at least one endpoint and the all-or-none procedure to show efficacy in all endpoints.
Results: To evaluate the impact of allocation bias on the test decision we propose a biasing policy for multiple endpoints. The impact of allocation on the test decision is measured by the family-wise error rate of the Šidák procedure and the type I error rate of the all-or-none procedure. Using the biasing policy we derive formulas to calculate these error rates. In simulations we show that, for the Šidák procedure as well as for the all-or-none procedure, allocation bias leads to inflation of the mean family-wise error and mean type I error, respectively. The strength of this inflation is affected by the choice of the RP.
Conclusion: Allocation bias should be considered during the design phase of a trial to increase validity. The developed methodology is useful for selecting an appropriate RP for a clinical trial with multiple endpoints to minimize allocation bias effects.
期刊介绍:
BMC Medical Research Methodology is an open access journal publishing original peer-reviewed research articles in methodological approaches to healthcare research. Articles on the methodology of epidemiological research, clinical trials and meta-analysis/systematic review are particularly encouraged, as are empirical studies of the associations between choice of methodology and study outcomes. BMC Medical Research Methodology does not aim to publish articles describing scientific methods or techniques: these should be directed to the BMC journal covering the relevant biomedical subject area.