The survival double descent: generalization dynamics of deep neural networks in time-to-event analysis.

IF 3.7 3区 医学 Q1 HEALTH CARE SCIENCES & SERVICES
Steven N Hart, Ann L Oberg
{"title":"The survival double descent: generalization dynamics of deep neural networks in time-to-event analysis.","authors":"Steven N Hart, Ann L Oberg","doi":"10.1186/s12874-026-02894-1","DOIUrl":null,"url":null,"abstract":"<p><p>Recent work on double descent has challenged classical bias-variance tradeoffs, showing that test error can decrease, increase sharply near the interpolation threshold, and then decrease again as model capacity grows. This phenomenon has been documented in regression and classification, but its relevance to survival analysis remains unclear. Survival data are subject to censoring, which obscures true event times, and widely used models such as the Cox proportional hazards model are optimized via partial likelihoods that emphasize ranking rather than calibrated risk estimation. It is therefore unknown whether double descent occurs in this setting, how censoring influences its manifestation, or how it interacts with standard performance metrics.We investigate these questions using synthetic survival data generated from Weibull hazards with controlled censoring, allowing systematic variation of model capacity from under to over parameterized regimes.While we verified double descent occurs in survival models, calibration plateaus and decouples from discrimination, even under strong [Formula: see text] regularization. This decoupling arises because the Cox partial likelihood optimizes rankings rather than magnitudes, producing extreme risk scores that break the Breslow estimator used to estimate survival probabilities. Validation on two real-world clinical datasets, the METABRIC breast cancer cohort and the SUPPORT study of seriously ill hospitalized adults, confirms the calibration-discrimination decoupling: IBS saturates at a constant value as network width grows while concordance varies, reproducing the primary synthetic finding across distinct clinical domains and sample sizes. These results highlight limitations of discrimination-based model selection in survival analysis and underscore the need for calibration-aware evaluation in high-capacity prognostic models.</p>","PeriodicalId":9114,"journal":{"name":"BMC Medical Research Methodology","volume":" ","pages":""},"PeriodicalIF":3.7000,"publicationDate":"2026-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13465384/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Medical Research Methodology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12874-026-02894-1","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0

Abstract

Recent work on double descent has challenged classical bias-variance tradeoffs, showing that test error can decrease, increase sharply near the interpolation threshold, and then decrease again as model capacity grows. This phenomenon has been documented in regression and classification, but its relevance to survival analysis remains unclear. Survival data are subject to censoring, which obscures true event times, and widely used models such as the Cox proportional hazards model are optimized via partial likelihoods that emphasize ranking rather than calibrated risk estimation. It is therefore unknown whether double descent occurs in this setting, how censoring influences its manifestation, or how it interacts with standard performance metrics.We investigate these questions using synthetic survival data generated from Weibull hazards with controlled censoring, allowing systematic variation of model capacity from under to over parameterized regimes.While we verified double descent occurs in survival models, calibration plateaus and decouples from discrimination, even under strong [Formula: see text] regularization. This decoupling arises because the Cox partial likelihood optimizes rankings rather than magnitudes, producing extreme risk scores that break the Breslow estimator used to estimate survival probabilities. Validation on two real-world clinical datasets, the METABRIC breast cancer cohort and the SUPPORT study of seriously ill hospitalized adults, confirms the calibration-discrimination decoupling: IBS saturates at a constant value as network width grows while concordance varies, reproducing the primary synthetic finding across distinct clinical domains and sample sizes. These results highlight limitations of discrimination-based model selection in survival analysis and underscore the need for calibration-aware evaluation in high-capacity prognostic models.

生存双下降:深度神经网络在时间-事件分析中的泛化动力学。
最近关于双下降的研究挑战了经典的偏差-方差权衡,表明测试误差可以减小,在接近插值阈值时急剧增加,然后随着模型容量的增加再次减小。这一现象在回归和分类中已有文献记载,但其与生存分析的相关性尚不清楚。生存数据受到审查,这模糊了真实的事件时间,广泛使用的模型,如Cox比例风险模型,是通过强调排名而不是校准风险估计的部分似然来优化的。因此,在这种情况下是否会发生双重下降,审查如何影响其表现,以及它如何与标准绩效指标相互作用,都是未知的。我们使用由威布尔危险生成的综合生存数据进行了研究,并进行了控制审查,允许模型能力从参数化状态下到参数化状态下的系统变化。虽然我们证实双重下降发生在生存模型,校准平台和解耦,甚至在强正则化[公式:见文本]。之所以出现这种脱钩,是因为Cox部分似然优化的是排名,而不是大小,产生的极端风险分数打破了用于估计生存概率的Breslow估计器。对两个真实世界临床数据集的验证,METABRIC乳腺癌队列和重症住院成人的SUPPORT研究,证实了校准-歧视脱钩:随着网络宽度的增长,IBS在恒定值饱和,而一致性变化,在不同的临床领域和样本量中再现了主要的合成发现。这些结果突出了基于判别的模型选择在生存分析中的局限性,并强调了在高容量预后模型中进行校准意识评估的必要性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
BMC Medical Research Methodology
BMC Medical Research Methodology 医学-卫生保健
CiteScore
6.50
自引率
2.50%
发文量
298
审稿时长
3-8 weeks
期刊介绍: BMC Medical Research Methodology is an open access journal publishing original peer-reviewed research articles in methodological approaches to healthcare research. Articles on the methodology of epidemiological research, clinical trials and meta-analysis/systematic review are particularly encouraged, as are empirical studies of the associations between choice of methodology and study outcomes. BMC Medical Research Methodology does not aim to publish articles describing scientific methods or techniques: these should be directed to the BMC journal covering the relevant biomedical subject area.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书