{"title":"Penalized landmark supermodels (penLM) for dynamic prediction for time-to-event outcomes in high-dimensional data.","authors":"Anya H Fries, Eunji Choi, Summer S Han","doi":"10.1186/s12874-024-02418-9","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>To effectively monitor long-term outcomes among cancer patients, it is critical to accurately assess patients' dynamic prognosis, which often involves utilizing multiple data sources (e.g., tumor registries, treatment histories, and patient-reported outcomes). However, challenges arise in selecting features to predict patient outcomes from high-dimensional data, aligning longitudinal measurements from multiple sources, and evaluating dynamic model performance.</p><p><strong>Methods: </strong>We provide a framework for dynamic risk prediction using the penalized landmark supermodel (penLM) and develop novel metrics ([Formula: see text] and [Formula: see text]) to evaluate and summarize model performance across different timepoints. Through simulations, we assess the coverage of the proposed metrics' confidence intervals under various scenarios. We applied penLM to predict the updated 5-year risk of lung cancer mortality at diagnosis and for subsequent years by combining data from SEER registries (2007-2018), Medicare claims (2007-2018), Medicare Health Outcome Survey (2006-2018), and U.S. Census (1990-2010).</p><p><strong>Results: </strong>The simulations confirmed valid coverage (~ 95%) of the confidence intervals of the proposed summary metrics. Of 4,670 lung cancer patients, 41.5% died from lung cancer. Using penLM, the key features to predict lung cancer mortality included long-term lung cancer treatments, minority races, regions with low education attainment or racial segregation, and various patient-reported outcomes beyond cancer staging and tumor characteristics. When evaluated using the proposed metrics, the penLM model developed using multi-source data ([Formula: see text]of 0.77 [95% confidence interval: 0.74-0.79]) outperformed those developed using single-source data ([Formula: see text]range: 0.50-0.74).</p><p><strong>Conclusions: </strong>The proposed penLM framework with novel evaluation metrics offers effective dynamic risk prediction when leveraging high-dimensional multi-source longitudinal data.</p>","PeriodicalId":9114,"journal":{"name":"BMC Medical Research Methodology","volume":"25 1","pages":"22"},"PeriodicalIF":3.9000,"publicationDate":"2025-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11771018/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Medical Research Methodology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12874-024-02418-9","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Background: To effectively monitor long-term outcomes among cancer patients, it is critical to accurately assess patients' dynamic prognosis, which often involves utilizing multiple data sources (e.g., tumor registries, treatment histories, and patient-reported outcomes). However, challenges arise in selecting features to predict patient outcomes from high-dimensional data, aligning longitudinal measurements from multiple sources, and evaluating dynamic model performance.
Methods: We provide a framework for dynamic risk prediction using the penalized landmark supermodel (penLM) and develop novel metrics ([Formula: see text] and [Formula: see text]) to evaluate and summarize model performance across different timepoints. Through simulations, we assess the coverage of the proposed metrics' confidence intervals under various scenarios. We applied penLM to predict the updated 5-year risk of lung cancer mortality at diagnosis and for subsequent years by combining data from SEER registries (2007-2018), Medicare claims (2007-2018), Medicare Health Outcome Survey (2006-2018), and U.S. Census (1990-2010).
Results: The simulations confirmed valid coverage (~ 95%) of the confidence intervals of the proposed summary metrics. Of 4,670 lung cancer patients, 41.5% died from lung cancer. Using penLM, the key features to predict lung cancer mortality included long-term lung cancer treatments, minority races, regions with low education attainment or racial segregation, and various patient-reported outcomes beyond cancer staging and tumor characteristics. When evaluated using the proposed metrics, the penLM model developed using multi-source data ([Formula: see text]of 0.77 [95% confidence interval: 0.74-0.79]) outperformed those developed using single-source data ([Formula: see text]range: 0.50-0.74).
Conclusions: The proposed penLM framework with novel evaluation metrics offers effective dynamic risk prediction when leveraging high-dimensional multi-source longitudinal data.
期刊介绍:
BMC Medical Research Methodology is an open access journal publishing original peer-reviewed research articles in methodological approaches to healthcare research. Articles on the methodology of epidemiological research, clinical trials and meta-analysis/systematic review are particularly encouraged, as are empirical studies of the associations between choice of methodology and study outcomes. BMC Medical Research Methodology does not aim to publish articles describing scientific methods or techniques: these should be directed to the BMC journal covering the relevant biomedical subject area.