Eline G M Cox, Daniek A M Meijs, Laure Wynants, Jan-Willem E M Sels, Jacqueline Koeze, Frederik Keus, Bianca Bos-van Dongen, Iwan C C van der Horst, Bas C T van Bussel
{"title":"\"The definition of predictor and outcome variables in mortality prediction models: a scoping review and quality of reporting study\".","authors":"Eline G M Cox, Daniek A M Meijs, Laure Wynants, Jan-Willem E M Sels, Jacqueline Koeze, Frederik Keus, Bianca Bos-van Dongen, Iwan C C van der Horst, Bas C T van Bussel","doi":"10.1016/j.jclinepi.2024.111605","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Mortality prediction models are promising tools for guiding clinical decision-making and resource allocation in intensive care units (ICUs). Clearly specified predictor and outcome variables are necessary to enable external validation and safe clinical application of prediction models. The objective of this study was to identify the predictor and outcome variables used in different mortality prediction models in the ICU and investigate their reporting.</p><p><strong>Methods: </strong>For this scoping review, MEDLINE, EMBASE, Web of Science, and the Cochrane Central Register of Controlled Trials (CENTRAL) were searched. Studies developed within a general ICU population reporting on prediction models with mortality as a primary or secondary outcome were eligible. The selection criteria were adopted from a review by Keuning et al. Predictor and outcome variables, variable characteristics (defined as units, definitions, moments of measurement and methods of measurement), and publication details (defined as first author, year of publication and title) were extracted from the included studies. Predictor and outcome variable categories were demographics, chronic disease, care logistics, acute diagnosis, clinical examination and physiological derangement, laboratory assessment, additional diagnostics, support and therapy, risk scores, and (mortality) outcomes.</p><p><strong>Results: </strong>A total of 56 mortality prediction models containing 204 unique predictor and outcome variables were included. The predictor variables most frequently included in the models were age (40 times), admission type (27 times), and mechanical ventilation (21 times). We observed that single variables were measured with different units, according to different definitions, at a different moment, and with a different method of measurement in different studies. The reporting of the unit was mostly complete (98% overall, 95% in the laboratory assessment category), whereas the definition of the variable (74% overall, 63% in the chronic disease category) and method of measurement (70% overall, 34% in the demographics category) were most often lacking.</p><p><strong>Conclusions: </strong>Accurate and transparent reporting of predictor and outcome variables is paramount to enhance reproducibility, model performance in different contexts, and validity. Since unclarity about the required input data may introduce bias and thereby affect model performance, this study advocates that prognostic ICU models can be improved by transparent and clear reporting of predictor and outcome variables and their characteristics.</p>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":" ","pages":"111605"},"PeriodicalIF":7.3000,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Clinical Epidemiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.jclinepi.2024.111605","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Mortality prediction models are promising tools for guiding clinical decision-making and resource allocation in intensive care units (ICUs). Clearly specified predictor and outcome variables are necessary to enable external validation and safe clinical application of prediction models. The objective of this study was to identify the predictor and outcome variables used in different mortality prediction models in the ICU and investigate their reporting.
Methods: For this scoping review, MEDLINE, EMBASE, Web of Science, and the Cochrane Central Register of Controlled Trials (CENTRAL) were searched. Studies developed within a general ICU population reporting on prediction models with mortality as a primary or secondary outcome were eligible. The selection criteria were adopted from a review by Keuning et al. Predictor and outcome variables, variable characteristics (defined as units, definitions, moments of measurement and methods of measurement), and publication details (defined as first author, year of publication and title) were extracted from the included studies. Predictor and outcome variable categories were demographics, chronic disease, care logistics, acute diagnosis, clinical examination and physiological derangement, laboratory assessment, additional diagnostics, support and therapy, risk scores, and (mortality) outcomes.
Results: A total of 56 mortality prediction models containing 204 unique predictor and outcome variables were included. The predictor variables most frequently included in the models were age (40 times), admission type (27 times), and mechanical ventilation (21 times). We observed that single variables were measured with different units, according to different definitions, at a different moment, and with a different method of measurement in different studies. The reporting of the unit was mostly complete (98% overall, 95% in the laboratory assessment category), whereas the definition of the variable (74% overall, 63% in the chronic disease category) and method of measurement (70% overall, 34% in the demographics category) were most often lacking.
Conclusions: Accurate and transparent reporting of predictor and outcome variables is paramount to enhance reproducibility, model performance in different contexts, and validity. Since unclarity about the required input data may introduce bias and thereby affect model performance, this study advocates that prognostic ICU models can be improved by transparent and clear reporting of predictor and outcome variables and their characteristics.
期刊介绍:
The Journal of Clinical Epidemiology strives to enhance the quality of clinical and patient-oriented healthcare research by advancing and applying innovative methods in conducting, presenting, synthesizing, disseminating, and translating research results into optimal clinical practice. Special emphasis is placed on training new generations of scientists and clinical practice leaders.