Kathryn M Ledwin, Sabrina Casucci, Suzanne S Sullivan, Sharon Hewner
{"title":"Area Deprivation and Patient Complexity Predict Low-Value Health Care Utilization in Persons With Heart Failure.","authors":"Kathryn M Ledwin, Sabrina Casucci, Suzanne S Sullivan, Sharon Hewner","doi":"10.1097/NNR.0000000000000794","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Heart failure is a debilitating condition affecting over 6.7 million adults in the United States. Social risks and complexity, or personal, social, and clinical aspects of persons' experiences, have been found to influence health care utilization and hospitalizations in persons with HF. Low-value utilization, or irregular outpatient visits with frequent emergency room use, or hospitalization is common among persons with complex conditions and social risk and requires further investigation in the heart failure population.</p><p><strong>Objective: </strong>The purpose of this research was to assess the influence of complexity and social risk on low-value utilization in persons with heart failure using machine learning approaches.</p><p><strong>Methods: </strong>Supervised machine learning, tree-based predictive modeling was conducted on an existing data set of adults with heart failure in the eight-county region of Western New York for the year 2022. Decision tree and random forest models were validated using a 70/30 training/testing data set and k-fold cross-validation. The models were compared for accuracy and interpretability using the area under the curve, Matthew's correlation coefficient, sensitivity, specificity, precision, and negative predictive value.</p><p><strong>Results: </strong>Area deprivation index, a proxy for social risk, number of chronic conditions, age, and substance use disorders were predictors of low-value utilization in both the decision tree and random forest models. The decision tree model performed moderately, while the random forest model performed excellently and added hardship as an additional important variable.</p><p><strong>Discussion: </strong>This is the first known study to look at the outcome of low-value utilization, targeting individuals who are underutilizing outpatient services. The random forest model performed better than the decision tree; however, features were similar in both models, with area deprivation index as the key variable in predicting low-value utilization. The decision tree was able to produce specific cutoff points, making it more interpretable and useful for clinical application. Both models can be used to create clinical tools for identifying and targeting individuals for intervention and follow-up.</p>","PeriodicalId":49723,"journal":{"name":"Nursing Research","volume":" ","pages":""},"PeriodicalIF":2.2000,"publicationDate":"2024-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nursing Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/NNR.0000000000000794","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"NURSING","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Heart failure is a debilitating condition affecting over 6.7 million adults in the United States. Social risks and complexity, or personal, social, and clinical aspects of persons' experiences, have been found to influence health care utilization and hospitalizations in persons with HF. Low-value utilization, or irregular outpatient visits with frequent emergency room use, or hospitalization is common among persons with complex conditions and social risk and requires further investigation in the heart failure population.
Objective: The purpose of this research was to assess the influence of complexity and social risk on low-value utilization in persons with heart failure using machine learning approaches.
Methods: Supervised machine learning, tree-based predictive modeling was conducted on an existing data set of adults with heart failure in the eight-county region of Western New York for the year 2022. Decision tree and random forest models were validated using a 70/30 training/testing data set and k-fold cross-validation. The models were compared for accuracy and interpretability using the area under the curve, Matthew's correlation coefficient, sensitivity, specificity, precision, and negative predictive value.
Results: Area deprivation index, a proxy for social risk, number of chronic conditions, age, and substance use disorders were predictors of low-value utilization in both the decision tree and random forest models. The decision tree model performed moderately, while the random forest model performed excellently and added hardship as an additional important variable.
Discussion: This is the first known study to look at the outcome of low-value utilization, targeting individuals who are underutilizing outpatient services. The random forest model performed better than the decision tree; however, features were similar in both models, with area deprivation index as the key variable in predicting low-value utilization. The decision tree was able to produce specific cutoff points, making it more interpretable and useful for clinical application. Both models can be used to create clinical tools for identifying and targeting individuals for intervention and follow-up.
期刊介绍:
Nursing Research is a peer-reviewed journal celebrating over 60 years as the most sought-after nursing resource; it offers more depth, more detail, and more of what today''s nurses demand. Nursing Research covers key issues, including health promotion, human responses to illness, acute care nursing research, symptom management, cost-effectiveness, vulnerable populations, health services, and community-based nursing studies. Each issue highlights the latest research techniques, quantitative and qualitative studies, and new state-of-the-art methodological strategies, including information not yet found in textbooks. Expert commentaries and briefs are also included. In addition to 6 issues per year, Nursing Research from time to time publishes supplemental content not found anywhere else.