Richard W Grant, Jodi K McCloskey, Connie S Uratsu, Dilrini Ranatunga, James D Ralston, Elizabeth A Bayliss, Oleg Sofrygin
{"title":"Predicting Self-Reported Social Risk in Medically Complex Adults Using Electronic Health Data.","authors":"Richard W Grant, Jodi K McCloskey, Connie S Uratsu, Dilrini Ranatunga, James D Ralston, Elizabeth A Bayliss, Oleg Sofrygin","doi":"10.1097/MLR.0000000000002021","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Social barriers to health care, such as food insecurity, financial distress, and housing instability, may impede effective clinical management for individuals with chronic illness. Systematic strategies are needed to more efficiently identify at-risk individuals who may benefit from proactive outreach by health care systems for screening and referral to available social resources.</p><p><strong>Objective: </strong>To create a predictive model to identify a higher likelihood of food insecurity, financial distress, and/or housing instability among adults with multiple chronic medical conditions.</p><p><strong>Research design and subjects: </strong>We developed and validated a predictive model in adults with 2 or more chronic conditions who were receiving care within Kaiser Permanente Northern California (KPNC) between January 2017 and February 2020. The model was developed to predict the likelihood of a \"yes\" response to any of 3 validated self-reported survey questions related to current concerns about food insecurity, financial distress, and/or housing instability. External model validation was conducted in a separate cohort of adult non-Medicaid KPNC members aged 35-85 who completed a survey administered to a random sample of health plan members between April and June 2021 (n = 2820).</p><p><strong>Measures: </strong>We examined the performance of multiple model iterations by comparing areas under the receiver operating characteristic curves (AUCs). We also assessed algorithmic bias related to race/ethnicity and calculated model performance at defined risk thresholds for screening implementation.</p><p><strong>Results: </strong>Patients in the primary modeling cohort (n = 11,999) had a mean age of 53.8 (±19.3) years, 64.7% were women, and 63.9% were of non-White race/ethnicity. The final, simplified model with 30 predictors (including utilization, diagnosis, behavior, insurance, neighborhood, and pharmacy-based variables) had an AUC of 0.68. The model remained robust within different race/ethnic strata.</p><p><strong>Conclusions: </strong>Our results demonstrated that a predictive model developed using information gleaned from the medical record and from public census tract data can be used to identify patients who may benefit from proactive social needs assessment. Depending on the prevalence of social needs in the target population, different risk output thresholds could be set to optimize positive predictive value for successful outreach. This predictive model-based strategy provides a pathway for prioritizing more intensive social risk outreach and screening efforts to the patients who may be in greatest need.</p>","PeriodicalId":3,"journal":{"name":"ACS Applied Electronic Materials","volume":null,"pages":null},"PeriodicalIF":4.3000,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Electronic Materials","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/MLR.0000000000002021","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/6/4 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Social barriers to health care, such as food insecurity, financial distress, and housing instability, may impede effective clinical management for individuals with chronic illness. Systematic strategies are needed to more efficiently identify at-risk individuals who may benefit from proactive outreach by health care systems for screening and referral to available social resources.
Objective: To create a predictive model to identify a higher likelihood of food insecurity, financial distress, and/or housing instability among adults with multiple chronic medical conditions.
Research design and subjects: We developed and validated a predictive model in adults with 2 or more chronic conditions who were receiving care within Kaiser Permanente Northern California (KPNC) between January 2017 and February 2020. The model was developed to predict the likelihood of a "yes" response to any of 3 validated self-reported survey questions related to current concerns about food insecurity, financial distress, and/or housing instability. External model validation was conducted in a separate cohort of adult non-Medicaid KPNC members aged 35-85 who completed a survey administered to a random sample of health plan members between April and June 2021 (n = 2820).
Measures: We examined the performance of multiple model iterations by comparing areas under the receiver operating characteristic curves (AUCs). We also assessed algorithmic bias related to race/ethnicity and calculated model performance at defined risk thresholds for screening implementation.
Results: Patients in the primary modeling cohort (n = 11,999) had a mean age of 53.8 (±19.3) years, 64.7% were women, and 63.9% were of non-White race/ethnicity. The final, simplified model with 30 predictors (including utilization, diagnosis, behavior, insurance, neighborhood, and pharmacy-based variables) had an AUC of 0.68. The model remained robust within different race/ethnic strata.
Conclusions: Our results demonstrated that a predictive model developed using information gleaned from the medical record and from public census tract data can be used to identify patients who may benefit from proactive social needs assessment. Depending on the prevalence of social needs in the target population, different risk output thresholds could be set to optimize positive predictive value for successful outreach. This predictive model-based strategy provides a pathway for prioritizing more intensive social risk outreach and screening efforts to the patients who may be in greatest need.