Madison Coots, Soroush Saghafian, David M Kent, Sharad Goel
{"title":"A Framework for Considering the Value of Race and Ethnicity in Estimating Disease Risk.","authors":"Madison Coots, Soroush Saghafian, David M Kent, Sharad Goel","doi":"10.7326/M23-3166","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Accounting for race and ethnicity in estimating disease risk may improve the accuracy of predictions but may also encourage a racialized view of medicine.</p><p><strong>Objective: </strong>To present a decision analytic framework for considering the potential benefits of race-aware over race-unaware risk predictions, using cardiovascular disease, breast cancer, and lung cancer as case studies.</p><p><strong>Design: </strong>Cross-sectional study.</p><p><strong>Setting: </strong>NHANES (National Health and Nutrition Examination Survey), 2011 to 2018, and NLST (National Lung Screening Trial), 2002 to 2004.</p><p><strong>Patients: </strong>U.S. adults.</p><p><strong>Measurements: </strong>Starting with risk predictions from clinically recommended race-aware models, the researchers generated race-unaware predictions via statistical marginalization. They then estimated the utility gains of the race-aware over the race-unaware models, based on a simple utility function that assumes constant costs of screening and constant benefits of disease detection.</p><p><strong>Results: </strong>The race-unaware predictions were substantially miscalibrated across racial and ethnic groups compared with the race-aware predictions as the benchmark. However, the clinical net benefit at the population level of race-aware predictions over race-unaware predictions was smaller than expected. This result stems from 2 empirical patterns: First, across all 3 diseases, 95% or more of individuals would receive the same decision regardless of whether race and ethnicity are included in risk models; second, for those who receive different decisions, the net benefit of screening or treatment is relatively small because these patients have disease risks close to the decision threshold (that is, the theoretical \"point of indifference\"). When used to inform rationing, race-aware models may have a more substantial net benefit.</p><p><strong>Limitations: </strong>For illustrative purposes, the race-aware models were assumed to yield accurate estimates of risk given the input variables. The researchers used a simplified approach to generate race-unaware risk predictions from the race-aware models and a simple utility function to compare models.</p><p><strong>Conclusion: </strong>The analysis highlights the importance of foregrounding changes in decisions and utility when evaluating the potential benefit of using race and ethnicity to estimate disease risk.</p><p><strong>Primary funding source: </strong>The Greenwall Foundation.</p>","PeriodicalId":7932,"journal":{"name":"Annals of Internal Medicine","volume":" ","pages":""},"PeriodicalIF":19.6000,"publicationDate":"2024-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Annals of Internal Medicine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.7326/M23-3166","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Accounting for race and ethnicity in estimating disease risk may improve the accuracy of predictions but may also encourage a racialized view of medicine.
Objective: To present a decision analytic framework for considering the potential benefits of race-aware over race-unaware risk predictions, using cardiovascular disease, breast cancer, and lung cancer as case studies.
Design: Cross-sectional study.
Setting: NHANES (National Health and Nutrition Examination Survey), 2011 to 2018, and NLST (National Lung Screening Trial), 2002 to 2004.
Patients: U.S. adults.
Measurements: Starting with risk predictions from clinically recommended race-aware models, the researchers generated race-unaware predictions via statistical marginalization. They then estimated the utility gains of the race-aware over the race-unaware models, based on a simple utility function that assumes constant costs of screening and constant benefits of disease detection.
Results: The race-unaware predictions were substantially miscalibrated across racial and ethnic groups compared with the race-aware predictions as the benchmark. However, the clinical net benefit at the population level of race-aware predictions over race-unaware predictions was smaller than expected. This result stems from 2 empirical patterns: First, across all 3 diseases, 95% or more of individuals would receive the same decision regardless of whether race and ethnicity are included in risk models; second, for those who receive different decisions, the net benefit of screening or treatment is relatively small because these patients have disease risks close to the decision threshold (that is, the theoretical "point of indifference"). When used to inform rationing, race-aware models may have a more substantial net benefit.
Limitations: For illustrative purposes, the race-aware models were assumed to yield accurate estimates of risk given the input variables. The researchers used a simplified approach to generate race-unaware risk predictions from the race-aware models and a simple utility function to compare models.
Conclusion: The analysis highlights the importance of foregrounding changes in decisions and utility when evaluating the potential benefit of using race and ethnicity to estimate disease risk.
期刊介绍:
Established in 1927 by the American College of Physicians (ACP), Annals of Internal Medicine is the premier internal medicine journal. Annals of Internal Medicine’s mission is to promote excellence in medicine, enable physicians and other health care professionals to be well informed members of the medical community and society, advance standards in the conduct and reporting of medical research, and contribute to improving the health of people worldwide. To achieve this mission, the journal publishes a wide variety of original research, review articles, practice guidelines, and commentary relevant to clinical practice, health care delivery, public health, health care policy, medical education, ethics, and research methodology. In addition, the journal publishes personal narratives that convey the feeling and the art of medicine.