Can researchers trust ICD-10 coding of medical comorbidities in orthopaedic trauma patients?

Abstract

Objectives: The 10th revision of the International Classification of Diseases (ICD-10) coding system may prove useful to orthopaedic trauma researchers to identify and document populations based on comorbidities. However, its use for research first necessitates determination of its reliability. The purpose of this study was to assess the reliability of electronic medical record (EMR) ICD-10 coding of nonorthopaedic diagnoses in orthopaedic trauma patients relative to the gold standard of prospective data collection.

Design: Nonexperimental cross-sectional study.

Setting: Level 1 Trauma Center.

Patients/participants: Two hundred sixty-three orthopaedic trauma patients from 2 prior prospective studies from September 2018 to April 2022.

Intervention: Prospectively collected data were compared with EMR ICD-10 code abstraction for components of the Charlson Comorbidity Index (CCI), obesity, alcohol abuse, and tobacco use (retrospective data).

Main outcome measurements: Percent agreement and Cohen's kappa reliability.

Results: Percent agreement ranged from 86.7% to 96.9% for all CCI diagnoses and was as low as 72.6% for the diagnosis "overweight." Only 2 diagnoses, diabetes without end-organ damage (kappa = 0.794) and AIDS (kappa = 0.798) demonstrated Cohen's kappa values to indicate substantial agreement.

Conclusion: EMR diagnostic coding for medical comorbidities in orthopaedic trauma patients demonstrated variable reliability. Researchers may be able to rely on EMR coding to identify patients with diabetes without complications or AIDS. Chart review may still be necessary to confirm diagnoses. Low prevalence of most comorbidities led to high percentage agreement with low reliability.

Level of evidence: Level 1 diagnostic.