Assessing the Validity of Claims-Based Diagnostic Codes for Psychotic and Affective Disorders and the Influence of the Coding Transition from the ICD-9 to the ICD-10 in Taiwan's National Health Insurance Research Database.
IF 3.2 2区 医学Q1 PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH
{"title":"Assessing the Validity of Claims-Based Diagnostic Codes for Psychotic and Affective Disorders and the Influence of the Coding Transition from the ICD-9 to the ICD-10 in Taiwan's National Health Insurance Research Database.","authors":"Yen-Wen Wang, Chen-Chung Liu, Hsi-Chung Chen, Chi-Shin Wu, Jen-Hui Chan, Cheng-Che Chen, Wei-Lieh Huang, Shih-Cheng Liao, Tzung-Jeng Hwang, Wei J Chen","doi":"10.2147/CLEP.S522618","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>No studies have validated psychiatric diseases diagnoses in Taiwan's National Health Insurance Research Database (NHIRD). We aimed to assess the interrater reliability of chart-review among psychiatrists, examine the validity of the diagnostic codes for psychotic disorders and affective diseases in the NHIRD against review-based diagnoses, and examine whether the change in the coding system from the ICD-9-CM to the ICD-10-CM affected the validity of the diagnostic codes.</p><p><strong>Patients and methods: </strong>The study participants were psychiatric inpatients aged 18 to 65 years who were admitted in 2015 and 2017, respectively, to the main and three branch hospitals of National Taiwan University Hospital. A chart review was conducted among 48 purposively selected inpatients with discharge diagnoses in five core categories to assess interrater reliability. This chart-review procedure was then used to generate diagnostic codes for a stratified sampling of 727 inpatients with discharge diagnoses in 12 diagnostic categories of psychotic disorders and affective disorders to examine the validity of the diagnostic codes.</p><p><strong>Results: </strong>The intraclass correlation coefficient reliability of schizophrenia and three broad categories of diagnoses indicated good interrater reliability. The positive predictive value and sensitivity of common diagnoses in the narrow category (eg, schizophrenia) or the broad category (eg, psychotic disorders, bipolar disorders, and major depressive disorders) were high-performing (≥ 0.70), whereas those of the diagnoses of low prevalence were modest. The validity indices of claims-based diagnoses using the ICD-10-CM tended to be better than those using the ICD-9-CM.</p><p><strong>Conclusion: </strong>This first-ever study validating psychiatric diagnoses in Taiwan's NHIRD using a structured chart review suggests that the diagnostic codes of narrow categories of schizophrenia or other broad categories are recommended for high-performing validity indices. Intensive training for the coding plus the specific details requested by the ICD-10 may increase the validity of the claims-based databases for psychotic and affective disorders.</p>","PeriodicalId":10362,"journal":{"name":"Clinical Epidemiology","volume":"17 ","pages":"635-645"},"PeriodicalIF":3.2000,"publicationDate":"2025-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12258254/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical Epidemiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.2147/CLEP.S522618","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: No studies have validated psychiatric diseases diagnoses in Taiwan's National Health Insurance Research Database (NHIRD). We aimed to assess the interrater reliability of chart-review among psychiatrists, examine the validity of the diagnostic codes for psychotic disorders and affective diseases in the NHIRD against review-based diagnoses, and examine whether the change in the coding system from the ICD-9-CM to the ICD-10-CM affected the validity of the diagnostic codes.
Patients and methods: The study participants were psychiatric inpatients aged 18 to 65 years who were admitted in 2015 and 2017, respectively, to the main and three branch hospitals of National Taiwan University Hospital. A chart review was conducted among 48 purposively selected inpatients with discharge diagnoses in five core categories to assess interrater reliability. This chart-review procedure was then used to generate diagnostic codes for a stratified sampling of 727 inpatients with discharge diagnoses in 12 diagnostic categories of psychotic disorders and affective disorders to examine the validity of the diagnostic codes.
Results: The intraclass correlation coefficient reliability of schizophrenia and three broad categories of diagnoses indicated good interrater reliability. The positive predictive value and sensitivity of common diagnoses in the narrow category (eg, schizophrenia) or the broad category (eg, psychotic disorders, bipolar disorders, and major depressive disorders) were high-performing (≥ 0.70), whereas those of the diagnoses of low prevalence were modest. The validity indices of claims-based diagnoses using the ICD-10-CM tended to be better than those using the ICD-9-CM.
Conclusion: This first-ever study validating psychiatric diagnoses in Taiwan's NHIRD using a structured chart review suggests that the diagnostic codes of narrow categories of schizophrenia or other broad categories are recommended for high-performing validity indices. Intensive training for the coding plus the specific details requested by the ICD-10 may increase the validity of the claims-based databases for psychotic and affective disorders.
期刊介绍：
Clinical Epidemiology is an international, peer reviewed, open access journal. Clinical Epidemiology focuses on the application of epidemiological principles and questions relating to patients and clinical care in terms of prevention, diagnosis, prognosis, and treatment.
Clinical Epidemiology welcomes papers covering these topics in form of original research and systematic reviews.
Clinical Epidemiology has a special interest in international electronic medical patient records and other routine health care data, especially as applied to safety of medical interventions, clinical utility of diagnostic procedures, understanding short- and long-term clinical course of diseases, clinical epidemiological and biostatistical methods, and systematic reviews.
When considering submission of a paper utilizing publicly-available data, authors should ensure that such studies add significantly to the body of knowledge and that they use appropriate validated methods for identifying health outcomes.
The journal has launched special series describing existing data sources for clinical epidemiology, international health care systems and validation studies of algorithms based on databases and registries.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
