Y-H Lee,J H Lee,Q-S Auh,S Lee,D Nixdorf,A Chaurasia
{"title":"用掩模自监督表格变压器诊断TMD。","authors":"Y-H Lee,J H Lee,Q-S Auh,S Lee,D Nixdorf,A Chaurasia","doi":"10.1177/00220345251376974","DOIUrl":null,"url":null,"abstract":"Temporomandibular disorders (TMDs) encompass a heterogeneous group of musculoskeletal conditions involving the temporomandibular joint (TMJ), masticatory muscles, and associated structures. Diagnosis remains challenging due to overlapping symptoms, multifactorial etiology, and variability across clinical settings. To address these limitations, we developed the Gated Attention Tabular Transformer (GATT), a novel deep-learning model that uses masked self-supervised learning and gated attention mechanisms, to classify TMD subgroups based on the diagnostic criteria for TMD (DC/TMD). A total of 4,644 structured clinical records from a university-based registry were analyzed, comprising 3,524 female and 1,120 male patients (mean age 36.9 ± 14.7 y), across 12 core TMD subgroups. GATT achieved robust diagnostic performance with area under the receiver-operating characteristic curve values ranging from 0.815 to 1.000, sensitivity from 0.652 to 1.000, and specificity from 0.773 to 1.000. The model significantly outperformed conventional machine-learning methods including logistic regression, random forest, support vector machine, and XGBoost as well as advanced tabular deep-learning models such as TabNet, TabTransformer, AutoGluon Tabular Predictor, and FT-Transformer. Shapley additive explanations (SHAP) analysis revealed \"pain-free opening\" (SHAP = 6.78, P < 0.001) and \"current TMJ noise\" (SHAP = 2.87, P = 0.003) as key features of mechanical TMJ disorders. Co-occurrence network analysis uncovered side-specific clustering and potential time-lagged progression between bilateral TMJs. These findings demonstrate the feasibility of using deep learning to classify heterogeneous TMD subgroups using only structured clinical data, without the need for imaging. The GATT model offers an accurate, explainable, and scalable tool to support clinician-assisted diagnosis and reduce variability in TMD management in real-world practice. These results support the integration of AI-driven tools such as GATT into clinical workflows for standardized, efficient, and patient-specific TMD diagnosis.","PeriodicalId":15596,"journal":{"name":"Journal of Dental Research","volume":"3 1","pages":"220345251376974"},"PeriodicalIF":5.9000,"publicationDate":"2025-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"TMD Diagnosis Using a Masked Self-Supervised Tabular Transformer.\",\"authors\":\"Y-H Lee,J H Lee,Q-S Auh,S Lee,D Nixdorf,A Chaurasia\",\"doi\":\"10.1177/00220345251376974\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Temporomandibular disorders (TMDs) encompass a heterogeneous group of musculoskeletal conditions involving the temporomandibular joint (TMJ), masticatory muscles, and associated structures. Diagnosis remains challenging due to overlapping symptoms, multifactorial etiology, and variability across clinical settings. To address these limitations, we developed the Gated Attention Tabular Transformer (GATT), a novel deep-learning model that uses masked self-supervised learning and gated attention mechanisms, to classify TMD subgroups based on the diagnostic criteria for TMD (DC/TMD). A total of 4,644 structured clinical records from a university-based registry were analyzed, comprising 3,524 female and 1,120 male patients (mean age 36.9 ± 14.7 y), across 12 core TMD subgroups. GATT achieved robust diagnostic performance with area under the receiver-operating characteristic curve values ranging from 0.815 to 1.000, sensitivity from 0.652 to 1.000, and specificity from 0.773 to 1.000. The model significantly outperformed conventional machine-learning methods including logistic regression, random forest, support vector machine, and XGBoost as well as advanced tabular deep-learning models such as TabNet, TabTransformer, AutoGluon Tabular Predictor, and FT-Transformer. Shapley additive explanations (SHAP) analysis revealed \\\"pain-free opening\\\" (SHAP = 6.78, P < 0.001) and \\\"current TMJ noise\\\" (SHAP = 2.87, P = 0.003) as key features of mechanical TMJ disorders. Co-occurrence network analysis uncovered side-specific clustering and potential time-lagged progression between bilateral TMJs. These findings demonstrate the feasibility of using deep learning to classify heterogeneous TMD subgroups using only structured clinical data, without the need for imaging. The GATT model offers an accurate, explainable, and scalable tool to support clinician-assisted diagnosis and reduce variability in TMD management in real-world practice. These results support the integration of AI-driven tools such as GATT into clinical workflows for standardized, efficient, and patient-specific TMD diagnosis.\",\"PeriodicalId\":15596,\"journal\":{\"name\":\"Journal of Dental Research\",\"volume\":\"3 1\",\"pages\":\"220345251376974\"},\"PeriodicalIF\":5.9000,\"publicationDate\":\"2025-10-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Dental Research\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1177/00220345251376974\",\"RegionNum\":1,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"DENTISTRY, ORAL SURGERY & MEDICINE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Dental Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1177/00220345251376974","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
引用次数: 0
摘要
颞下颌关节疾病(TMDs)包括一组异质性的肌肉骨骼疾病,涉及颞下颌关节(TMJ)、咀嚼肌和相关结构。由于症状重叠、多因素病因和临床环境的可变性,诊断仍然具有挑战性。为了解决这些限制,我们开发了门控注意表转换器(GATT),这是一种新型的深度学习模型,使用屏蔽自监督学习和门控注意机制,根据TMD的诊断标准(DC/TMD)对TMD子组进行分类。研究人员分析了来自大学注册中心的4644份结构化临床记录,包括3524名女性和1120名男性患者(平均年龄36.9±14.7岁),涵盖12个核心TMD亚组。GATT具有较强的诊断能力,患者工作特征曲线下面积为0.815 ~ 1.000,灵敏度为0.652 ~ 1.000,特异度为0.773 ~ 1.000。该模型明显优于传统的机器学习方法,包括逻辑回归、随机森林、支持向量机和XGBoost,以及先进的表格深度学习模型,如TabNet、TabTransformer、AutoGluon tabular Predictor和FT-Transformer。Shapley加性解释(SHAP)分析显示,“无痛开口”(SHAP = 6.78, P < 0.001)和“当前TMJ噪声”(SHAP = 2.87, P = 0.003)是机械性TMJ障碍的主要特征。共发生网络分析揭示了两侧tmj之间的侧特异性聚类和潜在的时滞进展。这些发现表明,仅使用结构化临床数据,而无需成像,就可以使用深度学习对异质TMD亚组进行分类。GATT模型提供了一个准确的、可解释的、可扩展的工具,以支持临床辅助诊断,并减少现实世界实践中TMD管理的可变性。这些结果支持将GATT等人工智能驱动的工具整合到临床工作流程中,以实现标准化、高效和针对患者的TMD诊断。
TMD Diagnosis Using a Masked Self-Supervised Tabular Transformer.
Temporomandibular disorders (TMDs) encompass a heterogeneous group of musculoskeletal conditions involving the temporomandibular joint (TMJ), masticatory muscles, and associated structures. Diagnosis remains challenging due to overlapping symptoms, multifactorial etiology, and variability across clinical settings. To address these limitations, we developed the Gated Attention Tabular Transformer (GATT), a novel deep-learning model that uses masked self-supervised learning and gated attention mechanisms, to classify TMD subgroups based on the diagnostic criteria for TMD (DC/TMD). A total of 4,644 structured clinical records from a university-based registry were analyzed, comprising 3,524 female and 1,120 male patients (mean age 36.9 ± 14.7 y), across 12 core TMD subgroups. GATT achieved robust diagnostic performance with area under the receiver-operating characteristic curve values ranging from 0.815 to 1.000, sensitivity from 0.652 to 1.000, and specificity from 0.773 to 1.000. The model significantly outperformed conventional machine-learning methods including logistic regression, random forest, support vector machine, and XGBoost as well as advanced tabular deep-learning models such as TabNet, TabTransformer, AutoGluon Tabular Predictor, and FT-Transformer. Shapley additive explanations (SHAP) analysis revealed "pain-free opening" (SHAP = 6.78, P < 0.001) and "current TMJ noise" (SHAP = 2.87, P = 0.003) as key features of mechanical TMJ disorders. Co-occurrence network analysis uncovered side-specific clustering and potential time-lagged progression between bilateral TMJs. These findings demonstrate the feasibility of using deep learning to classify heterogeneous TMD subgroups using only structured clinical data, without the need for imaging. The GATT model offers an accurate, explainable, and scalable tool to support clinician-assisted diagnosis and reduce variability in TMD management in real-world practice. These results support the integration of AI-driven tools such as GATT into clinical workflows for standardized, efficient, and patient-specific TMD diagnosis.
期刊介绍:
The Journal of Dental Research (JDR) is a peer-reviewed scientific journal committed to sharing new knowledge and information on all sciences related to dentistry and the oral cavity, covering health and disease. With monthly publications, JDR ensures timely communication of the latest research to the oral and dental community.