Artificial intelligence for predicting post-excision recurrence and malignant progression in oral potentially malignant disorders a retrospective cohort study.
{"title":"Artificial intelligence for predicting post-excision recurrence and malignant progression in oral potentially malignant disorders a retrospective cohort study.","authors":"John Adeoye, Yu-Xiong Su","doi":"10.1097/JS9.0000000000003592","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Oral cancer may develop from precursor lesions and conditions termed oral potentially malignant disorders (OPMD), although not all patients progress to cancer in their lifetime. Managing patients with OPMD is challenging due to lesion recurrence and uncertain malignant progression risk following surgical excision. This study developed a multitask AI-based model to predict the risk of treatment failure, malignant progression, and recurrence among patients with OPMD treated by surgery.</p><p><strong>Methods: </strong>This study utilized multidimensional data from 366 retrospective patients with OPMD treated in two tertiary centers to construct an AI model to predict three treatment outcomes among patients with OPMD. Multifaceted prognostic variables were collected for the cohort and used to train four AI supervised learning models, followed by optimal model selection. AUC and Brier scores were used to assess model performance. External testing of the model was also performed, and metrics were compared to the WHO and binary dysplasia grading systems (current standards). We further assessed the net benefit and explainability of the final multitask model.</p><p><strong>Results: </strong>The outperforming model (TabPFN) had good AUC values of 0.829 (0.729-0.929), 0.912 (0.836-0.988), and 0.791 (0.683-0.899) for predicting treatment failure, malignant progression, and lesion recurrence at external testing. The Brier scores of the model for all three treatment outcome predictive tasks were also optimal (0.085-0.147). Furthermore, the AI model had a superior net benefit than the WHO and binary epithelial dysplasia grading systems in assessing the need for close monitoring among patients with OPMD treated by surgery. The explainability of the model was also successfully implemented.</p><p><strong>Conclusions: </strong>The multitask AI-based model developed with multidimensional data has good discriminatory performance, calibration, and net benefit, showing potential for comprehensive risk assessment and clinical decision support in the surgical management of patients with OPMD to promote early detection of oral cancer.</p>","PeriodicalId":14401,"journal":{"name":"International journal of surgery","volume":" ","pages":""},"PeriodicalIF":10.1000,"publicationDate":"2025-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/JS9.0000000000003592","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"SURGERY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Oral cancer may develop from precursor lesions and conditions termed oral potentially malignant disorders (OPMD), although not all patients progress to cancer in their lifetime. Managing patients with OPMD is challenging due to lesion recurrence and uncertain malignant progression risk following surgical excision. This study developed a multitask AI-based model to predict the risk of treatment failure, malignant progression, and recurrence among patients with OPMD treated by surgery.
Methods: This study utilized multidimensional data from 366 retrospective patients with OPMD treated in two tertiary centers to construct an AI model to predict three treatment outcomes among patients with OPMD. Multifaceted prognostic variables were collected for the cohort and used to train four AI supervised learning models, followed by optimal model selection. AUC and Brier scores were used to assess model performance. External testing of the model was also performed, and metrics were compared to the WHO and binary dysplasia grading systems (current standards). We further assessed the net benefit and explainability of the final multitask model.
Results: The outperforming model (TabPFN) had good AUC values of 0.829 (0.729-0.929), 0.912 (0.836-0.988), and 0.791 (0.683-0.899) for predicting treatment failure, malignant progression, and lesion recurrence at external testing. The Brier scores of the model for all three treatment outcome predictive tasks were also optimal (0.085-0.147). Furthermore, the AI model had a superior net benefit than the WHO and binary epithelial dysplasia grading systems in assessing the need for close monitoring among patients with OPMD treated by surgery. The explainability of the model was also successfully implemented.
Conclusions: The multitask AI-based model developed with multidimensional data has good discriminatory performance, calibration, and net benefit, showing potential for comprehensive risk assessment and clinical decision support in the surgical management of patients with OPMD to promote early detection of oral cancer.
期刊介绍:
The International Journal of Surgery (IJS) has a broad scope, encompassing all surgical specialties. Its primary objective is to facilitate the exchange of crucial ideas and lines of thought between and across these specialties.By doing so, the journal aims to counter the growing trend of increasing sub-specialization, which can result in "tunnel-vision" and the isolation of significant surgical advancements within specific specialties.