Accurate non-invasive detection of MASH with fibrosis F2-F3 using a lightweight machine learning model with minimal clinical and metabolomic variables.
Konstantinos Stefanakis, Geltrude Mingrone, Jacob George, Christos S Mantzoros
{"title":"Accurate non-invasive detection of MASH with fibrosis F2-F3 using a lightweight machine learning model with minimal clinical and metabolomic variables.","authors":"Konstantinos Stefanakis, Geltrude Mingrone, Jacob George, Christos S Mantzoros","doi":"10.1016/j.metabol.2024.156082","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>There are no known non-invasive tests (NITs) designed for accurately detecting metabolic dysfunction-associated steatohepatitis (MASH) with liver fibrosis stages F2-F3, excluding cirrhosis-the FDA-defined range for prescribing Resmetirom and other drugs in clinical trials. We aimed to validate and re-optimize known NITs, and most importantly to develop new machine learning (ML)-based NITs to accurately detect MASH F2-F3.</p><p><strong>Methods: </strong>Clinical and metabolomic data were collected from 443 patients across three countries and two clinic types (metabolic surgery, gastroenterology/hepatology) covering the entire spectrum of biopsy-proven MASLD, including cirrhosis and healthy controls. Three novel types of ML models were developed using a categorical gradient boosting machine pipeline. These were compared with 24 biomarker, imaging, and algorithm-based NITs with both known cutoffs for MASH F2-F4 and re-optimized cutoffs for MASH F2-F3.</p><p><strong>Results: </strong>NFS at a - 1.455 cutoff attained an AUC of 0.59, the highest sensitivity (90.9 %, 95 % CI 84.3-95.4), and NPV of 87.2 %. FIB4 risk stratification followed by elastography (8 kPa) had the best specificity (86.9 %) and PPV (63.3 %), with an AUC of 0.57. NFS followed by elastography improved the PPV to 65.3 % and AUC to 0.62. Re-optimized FibroScan-AST (FAST) at a 0.22 cutoff had the highest PPV (69.1 %). ML models using aminotransferases, metabolic syndrome components, BMI, and 3-ureidopropionate achieved an AUC of 0.89, which further increased to 0.91 following hyperparameter optimization and the addition of alpha-ketoglutarate. These new ML models outperformed all other NITs and displayed accuracy, sensitivity, specificity, PPV, and NPV up to 91.2 %, 85.3 %, 97.0 %, 92.4 %, and 90.7 % respectively. The models were reproduced and validated in a secondary sensitivity analysis, that used one of the cohorts as feature selection/training, and the rest as independent validation, likewise outperforming all other NITs.</p><p><strong>Conclusions: </strong>We report for the first time the diagnostic characteristics of non-invasive, metabolomics-based biomarker models to detect MASH with fibrosis F2-F3 required for Resmetirom treatment and inclusion in ongoing phase-III trials. These models may be used alone or in combination with other NITs to accurately determine treatment eligibility.</p>","PeriodicalId":18694,"journal":{"name":"Metabolism: clinical and experimental","volume":" ","pages":"156082"},"PeriodicalIF":10.8000,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Metabolism: clinical and experimental","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.metabol.2024.156082","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENDOCRINOLOGY & METABOLISM","Score":null,"Total":0}
引用次数: 0
Abstract
Background: There are no known non-invasive tests (NITs) designed for accurately detecting metabolic dysfunction-associated steatohepatitis (MASH) with liver fibrosis stages F2-F3, excluding cirrhosis-the FDA-defined range for prescribing Resmetirom and other drugs in clinical trials. We aimed to validate and re-optimize known NITs, and most importantly to develop new machine learning (ML)-based NITs to accurately detect MASH F2-F3.
Methods: Clinical and metabolomic data were collected from 443 patients across three countries and two clinic types (metabolic surgery, gastroenterology/hepatology) covering the entire spectrum of biopsy-proven MASLD, including cirrhosis and healthy controls. Three novel types of ML models were developed using a categorical gradient boosting machine pipeline. These were compared with 24 biomarker, imaging, and algorithm-based NITs with both known cutoffs for MASH F2-F4 and re-optimized cutoffs for MASH F2-F3.
Results: NFS at a - 1.455 cutoff attained an AUC of 0.59, the highest sensitivity (90.9 %, 95 % CI 84.3-95.4), and NPV of 87.2 %. FIB4 risk stratification followed by elastography (8 kPa) had the best specificity (86.9 %) and PPV (63.3 %), with an AUC of 0.57. NFS followed by elastography improved the PPV to 65.3 % and AUC to 0.62. Re-optimized FibroScan-AST (FAST) at a 0.22 cutoff had the highest PPV (69.1 %). ML models using aminotransferases, metabolic syndrome components, BMI, and 3-ureidopropionate achieved an AUC of 0.89, which further increased to 0.91 following hyperparameter optimization and the addition of alpha-ketoglutarate. These new ML models outperformed all other NITs and displayed accuracy, sensitivity, specificity, PPV, and NPV up to 91.2 %, 85.3 %, 97.0 %, 92.4 %, and 90.7 % respectively. The models were reproduced and validated in a secondary sensitivity analysis, that used one of the cohorts as feature selection/training, and the rest as independent validation, likewise outperforming all other NITs.
Conclusions: We report for the first time the diagnostic characteristics of non-invasive, metabolomics-based biomarker models to detect MASH with fibrosis F2-F3 required for Resmetirom treatment and inclusion in ongoing phase-III trials. These models may be used alone or in combination with other NITs to accurately determine treatment eligibility.
期刊介绍:
Metabolism upholds research excellence by disseminating high-quality original research, reviews, editorials, and commentaries covering all facets of human metabolism.
Consideration for publication in Metabolism extends to studies in humans, animal, and cellular models, with a particular emphasis on work demonstrating strong translational potential.
The journal addresses a range of topics, including:
- Energy Expenditure and Obesity
- Metabolic Syndrome, Prediabetes, and Diabetes
- Nutrition, Exercise, and the Environment
- Genetics and Genomics, Proteomics, and Metabolomics
- Carbohydrate, Lipid, and Protein Metabolism
- Endocrinology and Hypertension
- Mineral and Bone Metabolism
- Cardiovascular Diseases and Malignancies
- Inflammation in metabolism and immunometabolism