Mohammad Alshurbaji , Maregu Assefa , Ahmad Obeid , Mohamed L. Seghier , Taimur Hassan , Kamal Taha , Naoufel Werghi
{"title":"TriGAN-SiaMT: A triple-segmentor adversarial network with bounding box priors for semi-supervised brain lesion segmentation","authors":"Mohammad Alshurbaji , Maregu Assefa , Ahmad Obeid , Mohamed L. Seghier , Taimur Hassan , Kamal Taha , Naoufel Werghi","doi":"10.1016/j.patrec.2025.11.032","DOIUrl":null,"url":null,"abstract":"<div><div>Accurate brain lesion segmentation in MRI is critical for clinical decision-making, but pixel-wise annotations remain costly and time-consuming. We propose TriGAN-SiaMT, a novel semi-supervised segmentation framework that combines adversarial learning, consistency regularization, and bounding box priors. Our architecture comprises three segmentors (<em>S</em><sub>0</sub>, <em>S</em><sub>1</sub>, <em>S</em><sub>2</sub>) and two discriminators (<em>D</em><sub>0</sub>, <em>D</em><sub>1</sub>). It includes: (1) a supervised branch (<em>S</em><sub>0</sub>↔<em>D</em><sub>0</sub>) trained on a small labeled subset; (2) a Siamese branch (<em>S</em><sub>1</sub>↔<em>D</em><sub>1</sub>) with an identical architecture to <em>S</em><sub>0</sub>↔<em>D</em><sub>0</sub>, but trained on unlabeled data; and (3) a teacher branch (<em>S</em><sub>2</sub>) updated via exponential moving average (EMA) from <em>S</em><sub>1</sub>, following the Mean Teacher (MT) paradigm. The teacher <em>S</em><sub>2</sub> generates pseudo-labels to supervise <em>S</em><sub>1</sub>. It also provides soft segmentations to guide <em>D</em><sub>1</sub>, which does not see any labeled data. The model enforces consistency at multiple levels: between <em>S</em><sub>0</sub> and <em>S</em><sub>1</sub> (Siamese consistency), and between <em>S</em><sub>1</sub> and <em>S</em><sub>2</sub> (EMA consistency). Bounding box priors are incorporated as weak supervision for both labeled and unlabeled images, improving lesion localization. Evaluated on the ISLES 2022 and BraTS 2019 datasets, TriGAN-SiaMT achieves DSC scores of 84.80 % and 86.32 %, respectively, using only 5 % labeled data. These results demonstrate strong performance under limited supervision and robust generalization across brain lesions.</div></div>","PeriodicalId":54638,"journal":{"name":"Pattern Recognition Letters","volume":"200 ","pages":"Pages 37-43"},"PeriodicalIF":3.5000,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pattern Recognition Letters","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0167865525003861","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/11/29 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Accurate brain lesion segmentation in MRI is critical for clinical decision-making, but pixel-wise annotations remain costly and time-consuming. We propose TriGAN-SiaMT, a novel semi-supervised segmentation framework that combines adversarial learning, consistency regularization, and bounding box priors. Our architecture comprises three segmentors (S0, S1, S2) and two discriminators (D0, D1). It includes: (1) a supervised branch (S0↔D0) trained on a small labeled subset; (2) a Siamese branch (S1↔D1) with an identical architecture to S0↔D0, but trained on unlabeled data; and (3) a teacher branch (S2) updated via exponential moving average (EMA) from S1, following the Mean Teacher (MT) paradigm. The teacher S2 generates pseudo-labels to supervise S1. It also provides soft segmentations to guide D1, which does not see any labeled data. The model enforces consistency at multiple levels: between S0 and S1 (Siamese consistency), and between S1 and S2 (EMA consistency). Bounding box priors are incorporated as weak supervision for both labeled and unlabeled images, improving lesion localization. Evaluated on the ISLES 2022 and BraTS 2019 datasets, TriGAN-SiaMT achieves DSC scores of 84.80 % and 86.32 %, respectively, using only 5 % labeled data. These results demonstrate strong performance under limited supervision and robust generalization across brain lesions.
期刊介绍:
Pattern Recognition Letters aims at rapid publication of concise articles of a broad interest in pattern recognition.
Subject areas include all the current fields of interest represented by the Technical Committees of the International Association of Pattern Recognition, and other developing themes involving learning and recognition.