Hyeokjin Kwon , Seungyeon Son , Sarah U. Morton , David Wypij , John Cleveland , Caitlin K Rollins , Hao Huang , Elizabeth Goldmuntz , Ashok Panigrahy , Nina H. Thomas , Wendy K. Chung , Evdokia Anagnostou , Ami Norris-Brilliant , Bruce D. Gelb , Patrick McQuillen , George A. Porter Jr. , Martin Tristani-Firouzi , Mark W. Russell , Amy E. Roberts , Jane W. Newburger , Kiho Im
{"title":"Graph-based prototype inverse-projection for identifying cortical sulcal pattern abnormalities in congenital heart disease","authors":"Hyeokjin Kwon , Seungyeon Son , Sarah U. Morton , David Wypij , John Cleveland , Caitlin K Rollins , Hao Huang , Elizabeth Goldmuntz , Ashok Panigrahy , Nina H. Thomas , Wendy K. Chung , Evdokia Anagnostou , Ami Norris-Brilliant , Bruce D. Gelb , Patrick McQuillen , George A. Porter Jr. , Martin Tristani-Firouzi , Mark W. Russell , Amy E. Roberts , Jane W. Newburger , Kiho Im","doi":"10.1016/j.media.2025.103538","DOIUrl":null,"url":null,"abstract":"<div><div>Examining the altered arrangement and patterning of sulcal folds offers insights into the mechanisms of neurodevelopmental differences in psychiatric and neurological disorders. Previous sulcal pattern analysis used spectral graph matching of sulcal pit-based graph structures to assess deviations from normative sulcal patterns. However, challenges exist, including the absence of a standard criterion for defining a typical reference set, time-consuming cost of graph matching, user-defined feature weight sets, and assumptions about uniform node distribution. We developed a deep learning-based sulcal pattern analysis to address these challenges by adapting prototype-based graph neural networks to sulcal pattern graphs. Additionally, we proposed a prototype inverse-projection for better interpretability. Unlike other prototype-based models, our approach inversely projects prototypes onto individual node representations to calculate the inverse-projection weights, enabling efficient visualization of prototypes and focusing the model on selective regions. We evaluated our method through a classification task between healthy controls (<em>n</em> = 174, age = 15.4 <span><math><mrow><mo>±</mo><mrow><mspace></mspace></mrow></mrow></math></span>1.9 [mean ± standard deviation, years]) and patients with congenital heart disease (<em>n</em> = 345, age = 15.8 <span><math><mrow><mo>±</mo><mrow><mspace></mspace></mrow></mrow></math></span>4.7) from four cohort studies and a public dataset. Our approach demonstrated superior classification performance compared to other state-of-the-art models, supported by extensive ablative studies. Furthermore, we visualized and examined the learned prototypes to enhance understanding. We believe our method has the potential to be a sensitive and understandable tool for sulcal pattern analysis.</div></div>","PeriodicalId":18328,"journal":{"name":"Medical image analysis","volume":"102 ","pages":"Article 103538"},"PeriodicalIF":10.7000,"publicationDate":"2025-02-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical image analysis","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1361841525000854","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Examining the altered arrangement and patterning of sulcal folds offers insights into the mechanisms of neurodevelopmental differences in psychiatric and neurological disorders. Previous sulcal pattern analysis used spectral graph matching of sulcal pit-based graph structures to assess deviations from normative sulcal patterns. However, challenges exist, including the absence of a standard criterion for defining a typical reference set, time-consuming cost of graph matching, user-defined feature weight sets, and assumptions about uniform node distribution. We developed a deep learning-based sulcal pattern analysis to address these challenges by adapting prototype-based graph neural networks to sulcal pattern graphs. Additionally, we proposed a prototype inverse-projection for better interpretability. Unlike other prototype-based models, our approach inversely projects prototypes onto individual node representations to calculate the inverse-projection weights, enabling efficient visualization of prototypes and focusing the model on selective regions. We evaluated our method through a classification task between healthy controls (n = 174, age = 15.4 1.9 [mean ± standard deviation, years]) and patients with congenital heart disease (n = 345, age = 15.8 4.7) from four cohort studies and a public dataset. Our approach demonstrated superior classification performance compared to other state-of-the-art models, supported by extensive ablative studies. Furthermore, we visualized and examined the learned prototypes to enhance understanding. We believe our method has the potential to be a sensitive and understandable tool for sulcal pattern analysis.
期刊介绍:
Medical Image Analysis serves as a platform for sharing new research findings in the realm of medical and biological image analysis, with a focus on applications of computer vision, virtual reality, and robotics to biomedical imaging challenges. The journal prioritizes the publication of high-quality, original papers contributing to the fundamental science of processing, analyzing, and utilizing medical and biological images. It welcomes approaches utilizing biomedical image datasets across all spatial scales, from molecular/cellular imaging to tissue/organ imaging.