Liu Li, Hanchun Wang, Matthew Baugh, Qiang Ma, Weitong Zhang, Cheng Ouyang, Daniel Rueckert, Bernhard Kainz
{"title":"利用多项式特征合成对医学图像进行通用拓扑细化分割","authors":"Liu Li, Hanchun Wang, Matthew Baugh, Qiang Ma, Weitong Zhang, Cheng Ouyang, Daniel Rueckert, Bernhard Kainz","doi":"arxiv-2409.09796","DOIUrl":null,"url":null,"abstract":"Although existing medical image segmentation methods provide impressive\npixel-wise accuracy, they often neglect topological correctness, making their\nsegmentations unusable for many downstream tasks. One option is to retrain such\nmodels whilst including a topology-driven loss component. However, this is\ncomputationally expensive and often impractical. A better solution would be to\nhave a versatile plug-and-play topology refinement method that is compatible\nwith any domain-specific segmentation pipeline. Directly training a\npost-processing model to mitigate topological errors often fails as such models\ntend to be biased towards the topological errors of a target segmentation\nnetwork. The diversity of these errors is confined to the information provided\nby a labelled training set, which is especially problematic for small datasets.\nOur method solves this problem by training a model-agnostic topology refinement\nnetwork with synthetic segmentations that cover a wide variety of topological\nerrors. Inspired by the Stone-Weierstrass theorem, we synthesize\ntopology-perturbation masks with randomly sampled coefficients of orthogonal\npolynomial bases, which ensures a complete and unbiased representation.\nPractically, we verified the efficiency and effectiveness of our methods as\nbeing compatible with multiple families of polynomial bases, and show evidence\nthat our universal plug-and-play topology refinement network outperforms both\nexisting topology-driven learning-based and post-processing methods. We also\nshow that combining our method with learning-based models provides an\neffortless add-on, which can further improve the performance of existing\napproaches.","PeriodicalId":501289,"journal":{"name":"arXiv - EE - Image and Video Processing","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Universal Topology Refinement for Medical Image Segmentation with Polynomial Feature Synthesis\",\"authors\":\"Liu Li, Hanchun Wang, Matthew Baugh, Qiang Ma, Weitong Zhang, Cheng Ouyang, Daniel Rueckert, Bernhard Kainz\",\"doi\":\"arxiv-2409.09796\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Although existing medical image segmentation methods provide impressive\\npixel-wise accuracy, they often neglect topological correctness, making their\\nsegmentations unusable for many downstream tasks. One option is to retrain such\\nmodels whilst including a topology-driven loss component. However, this is\\ncomputationally expensive and often impractical. A better solution would be to\\nhave a versatile plug-and-play topology refinement method that is compatible\\nwith any domain-specific segmentation pipeline. Directly training a\\npost-processing model to mitigate topological errors often fails as such models\\ntend to be biased towards the topological errors of a target segmentation\\nnetwork. The diversity of these errors is confined to the information provided\\nby a labelled training set, which is especially problematic for small datasets.\\nOur method solves this problem by training a model-agnostic topology refinement\\nnetwork with synthetic segmentations that cover a wide variety of topological\\nerrors. Inspired by the Stone-Weierstrass theorem, we synthesize\\ntopology-perturbation masks with randomly sampled coefficients of orthogonal\\npolynomial bases, which ensures a complete and unbiased representation.\\nPractically, we verified the efficiency and effectiveness of our methods as\\nbeing compatible with multiple families of polynomial bases, and show evidence\\nthat our universal plug-and-play topology refinement network outperforms both\\nexisting topology-driven learning-based and post-processing methods. We also\\nshow that combining our method with learning-based models provides an\\neffortless add-on, which can further improve the performance of existing\\napproaches.\",\"PeriodicalId\":501289,\"journal\":{\"name\":\"arXiv - EE - Image and Video Processing\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - EE - Image and Video Processing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.09796\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - EE - Image and Video Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.09796","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Universal Topology Refinement for Medical Image Segmentation with Polynomial Feature Synthesis
Although existing medical image segmentation methods provide impressive
pixel-wise accuracy, they often neglect topological correctness, making their
segmentations unusable for many downstream tasks. One option is to retrain such
models whilst including a topology-driven loss component. However, this is
computationally expensive and often impractical. A better solution would be to
have a versatile plug-and-play topology refinement method that is compatible
with any domain-specific segmentation pipeline. Directly training a
post-processing model to mitigate topological errors often fails as such models
tend to be biased towards the topological errors of a target segmentation
network. The diversity of these errors is confined to the information provided
by a labelled training set, which is especially problematic for small datasets.
Our method solves this problem by training a model-agnostic topology refinement
network with synthetic segmentations that cover a wide variety of topological
errors. Inspired by the Stone-Weierstrass theorem, we synthesize
topology-perturbation masks with randomly sampled coefficients of orthogonal
polynomial bases, which ensures a complete and unbiased representation.
Practically, we verified the efficiency and effectiveness of our methods as
being compatible with multiple families of polynomial bases, and show evidence
that our universal plug-and-play topology refinement network outperforms both
existing topology-driven learning-based and post-processing methods. We also
show that combining our method with learning-based models provides an
effortless add-on, which can further improve the performance of existing
approaches.