{"title":"基于类激活图的白细胞图像弱监督语义分割。","authors":"Rui Feng,Wei Chen,Jie Qi","doi":"10.1364/boe.525294","DOIUrl":null,"url":null,"abstract":"Leukocytes are an essential component of the human defense system, accurate segmentation of leukocyte images is a crucial step towards automating detection. Most existing methods for leukocyte images segmentation relied on fully supervised semantic segmentation (FSSS) with extensive pixel-level annotations, which are time-consuming and labor-intensive. To address this issue, this paper proposes a weakly supervised semantic segmentation (WSSS) approach for leukocyte images utilizing improved class activation maps (CAMs). Firstly, to alleviate ambiguous boundary problem between leukocytes and background, preprocessing technique is employed to enhance the image quality. Secondly, attention mechanism is added to refine the CAMs generated by improving the matching of local and global features. Random walks, dense conditional random fields and hole filling were leveraged to obtain final pseudo-segmentation labels. Finally, a fully supervised segmentation network is trained with pseudo-segmentation labels. The method is evaluated on BCCD and TMAMD datasets. Experimental results demonstrate that by employing the pseudo segmentation annotations generated through this method can be utilized to train UNet as close as possible to FSSS. This method effectively reduces manual annotation cost while achieving WSSS of leukocyte images.","PeriodicalId":8969,"journal":{"name":"Biomedical optics express","volume":"53 1","pages":"5067-5080"},"PeriodicalIF":2.9000,"publicationDate":"2024-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Weakly supervised semantic segmentation of leukocyte images based on class activation maps.\",\"authors\":\"Rui Feng,Wei Chen,Jie Qi\",\"doi\":\"10.1364/boe.525294\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Leukocytes are an essential component of the human defense system, accurate segmentation of leukocyte images is a crucial step towards automating detection. Most existing methods for leukocyte images segmentation relied on fully supervised semantic segmentation (FSSS) with extensive pixel-level annotations, which are time-consuming and labor-intensive. To address this issue, this paper proposes a weakly supervised semantic segmentation (WSSS) approach for leukocyte images utilizing improved class activation maps (CAMs). Firstly, to alleviate ambiguous boundary problem between leukocytes and background, preprocessing technique is employed to enhance the image quality. Secondly, attention mechanism is added to refine the CAMs generated by improving the matching of local and global features. Random walks, dense conditional random fields and hole filling were leveraged to obtain final pseudo-segmentation labels. Finally, a fully supervised segmentation network is trained with pseudo-segmentation labels. The method is evaluated on BCCD and TMAMD datasets. Experimental results demonstrate that by employing the pseudo segmentation annotations generated through this method can be utilized to train UNet as close as possible to FSSS. This method effectively reduces manual annotation cost while achieving WSSS of leukocyte images.\",\"PeriodicalId\":8969,\"journal\":{\"name\":\"Biomedical optics express\",\"volume\":\"53 1\",\"pages\":\"5067-5080\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2024-08-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Biomedical optics express\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1364/boe.525294\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"BIOCHEMICAL RESEARCH METHODS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomedical optics express","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1364/boe.525294","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"BIOCHEMICAL RESEARCH METHODS","Score":null,"Total":0}
Weakly supervised semantic segmentation of leukocyte images based on class activation maps.
Leukocytes are an essential component of the human defense system, accurate segmentation of leukocyte images is a crucial step towards automating detection. Most existing methods for leukocyte images segmentation relied on fully supervised semantic segmentation (FSSS) with extensive pixel-level annotations, which are time-consuming and labor-intensive. To address this issue, this paper proposes a weakly supervised semantic segmentation (WSSS) approach for leukocyte images utilizing improved class activation maps (CAMs). Firstly, to alleviate ambiguous boundary problem between leukocytes and background, preprocessing technique is employed to enhance the image quality. Secondly, attention mechanism is added to refine the CAMs generated by improving the matching of local and global features. Random walks, dense conditional random fields and hole filling were leveraged to obtain final pseudo-segmentation labels. Finally, a fully supervised segmentation network is trained with pseudo-segmentation labels. The method is evaluated on BCCD and TMAMD datasets. Experimental results demonstrate that by employing the pseudo segmentation annotations generated through this method can be utilized to train UNet as close as possible to FSSS. This method effectively reduces manual annotation cost while achieving WSSS of leukocyte images.
期刊介绍:
The journal''s scope encompasses fundamental research, technology development, biomedical studies and clinical applications. BOEx focuses on the leading edge topics in the field, including:
Tissue optics and spectroscopy
Novel microscopies
Optical coherence tomography
Diffuse and fluorescence tomography
Photoacoustic and multimodal imaging
Molecular imaging and therapies
Nanophotonic biosensing
Optical biophysics/photobiology
Microfluidic optical devices
Vision research.