{"title":"BLS-GAN:消除传统射线照片中骨重叠的深层分离框架","authors":"Haolin Wang, Yafei Ou, Prasoon Ambalathankandy, Gen Ota, Pengyu Dai, Masayuki Ikebe, Kenji Suzuki, Tamotsu Kamishima","doi":"arxiv-2409.07304","DOIUrl":null,"url":null,"abstract":"Conventional radiography is the widely used imaging technology in diagnosing,\nmonitoring, and prognosticating musculoskeletal (MSK) diseases because of its\neasy availability, versatility, and cost-effectiveness. In conventional\nradiographs, bone overlaps are prevalent, and can impede the accurate\nassessment of bone characteristics by radiologists or algorithms, posing\nsignificant challenges to conventional and computer-aided diagnoses. This work\ninitiated the study of a challenging scenario - bone layer separation in\nconventional radiographs, in which separate overlapped bone regions enable the\nindependent assessment of the bone characteristics of each bone layer and lay\nthe groundwork for MSK disease diagnosis and its automation. This work proposed\na Bone Layer Separation GAN (BLS-GAN) framework that can produce high-quality\nbone layer images with reasonable bone characteristics and texture. This\nframework introduced a reconstructor based on conventional radiography imaging\nprinciples, which achieved efficient reconstruction and mitigates the recurrent\ncalculations and training instability issues caused by soft tissue in the\noverlapped regions. Additionally, pre-training with synthetic images was\nimplemented to enhance the stability of both the training process and the\nresults. The generated images passed the visual Turing test, and improved\nperformance in downstream tasks. This work affirms the feasibility of\nextracting bone layer images from conventional radiographs, which holds promise\nfor leveraging bone layer separation technology to facilitate more\ncomprehensive analytical research in MSK diagnosis, monitoring, and prognosis.\nCode and dataset will be made available.","PeriodicalId":501289,"journal":{"name":"arXiv - EE - Image and Video Processing","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"BLS-GAN: A Deep Layer Separation Framework for Eliminating Bone Overlap in Conventional Radiographs\",\"authors\":\"Haolin Wang, Yafei Ou, Prasoon Ambalathankandy, Gen Ota, Pengyu Dai, Masayuki Ikebe, Kenji Suzuki, Tamotsu Kamishima\",\"doi\":\"arxiv-2409.07304\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Conventional radiography is the widely used imaging technology in diagnosing,\\nmonitoring, and prognosticating musculoskeletal (MSK) diseases because of its\\neasy availability, versatility, and cost-effectiveness. In conventional\\nradiographs, bone overlaps are prevalent, and can impede the accurate\\nassessment of bone characteristics by radiologists or algorithms, posing\\nsignificant challenges to conventional and computer-aided diagnoses. This work\\ninitiated the study of a challenging scenario - bone layer separation in\\nconventional radiographs, in which separate overlapped bone regions enable the\\nindependent assessment of the bone characteristics of each bone layer and lay\\nthe groundwork for MSK disease diagnosis and its automation. This work proposed\\na Bone Layer Separation GAN (BLS-GAN) framework that can produce high-quality\\nbone layer images with reasonable bone characteristics and texture. This\\nframework introduced a reconstructor based on conventional radiography imaging\\nprinciples, which achieved efficient reconstruction and mitigates the recurrent\\ncalculations and training instability issues caused by soft tissue in the\\noverlapped regions. Additionally, pre-training with synthetic images was\\nimplemented to enhance the stability of both the training process and the\\nresults. The generated images passed the visual Turing test, and improved\\nperformance in downstream tasks. This work affirms the feasibility of\\nextracting bone layer images from conventional radiographs, which holds promise\\nfor leveraging bone layer separation technology to facilitate more\\ncomprehensive analytical research in MSK diagnosis, monitoring, and prognosis.\\nCode and dataset will be made available.\",\"PeriodicalId\":501289,\"journal\":{\"name\":\"arXiv - EE - Image and Video Processing\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - EE - Image and Video Processing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.07304\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - EE - Image and Video Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.07304","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
BLS-GAN: A Deep Layer Separation Framework for Eliminating Bone Overlap in Conventional Radiographs
Conventional radiography is the widely used imaging technology in diagnosing,
monitoring, and prognosticating musculoskeletal (MSK) diseases because of its
easy availability, versatility, and cost-effectiveness. In conventional
radiographs, bone overlaps are prevalent, and can impede the accurate
assessment of bone characteristics by radiologists or algorithms, posing
significant challenges to conventional and computer-aided diagnoses. This work
initiated the study of a challenging scenario - bone layer separation in
conventional radiographs, in which separate overlapped bone regions enable the
independent assessment of the bone characteristics of each bone layer and lay
the groundwork for MSK disease diagnosis and its automation. This work proposed
a Bone Layer Separation GAN (BLS-GAN) framework that can produce high-quality
bone layer images with reasonable bone characteristics and texture. This
framework introduced a reconstructor based on conventional radiography imaging
principles, which achieved efficient reconstruction and mitigates the recurrent
calculations and training instability issues caused by soft tissue in the
overlapped regions. Additionally, pre-training with synthetic images was
implemented to enhance the stability of both the training process and the
results. The generated images passed the visual Turing test, and improved
performance in downstream tasks. This work affirms the feasibility of
extracting bone layer images from conventional radiographs, which holds promise
for leveraging bone layer separation technology to facilitate more
comprehensive analytical research in MSK diagnosis, monitoring, and prognosis.
Code and dataset will be made available.