Nan Meng, Jason P. Y. Cheung, Tao Huang, Moxin Zhao, Yue Zhang, Chenxi Yu, Chang Shi, Teng Zhang
{"title":"EUFormer:利用正交光学图像进行学习驱动的三维脊柱畸形评估","authors":"Nan Meng, Jason P. Y. Cheung, Tao Huang, Moxin Zhao, Yue Zhang, Chenxi Yu, Chang Shi, Teng Zhang","doi":"arxiv-2407.16942","DOIUrl":null,"url":null,"abstract":"In clinical settings, the screening, diagnosis, and monitoring of adolescent\nidiopathic scoliosis (AIS) typically involve physical or radiographic\nexaminations. However, physical examinations are subjective, while radiographic\nexaminations expose patients to harmful radiation. Consequently, we propose a\npipeline that can accurately determine scoliosis severity. This pipeline\nutilizes posteroanterior (PA) and lateral (LAT) RGB images as input to generate\nspine curve maps, which are then used to reconstruct the three-dimensional (3D)\nspine curve for AIS severity grading. To generate the 2D spine curves\naccurately and efficiently, we further propose an Efficient U-shape transFormer\n(EUFormer) as the generator. It can efficiently utilize the learned feature\nacross channels, therefore producing consecutive spine curves from both PA and\nLAT views. Experimental results demonstrate superior performance of EUFormer on\nspine curve generation against other classical U-shape models. This finding\ndemonstrates that the proposed method for grading the severity of AIS, based on\na 3D spine curve, is more accurate when compared to using a 2D spine curve.","PeriodicalId":501174,"journal":{"name":"arXiv - CS - Graphics","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"EUFormer: Learning Driven 3D Spine Deformity Assessment with Orthogonal Optical Images\",\"authors\":\"Nan Meng, Jason P. Y. Cheung, Tao Huang, Moxin Zhao, Yue Zhang, Chenxi Yu, Chang Shi, Teng Zhang\",\"doi\":\"arxiv-2407.16942\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In clinical settings, the screening, diagnosis, and monitoring of adolescent\\nidiopathic scoliosis (AIS) typically involve physical or radiographic\\nexaminations. However, physical examinations are subjective, while radiographic\\nexaminations expose patients to harmful radiation. Consequently, we propose a\\npipeline that can accurately determine scoliosis severity. This pipeline\\nutilizes posteroanterior (PA) and lateral (LAT) RGB images as input to generate\\nspine curve maps, which are then used to reconstruct the three-dimensional (3D)\\nspine curve for AIS severity grading. To generate the 2D spine curves\\naccurately and efficiently, we further propose an Efficient U-shape transFormer\\n(EUFormer) as the generator. It can efficiently utilize the learned feature\\nacross channels, therefore producing consecutive spine curves from both PA and\\nLAT views. Experimental results demonstrate superior performance of EUFormer on\\nspine curve generation against other classical U-shape models. This finding\\ndemonstrates that the proposed method for grading the severity of AIS, based on\\na 3D spine curve, is more accurate when compared to using a 2D spine curve.\",\"PeriodicalId\":501174,\"journal\":{\"name\":\"arXiv - CS - Graphics\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Graphics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2407.16942\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Graphics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2407.16942","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
在临床环境中,青少年脊柱侧弯症(AIS)的筛查、诊断和监测通常涉及物理或放射检查。然而,体格检查是主观的,而射线检查则会使患者受到有害辐射的影响。因此,我们提出了一种能准确判断脊柱侧弯严重程度的管道。该管道利用后前方(PA)和侧方(LAT)RGB 图像作为输入,生成脊柱曲线图,然后用于重建三维(3D)脊柱曲线,以进行 AIS 严重程度分级。为了准确高效地生成二维脊柱曲线,我们进一步提出了一种高效 U 形变换器(EUFormer)作为生成器。它能有效利用跨通道学习特征,因此能从 PA 和 LAT 视图生成连续的脊柱曲线。实验结果表明,EUFormer 在脊柱曲线生成方面的性能优于其他经典 U 形模型。这一发现证明,与使用二维脊柱曲线相比,基于三维脊柱曲线的 AIS 严重程度分级方法更为准确。
EUFormer: Learning Driven 3D Spine Deformity Assessment with Orthogonal Optical Images
In clinical settings, the screening, diagnosis, and monitoring of adolescent
idiopathic scoliosis (AIS) typically involve physical or radiographic
examinations. However, physical examinations are subjective, while radiographic
examinations expose patients to harmful radiation. Consequently, we propose a
pipeline that can accurately determine scoliosis severity. This pipeline
utilizes posteroanterior (PA) and lateral (LAT) RGB images as input to generate
spine curve maps, which are then used to reconstruct the three-dimensional (3D)
spine curve for AIS severity grading. To generate the 2D spine curves
accurately and efficiently, we further propose an Efficient U-shape transFormer
(EUFormer) as the generator. It can efficiently utilize the learned feature
across channels, therefore producing consecutive spine curves from both PA and
LAT views. Experimental results demonstrate superior performance of EUFormer on
spine curve generation against other classical U-shape models. This finding
demonstrates that the proposed method for grading the severity of AIS, based on
a 3D spine curve, is more accurate when compared to using a 2D spine curve.