受激拉曼散射图像预处理对深度神经网络检测肿瘤组织性能的影响。

IF 2.3 2区 医学 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING
Andreas Weber, Kathrin Enderle-Ammour, Karl-Moritz Schröder, Marc C Metzger, Leonard Simon Brandenburg, Jürgen Beck, Jakob Straehle, David Steybe, Mohamed Hassan, Severin Schmid, Birte Ohm, Martin Werner, Bernward Passlick, Rainer Schmelzeisen, Uyen-Thao Le, Peter Bronsert
{"title":"受激拉曼散射图像预处理对深度神经网络检测肿瘤组织性能的影响。","authors":"Andreas Weber, Kathrin Enderle-Ammour, Karl-Moritz Schröder, Marc C Metzger, Leonard Simon Brandenburg, Jürgen Beck, Jakob Straehle, David Steybe, Mohamed Hassan, Severin Schmid, Birte Ohm, Martin Werner, Bernward Passlick, Rainer Schmelzeisen, Uyen-Thao Le, Peter Bronsert","doi":"10.21037/qims-2024-2608","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Images obtained from stimulated Raman scattering can be used to identify histomorphologically relevant information intraoperatively. In order to leverage deep learning algorithms for distinguishing tumoral and non-tumoral tissue, data preprocessing remains a crucial task and may affect the classification performance. To date, the effect of different preprocessing techniques on deep learning algorithm performance is unclear. This study aims to make a contribution to closing this knowledge gap.</p><p><strong>Methods: </strong>To investigate the influence of different preprocessing techniques of images obtained from stimulated Raman scattering, six deep learning architectures (VGG19, ResNet50, InceptionResNetV2, Xception, ConvNeXt and Vision Transformer) and five different preprocessing procedures were compared. For this, annotated datasets comprising 542 images of tissue samples obtained from patients with oral squamous cell carcinoma and non-small cell lung carcinoma were used for network training. Each network was trained five times for 40 epochs. Performance metrics balanced accuracy, precision, recall and F1-score were recorded. Class activation and attention maps were used to highlight on which input pixels a prediction is based.</p><p><strong>Results: </strong>A scaling of the original pixel values of stimulated Raman scattering images to the range [0, 1] yielded a higher and more stable overall classification performance across the neural networks when compared to more sophisticated and computationally expensive methods [ <math> <mrow> <mover><mrow><mi>F</mi> <mn>1</mn></mrow> <mo>¯</mo></mover> </mrow> </math> =0.8327; standard deviation (SD) =0.0622 on scaled dataset and <math> <mrow> <mover><mrow><mi>F</mi> <mn>1</mn></mrow> <mo>¯</mo></mover> </mrow> </math> =0.7213 (SD =0.2315) on complex preprocessed dataset; P≤0.05]. Absolute performance was best on stimulated Raman histology images ( <math> <mrow> <mover><mrow><mi>F</mi> <mn>1</mn></mrow> <mo>¯</mo></mover> </mrow> </math> =0.8478; SD =0.1487).</p><p><strong>Conclusions: </strong>This study shows that preprocessing of pixel values of stimulated Raman scattering images can have a great impact on the performance and the stability of deep learning algorithms when applied for classification of cancer tissue.</p>","PeriodicalId":54267,"journal":{"name":"Quantitative Imaging in Medicine and Surgery","volume":"15 9","pages":"7711-7726"},"PeriodicalIF":2.3000,"publicationDate":"2025-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12397652/pdf/","citationCount":"0","resultStr":"{\"title\":\"Influence of preprocessing of stimulated Raman scattering images on the performance of deep neural networks for detecting cancer tissue.\",\"authors\":\"Andreas Weber, Kathrin Enderle-Ammour, Karl-Moritz Schröder, Marc C Metzger, Leonard Simon Brandenburg, Jürgen Beck, Jakob Straehle, David Steybe, Mohamed Hassan, Severin Schmid, Birte Ohm, Martin Werner, Bernward Passlick, Rainer Schmelzeisen, Uyen-Thao Le, Peter Bronsert\",\"doi\":\"10.21037/qims-2024-2608\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Images obtained from stimulated Raman scattering can be used to identify histomorphologically relevant information intraoperatively. In order to leverage deep learning algorithms for distinguishing tumoral and non-tumoral tissue, data preprocessing remains a crucial task and may affect the classification performance. To date, the effect of different preprocessing techniques on deep learning algorithm performance is unclear. This study aims to make a contribution to closing this knowledge gap.</p><p><strong>Methods: </strong>To investigate the influence of different preprocessing techniques of images obtained from stimulated Raman scattering, six deep learning architectures (VGG19, ResNet50, InceptionResNetV2, Xception, ConvNeXt and Vision Transformer) and five different preprocessing procedures were compared. For this, annotated datasets comprising 542 images of tissue samples obtained from patients with oral squamous cell carcinoma and non-small cell lung carcinoma were used for network training. Each network was trained five times for 40 epochs. Performance metrics balanced accuracy, precision, recall and F1-score were recorded. Class activation and attention maps were used to highlight on which input pixels a prediction is based.</p><p><strong>Results: </strong>A scaling of the original pixel values of stimulated Raman scattering images to the range [0, 1] yielded a higher and more stable overall classification performance across the neural networks when compared to more sophisticated and computationally expensive methods [ <math> <mrow> <mover><mrow><mi>F</mi> <mn>1</mn></mrow> <mo>¯</mo></mover> </mrow> </math> =0.8327; standard deviation (SD) =0.0622 on scaled dataset and <math> <mrow> <mover><mrow><mi>F</mi> <mn>1</mn></mrow> <mo>¯</mo></mover> </mrow> </math> =0.7213 (SD =0.2315) on complex preprocessed dataset; P≤0.05]. Absolute performance was best on stimulated Raman histology images ( <math> <mrow> <mover><mrow><mi>F</mi> <mn>1</mn></mrow> <mo>¯</mo></mover> </mrow> </math> =0.8478; SD =0.1487).</p><p><strong>Conclusions: </strong>This study shows that preprocessing of pixel values of stimulated Raman scattering images can have a great impact on the performance and the stability of deep learning algorithms when applied for classification of cancer tissue.</p>\",\"PeriodicalId\":54267,\"journal\":{\"name\":\"Quantitative Imaging in Medicine and Surgery\",\"volume\":\"15 9\",\"pages\":\"7711-7726\"},\"PeriodicalIF\":2.3000,\"publicationDate\":\"2025-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12397652/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Quantitative Imaging in Medicine and Surgery\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.21037/qims-2024-2608\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/8/12 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Quantitative Imaging in Medicine and Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.21037/qims-2024-2608","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/8/12 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0

摘要

背景:从受激拉曼散射获得的图像可用于术中识别组织形态学相关信息。为了利用深度学习算法来区分肿瘤和非肿瘤组织,数据预处理仍然是一项关键任务,可能会影响分类性能。迄今为止,不同的预处理技术对深度学习算法性能的影响尚不清楚。本研究旨在为缩小这一知识差距做出贡献。方法:采用VGG19、ResNet50、InceptionResNetV2、Xception、ConvNeXt和Vision Transformer等6种深度学习架构和5种不同的预处理方法,研究不同预处理技术对受激拉曼散射图像的影响。为此,由542张来自口腔鳞状细胞癌和非小细胞肺癌患者的组织样本图像组成的带注释的数据集被用于网络训练。每个网络训练5次,共40次。记录了准确性、精密度、召回率和f1得分等性能指标。类激活和注意图被用来突出显示预测所基于的输入像素。结果:将受激拉曼散射图像的原始像素值缩放到[0,1]范围,与更复杂且计算成本更高的方法相比,神经网络的整体分类性能更高,更稳定[F 1¯=0.8327;尺度数据的标准差(SD) =0.0622,复杂预处理数据的标准差F¯=0.7213 (SD =0.2315);P≤0.05)。刺激拉曼组织学图像的绝对性能最好(f1¯=0.8478;SD =0.1487)。结论:本研究表明,受激拉曼散射图像的像素值预处理对深度学习算法用于肿瘤组织分类的性能和稳定性有很大影响。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Influence of preprocessing of stimulated Raman scattering images on the performance of deep neural networks for detecting cancer tissue.

Background: Images obtained from stimulated Raman scattering can be used to identify histomorphologically relevant information intraoperatively. In order to leverage deep learning algorithms for distinguishing tumoral and non-tumoral tissue, data preprocessing remains a crucial task and may affect the classification performance. To date, the effect of different preprocessing techniques on deep learning algorithm performance is unclear. This study aims to make a contribution to closing this knowledge gap.

Methods: To investigate the influence of different preprocessing techniques of images obtained from stimulated Raman scattering, six deep learning architectures (VGG19, ResNet50, InceptionResNetV2, Xception, ConvNeXt and Vision Transformer) and five different preprocessing procedures were compared. For this, annotated datasets comprising 542 images of tissue samples obtained from patients with oral squamous cell carcinoma and non-small cell lung carcinoma were used for network training. Each network was trained five times for 40 epochs. Performance metrics balanced accuracy, precision, recall and F1-score were recorded. Class activation and attention maps were used to highlight on which input pixels a prediction is based.

Results: A scaling of the original pixel values of stimulated Raman scattering images to the range [0, 1] yielded a higher and more stable overall classification performance across the neural networks when compared to more sophisticated and computationally expensive methods [ F 1 ¯ =0.8327; standard deviation (SD) =0.0622 on scaled dataset and F 1 ¯ =0.7213 (SD =0.2315) on complex preprocessed dataset; P≤0.05]. Absolute performance was best on stimulated Raman histology images ( F 1 ¯ =0.8478; SD =0.1487).

Conclusions: This study shows that preprocessing of pixel values of stimulated Raman scattering images can have a great impact on the performance and the stability of deep learning algorithms when applied for classification of cancer tissue.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Quantitative Imaging in Medicine and Surgery
Quantitative Imaging in Medicine and Surgery Medicine-Radiology, Nuclear Medicine and Imaging
CiteScore
4.20
自引率
17.90%
发文量
252
期刊介绍: Information not localized
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信