{"title":"A sustainable neuromorphic framework for disease diagnosis using digital medical imaging","authors":"Rutwik Gulakala, Marcus Stoffel","doi":"10.1016/j.cmpbup.2024.100171","DOIUrl":null,"url":null,"abstract":"<div><h3>Background and objective:</h3><div>In the diagnosis of medical images, neural network classifications can support rapid diagnosis together with existing imaging methods. Although current state-of-the-art deep learning methods can contribute to this image recognition, the aim of the present study is to develop a general classification framework with brain-inspired neural networks. Following this intention, spiking neural network models, also known as third-generation models, are included here to capitalize on their sparse characteristics and capacity to significantly decrease energy consumption. Inspired by the recent development of neuromorphic hardware, a sustainable neural network framework is proposed, leading to an energy reduction down to a thousandth compared to the current state-of-the-art second-generation counterpart of artificial neural networks. Making use of sparse signal transmissions as in the human brain, a neuromorphic algorithm for imaging diagnostics is introduced.</div></div><div><h3>Methods:</h3><div>A novel, sustainable, brain-inspired spiking neural network is proposed to perform the multi-class classification of digital medical images. The framework comprises branched and densely connected layers described by a Leaky-Integrate and Fire (LIF) neuron model. Backpropagation of discontinuous spiking activations in the forward pass is achieved by surrogate gradients, in this case, fast sigmoid. The data for the spiking neural network is encoded into binary spikes with a latency encoding strategy. The proposed model is evaluated on a publicly available dataset of digital X-rays of chest and compared with an equivalent classical neural network. The models are trained using enhanced and pre-processed X-ray images and are evaluated based on classification metrics.</div></div><div><h3>Results:</h3><div>The proposed neuromorphic framework had an extremely high classification accuracy of 99.22<span><math><mtext>%</mtext></math></span> on an unseen test set, together with high precision and recall figures. The framework achieves this accuracy, all the while consuming 1000 times less electrical power than classical neural network architectures.</div></div><div><h3>Conclusion:</h3><div>Though there is a loss of information due to encoding, the proposed neuromorphic framework has achieved accuracy close to its second-generation counterpart. Therefore, the benefit of the proposed framework is the high accuracy of classification while consuming a thousandth of the power, enabling a sustainable and accessible add-on for the available diagnostic tools, such as medical imaging equipment, to achieve rapid diagnosis.</div></div>","PeriodicalId":72670,"journal":{"name":"Computer methods and programs in biomedicine update","volume":"7 ","pages":"Article 100171"},"PeriodicalIF":0.0000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer methods and programs in biomedicine update","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666990024000387","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
背景与目的:在医学图像诊断中,神经网络分类可以与现有的成像方法一起支持快速诊断。虽然目前最先进的深度学习方法可以为这种图像识别做出贡献,但本研究的目的是利用脑启发神经网络开发一种通用分类框架。根据这一意图,这里采用了尖峰神经网络模型(也称为第三代模型),以利用其稀疏特性和能力来显著降低能耗。受最近神经形态硬件发展的启发,我们提出了一种可持续的神经网络框架,与目前最先进的第二代人工神经网络相比,能耗降低了千分之一。方法:提出了一种新型、可持续、受大脑启发的尖峰神经网络,用于执行数字医学图像的多级分类。该框架由分支层和密集连接层组成,这些层由泄漏-整合-发射(LIF)神经元模型描述。前向传递中不连续尖峰激活的反向传播是通过替代梯度实现的,在本例中是快速西格玛梯度。尖峰神经网络的数据通过延迟编码策略编码为二进制尖峰。我们在一个公开的胸部数字 X 光片数据集上对所提出的模型进行了评估,并将其与等效的经典神经网络进行了比较。结果:所提出的神经形态框架在未见测试集上的分类准确率高达 99.22%,而且精确度和召回率也很高。结论:虽然编码会造成信息损失,但所提出的神经形态框架达到了接近第二代框架的准确度。因此,所提框架的优势在于分类准确度高,而功耗仅为传统神经网络架构的千分之一,可为现有诊断工具(如医疗成像设备)提供可持续、可访问的附加功能,实现快速诊断。
A sustainable neuromorphic framework for disease diagnosis using digital medical imaging
Background and objective:
In the diagnosis of medical images, neural network classifications can support rapid diagnosis together with existing imaging methods. Although current state-of-the-art deep learning methods can contribute to this image recognition, the aim of the present study is to develop a general classification framework with brain-inspired neural networks. Following this intention, spiking neural network models, also known as third-generation models, are included here to capitalize on their sparse characteristics and capacity to significantly decrease energy consumption. Inspired by the recent development of neuromorphic hardware, a sustainable neural network framework is proposed, leading to an energy reduction down to a thousandth compared to the current state-of-the-art second-generation counterpart of artificial neural networks. Making use of sparse signal transmissions as in the human brain, a neuromorphic algorithm for imaging diagnostics is introduced.
Methods:
A novel, sustainable, brain-inspired spiking neural network is proposed to perform the multi-class classification of digital medical images. The framework comprises branched and densely connected layers described by a Leaky-Integrate and Fire (LIF) neuron model. Backpropagation of discontinuous spiking activations in the forward pass is achieved by surrogate gradients, in this case, fast sigmoid. The data for the spiking neural network is encoded into binary spikes with a latency encoding strategy. The proposed model is evaluated on a publicly available dataset of digital X-rays of chest and compared with an equivalent classical neural network. The models are trained using enhanced and pre-processed X-ray images and are evaluated based on classification metrics.
Results:
The proposed neuromorphic framework had an extremely high classification accuracy of 99.22 on an unseen test set, together with high precision and recall figures. The framework achieves this accuracy, all the while consuming 1000 times less electrical power than classical neural network architectures.
Conclusion:
Though there is a loss of information due to encoding, the proposed neuromorphic framework has achieved accuracy close to its second-generation counterpart. Therefore, the benefit of the proposed framework is the high accuracy of classification while consuming a thousandth of the power, enabling a sustainable and accessible add-on for the available diagnostic tools, such as medical imaging equipment, to achieve rapid diagnosis.