用于高效硬件贝叶斯神经网络的铁电NAND

IF 15.7 1区 综合性期刊 Q1 MULTIDISCIPLINARY SCIENCES
Minsuk Song, Ryun-Han Koo, Jangsaeng Kim, Chang-Hyeon Han, Jiyong Yim, Jonghyun Ko, Sijung Yoo, Duk-hyun Choe, Sangwook Kim, Wonjun Shin, Daewoong Kwon
{"title":"用于高效硬件贝叶斯神经网络的铁电NAND","authors":"Minsuk Song, Ryun-Han Koo, Jangsaeng Kim, Chang-Hyeon Han, Jiyong Yim, Jonghyun Ko, Sijung Yoo, Duk-hyun Choe, Sangwook Kim, Wonjun Shin, Daewoong Kwon","doi":"10.1038/s41467-025-61980-y","DOIUrl":null,"url":null,"abstract":"<p>The rapid advancement of artificial intelligence has enabled breakthroughs in diverse fields, including autonomous systems and medical diagnostics. However, conventional deterministic neural networks struggle to capture uncertainty, limiting their reliability when handling real-world data, which are often noisy, imbalanced, or scarce. Bayesian neural networks address this limitation by representing weights as probabilistic distributions, allowing for natural uncertainty quantification and improved robustness. Despite their advantages, hardware-based implementations face significant challenges due to the difficulty of independently tuning both the mean and variance of weight distributions. Herein, we propose a 3D ferroelectric NAND-based Bayesian neural network system that leverages incremental step pulse programming technology to achieve efficient and scalable probabilistic weight control. The page-level programming capabilities and intrinsic device-to-device variations enable gaussian weight distributions in a single programming step, without structural modifications. By modulating the incremental step pulse programming voltage step, we achieve precise weight distribution control. The proposed system demonstrates successful uncertainty estimation, enhanced energy efficiency, and robustness to external noise for medical images.</p>","PeriodicalId":19066,"journal":{"name":"Nature Communications","volume":"14 1","pages":""},"PeriodicalIF":15.7000,"publicationDate":"2025-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Ferroelectric NAND for efficient hardware bayesian neural networks\",\"authors\":\"Minsuk Song, Ryun-Han Koo, Jangsaeng Kim, Chang-Hyeon Han, Jiyong Yim, Jonghyun Ko, Sijung Yoo, Duk-hyun Choe, Sangwook Kim, Wonjun Shin, Daewoong Kwon\",\"doi\":\"10.1038/s41467-025-61980-y\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>The rapid advancement of artificial intelligence has enabled breakthroughs in diverse fields, including autonomous systems and medical diagnostics. However, conventional deterministic neural networks struggle to capture uncertainty, limiting their reliability when handling real-world data, which are often noisy, imbalanced, or scarce. Bayesian neural networks address this limitation by representing weights as probabilistic distributions, allowing for natural uncertainty quantification and improved robustness. Despite their advantages, hardware-based implementations face significant challenges due to the difficulty of independently tuning both the mean and variance of weight distributions. Herein, we propose a 3D ferroelectric NAND-based Bayesian neural network system that leverages incremental step pulse programming technology to achieve efficient and scalable probabilistic weight control. The page-level programming capabilities and intrinsic device-to-device variations enable gaussian weight distributions in a single programming step, without structural modifications. By modulating the incremental step pulse programming voltage step, we achieve precise weight distribution control. The proposed system demonstrates successful uncertainty estimation, enhanced energy efficiency, and robustness to external noise for medical images.</p>\",\"PeriodicalId\":19066,\"journal\":{\"name\":\"Nature Communications\",\"volume\":\"14 1\",\"pages\":\"\"},\"PeriodicalIF\":15.7000,\"publicationDate\":\"2025-07-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Nature Communications\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://doi.org/10.1038/s41467-025-61980-y\",\"RegionNum\":1,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MULTIDISCIPLINARY SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nature Communications","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1038/s41467-025-61980-y","RegionNum":1,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0

摘要

人工智能的快速发展使自主系统和医疗诊断等多个领域取得了突破。然而,传统的确定性神经网络难以捕捉不确定性,这限制了它们在处理现实世界数据时的可靠性,这些数据通常是嘈杂的、不平衡的或稀缺的。贝叶斯神经网络通过将权重表示为概率分布来解决这一限制,允许自然的不确定性量化和改进的鲁棒性。尽管基于硬件的实现具有优势,但由于难以独立调优权重分布的均值和方差,因此面临着重大挑战。在此,我们提出了一种基于nand的三维铁电贝叶斯神经网络系统,该系统利用增量步进脉冲编程技术来实现高效和可扩展的概率权重控制。页面级编程功能和固有的设备到设备的变化使得在单个编程步骤中可以实现高斯权重分布,而无需进行结构修改。通过调制增量步进脉冲编程电压步进,实现了精确的重量分配控制。该系统成功地估计了医学图像的不确定性,提高了能量效率,并对外部噪声具有鲁棒性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Ferroelectric NAND for efficient hardware bayesian neural networks

Ferroelectric NAND for efficient hardware bayesian neural networks

The rapid advancement of artificial intelligence has enabled breakthroughs in diverse fields, including autonomous systems and medical diagnostics. However, conventional deterministic neural networks struggle to capture uncertainty, limiting their reliability when handling real-world data, which are often noisy, imbalanced, or scarce. Bayesian neural networks address this limitation by representing weights as probabilistic distributions, allowing for natural uncertainty quantification and improved robustness. Despite their advantages, hardware-based implementations face significant challenges due to the difficulty of independently tuning both the mean and variance of weight distributions. Herein, we propose a 3D ferroelectric NAND-based Bayesian neural network system that leverages incremental step pulse programming technology to achieve efficient and scalable probabilistic weight control. The page-level programming capabilities and intrinsic device-to-device variations enable gaussian weight distributions in a single programming step, without structural modifications. By modulating the incremental step pulse programming voltage step, we achieve precise weight distribution control. The proposed system demonstrates successful uncertainty estimation, enhanced energy efficiency, and robustness to external noise for medical images.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Nature Communications
Nature Communications Biological Science Disciplines-
CiteScore
24.90
自引率
2.40%
发文量
6928
审稿时长
3.7 months
期刊介绍: Nature Communications, an open-access journal, publishes high-quality research spanning all areas of the natural sciences. Papers featured in the journal showcase significant advances relevant to specialists in each respective field. With a 2-year impact factor of 16.6 (2022) and a median time of 8 days from submission to the first editorial decision, Nature Communications is committed to rapid dissemination of research findings. As a multidisciplinary journal, it welcomes contributions from biological, health, physical, chemical, Earth, social, mathematical, applied, and engineering sciences, aiming to highlight important breakthroughs within each domain.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信