Optimizing energy-based neural network training processes with a coherent Ising machine

IF 7.2 1区 物理与天体物理 Q1 PHYSICS, MULTIDISCIPLINARY
Chen-Rui Fan, Bo Lu, Zhi-Hong Zhang, Run-Qing Zhang, Jing-Wei Wen, Tie-Jun Wang, Chuan Wang
{"title":"Optimizing energy-based neural network training processes with a coherent Ising machine","authors":"Chen-Rui Fan,&nbsp;Bo Lu,&nbsp;Zhi-Hong Zhang,&nbsp;Run-Qing Zhang,&nbsp;Jing-Wei Wen,&nbsp;Tie-Jun Wang,&nbsp;Chuan Wang","doi":"10.1007/s11433-026-3105-4","DOIUrl":null,"url":null,"abstract":"<div><p>While Ising machines serve as advanced physical solvers for the Ising model, thus enabling applications in combinatorial optimization problems and neural network training scenarios, their scalability for use with large-scale neural networks remains constrained by hardware connectivity limitations and suboptimal training methodologies. In this work, we leverage a coherent Ising machine (CIM) to train an energy-based neural network using equilibrium propagation, achieving performance comparable to that of existing software-based implementations. We further enhance the CIM simulation algorithm by integrating the Adam optimizer to compute the ground state of a Hopfield energy network, thereby significantly improving convergence speed and solution accuracy. Additionally, we demonstrate the scalability of our approach across deeper network architectures and convolutional operations. Our results highlight the potential for CIM dynamics to serve as a physics-inspired optical platform, distinct from classical computing, for training complex neural networks, offering a pathway toward energy-efficient implementations via analog circuits, optoelectronics, or integrated photonics. This work establishes a novel physical framework for the development of next-generation AI hardware.</p></div>","PeriodicalId":774,"journal":{"name":"Science China Physics, Mechanics & Astronomy","volume":"69 12","pages":""},"PeriodicalIF":7.2000,"publicationDate":"2026-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Science China Physics, Mechanics & Astronomy","FirstCategoryId":"101","ListUrlMain":"https://link.springer.com/article/10.1007/s11433-026-3105-4","RegionNum":1,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PHYSICS, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

While Ising machines serve as advanced physical solvers for the Ising model, thus enabling applications in combinatorial optimization problems and neural network training scenarios, their scalability for use with large-scale neural networks remains constrained by hardware connectivity limitations and suboptimal training methodologies. In this work, we leverage a coherent Ising machine (CIM) to train an energy-based neural network using equilibrium propagation, achieving performance comparable to that of existing software-based implementations. We further enhance the CIM simulation algorithm by integrating the Adam optimizer to compute the ground state of a Hopfield energy network, thereby significantly improving convergence speed and solution accuracy. Additionally, we demonstrate the scalability of our approach across deeper network architectures and convolutional operations. Our results highlight the potential for CIM dynamics to serve as a physics-inspired optical platform, distinct from classical computing, for training complex neural networks, offering a pathway toward energy-efficient implementations via analog circuits, optoelectronics, or integrated photonics. This work establishes a novel physical framework for the development of next-generation AI hardware.

用相干伊辛机优化基于能量的神经网络训练过程
虽然伊辛机器可以作为伊辛模型的高级物理解算器,从而实现在组合优化问题和神经网络训练场景中的应用,但它们用于大规模神经网络的可扩展性仍然受到硬件连接限制和次优训练方法的限制。在这项工作中,我们利用一个相干伊辛机(CIM)来训练一个基于能量的神经网络,使用平衡传播,实现与现有的基于软件的实现相当的性能。我们进一步增强了CIM仿真算法,通过集成Adam优化器来计算Hopfield能源网络的基态,从而显著提高了收敛速度和求解精度。此外,我们还展示了我们的方法在更深层次的网络架构和卷积操作中的可扩展性。我们的研究结果强调了CIM动力学作为一个物理启发的光学平台的潜力,与经典计算不同,用于训练复杂的神经网络,通过模拟电路、光电子学或集成光子学为节能实现提供了一条途径。这项工作为下一代人工智能硬件的开发建立了一个新的物理框架。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Science China Physics, Mechanics & Astronomy
Science China Physics, Mechanics & Astronomy PHYSICS, MULTIDISCIPLINARY-
CiteScore
10.30
自引率
6.20%
发文量
4047
审稿时长
3 months
期刊介绍: Science China Physics, Mechanics & Astronomy, an academic journal cosponsored by the Chinese Academy of Sciences and the National Natural Science Foundation of China, and published by Science China Press, is committed to publishing high-quality, original results in both basic and applied research. Science China Physics, Mechanics & Astronomy, is published in both print and electronic forms. It is indexed by Science Citation Index. Categories of articles: Reviews summarize representative results and achievements in a particular topic or an area, comment on the current state of research, and advise on the research directions. The author’s own opinion and related discussion is requested. Research papers report on important original results in all areas of physics, mechanics and astronomy. Brief reports present short reports in a timely manner of the latest important results.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书