Chen-Rui Fan, Bo Lu, Zhi-Hong Zhang, Run-Qing Zhang, Jing-Wei Wen, Tie-Jun Wang, Chuan Wang
{"title":"Optimizing energy-based neural network training processes with a coherent Ising machine","authors":"Chen-Rui Fan, Bo Lu, Zhi-Hong Zhang, Run-Qing Zhang, Jing-Wei Wen, Tie-Jun Wang, Chuan Wang","doi":"10.1007/s11433-026-3105-4","DOIUrl":null,"url":null,"abstract":"<div><p>While Ising machines serve as advanced physical solvers for the Ising model, thus enabling applications in combinatorial optimization problems and neural network training scenarios, their scalability for use with large-scale neural networks remains constrained by hardware connectivity limitations and suboptimal training methodologies. In this work, we leverage a coherent Ising machine (CIM) to train an energy-based neural network using equilibrium propagation, achieving performance comparable to that of existing software-based implementations. We further enhance the CIM simulation algorithm by integrating the Adam optimizer to compute the ground state of a Hopfield energy network, thereby significantly improving convergence speed and solution accuracy. Additionally, we demonstrate the scalability of our approach across deeper network architectures and convolutional operations. Our results highlight the potential for CIM dynamics to serve as a physics-inspired optical platform, distinct from classical computing, for training complex neural networks, offering a pathway toward energy-efficient implementations via analog circuits, optoelectronics, or integrated photonics. This work establishes a novel physical framework for the development of next-generation AI hardware.</p></div>","PeriodicalId":774,"journal":{"name":"Science China Physics, Mechanics & Astronomy","volume":"69 12","pages":""},"PeriodicalIF":7.2000,"publicationDate":"2026-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Science China Physics, Mechanics & Astronomy","FirstCategoryId":"101","ListUrlMain":"https://link.springer.com/article/10.1007/s11433-026-3105-4","RegionNum":1,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PHYSICS, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
While Ising machines serve as advanced physical solvers for the Ising model, thus enabling applications in combinatorial optimization problems and neural network training scenarios, their scalability for use with large-scale neural networks remains constrained by hardware connectivity limitations and suboptimal training methodologies. In this work, we leverage a coherent Ising machine (CIM) to train an energy-based neural network using equilibrium propagation, achieving performance comparable to that of existing software-based implementations. We further enhance the CIM simulation algorithm by integrating the Adam optimizer to compute the ground state of a Hopfield energy network, thereby significantly improving convergence speed and solution accuracy. Additionally, we demonstrate the scalability of our approach across deeper network architectures and convolutional operations. Our results highlight the potential for CIM dynamics to serve as a physics-inspired optical platform, distinct from classical computing, for training complex neural networks, offering a pathway toward energy-efficient implementations via analog circuits, optoelectronics, or integrated photonics. This work establishes a novel physical framework for the development of next-generation AI hardware.
期刊介绍:
Science China Physics, Mechanics & Astronomy, an academic journal cosponsored by the Chinese Academy of Sciences and the National Natural Science Foundation of China, and published by Science China Press, is committed to publishing high-quality, original results in both basic and applied research.
Science China Physics, Mechanics & Astronomy, is published in both print and electronic forms. It is indexed by Science Citation Index.
Categories of articles:
Reviews summarize representative results and achievements in a particular topic or an area, comment on the current state of research, and advise on the research directions. The author’s own opinion and related discussion is requested.
Research papers report on important original results in all areas of physics, mechanics and astronomy.
Brief reports present short reports in a timely manner of the latest important results.