基于智能学习的片上光网络路由算法

IF 4 2区 计算机科学 Q1 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE
Zhouping Huang;Fang Xu;Yiyuan Xie;Ye Su;Zhuang Chen;Xiao Jiang
{"title":"基于智能学习的片上光网络路由算法","authors":"Zhouping Huang;Fang Xu;Yiyuan Xie;Ye Su;Zhuang Chen;Xiao Jiang","doi":"10.1364/JOCN.543042","DOIUrl":null,"url":null,"abstract":"Optical network-on-chips (ONoCs) play a vital role in interconnecting chip cores. Currently, transmission loss is the major limiting factor that affects the size of interconnect networks. As such, reducing the transmission loss is very important for optimizing the operating efficiency and size of ONoCs. Despite already significant progress on transmission loss reduction, further work is still needed to enhance the performance of ONoCs. In this paper, we propose an intelligent deep Q-network (DQN)-based routing algorithm, for arriving at a low-loss optimal route. More specifically, we combine the power loss model with DQN, where the transmitted data packet is regarded as an agent. Through continuous interaction with the environment and iterative trial, the agent can learn a near-optimal routing strategy. Numerical results show that our proposed routing algorithm has better performance and lower online computational latency compared to the traditional routing algorithm. Additionally, with an increasing network size, the advantages of DQN-based approach will become more significant.","PeriodicalId":50103,"journal":{"name":"Journal of Optical Communications and Networking","volume":"17 4","pages":"285-293"},"PeriodicalIF":4.0000,"publicationDate":"2025-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Intelligent learning-based routing algorithm for optical network-on-chips\",\"authors\":\"Zhouping Huang;Fang Xu;Yiyuan Xie;Ye Su;Zhuang Chen;Xiao Jiang\",\"doi\":\"10.1364/JOCN.543042\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Optical network-on-chips (ONoCs) play a vital role in interconnecting chip cores. Currently, transmission loss is the major limiting factor that affects the size of interconnect networks. As such, reducing the transmission loss is very important for optimizing the operating efficiency and size of ONoCs. Despite already significant progress on transmission loss reduction, further work is still needed to enhance the performance of ONoCs. In this paper, we propose an intelligent deep Q-network (DQN)-based routing algorithm, for arriving at a low-loss optimal route. More specifically, we combine the power loss model with DQN, where the transmitted data packet is regarded as an agent. Through continuous interaction with the environment and iterative trial, the agent can learn a near-optimal routing strategy. Numerical results show that our proposed routing algorithm has better performance and lower online computational latency compared to the traditional routing algorithm. Additionally, with an increasing network size, the advantages of DQN-based approach will become more significant.\",\"PeriodicalId\":50103,\"journal\":{\"name\":\"Journal of Optical Communications and Networking\",\"volume\":\"17 4\",\"pages\":\"285-293\"},\"PeriodicalIF\":4.0000,\"publicationDate\":\"2025-03-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Optical Communications and Networking\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10927713/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Optical Communications and Networking","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10927713/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0

摘要

光片上网络(ONoCs)在芯片核心互连中起着至关重要的作用。目前,传输损耗是影响互联网络规模的主要限制因素。因此,降低传输损耗对于优化onoc的运行效率和规模是非常重要的。尽管在减少传输损耗方面已经取得了重大进展,但仍需要进一步工作来提高ONoCs的性能。本文提出了一种基于智能深度q网络(DQN)的路由算法,以达到低损耗的最优路由。更具体地说,我们将功率损耗模型与DQN相结合,其中传输的数据包被视为一个代理。通过与环境的持续交互和迭代试验,智能体可以学习到接近最优的路由策略。数值结果表明,与传统的路由算法相比,本文提出的路由算法具有更好的性能和更低的在线计算延迟。此外,随着网络规模的增加,基于dqn的方法的优势将变得更加明显。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Intelligent learning-based routing algorithm for optical network-on-chips
Optical network-on-chips (ONoCs) play a vital role in interconnecting chip cores. Currently, transmission loss is the major limiting factor that affects the size of interconnect networks. As such, reducing the transmission loss is very important for optimizing the operating efficiency and size of ONoCs. Despite already significant progress on transmission loss reduction, further work is still needed to enhance the performance of ONoCs. In this paper, we propose an intelligent deep Q-network (DQN)-based routing algorithm, for arriving at a low-loss optimal route. More specifically, we combine the power loss model with DQN, where the transmitted data packet is regarded as an agent. Through continuous interaction with the environment and iterative trial, the agent can learn a near-optimal routing strategy. Numerical results show that our proposed routing algorithm has better performance and lower online computational latency compared to the traditional routing algorithm. Additionally, with an increasing network size, the advantages of DQN-based approach will become more significant.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
9.40
自引率
16.00%
发文量
104
审稿时长
4 months
期刊介绍: The scope of the Journal includes advances in the state-of-the-art of optical networking science, technology, and engineering. Both theoretical contributions (including new techniques, concepts, analyses, and economic studies) and practical contributions (including optical networking experiments, prototypes, and new applications) are encouraged. Subareas of interest include the architecture and design of optical networks, optical network survivability and security, software-defined optical networking, elastic optical networks, data and control plane advances, network management related innovation, and optical access networks. Enabling technologies and their applications are suitable topics only if the results are shown to directly impact optical networking beyond simple point-to-point networks.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信