Qiuzhan Zhou, Yinggang Li, Cong Wang, Jingsong Wang
{"title":"基于深度强化学习框架的PCB电镀假垫优化布局","authors":"Qiuzhan Zhou, Yinggang Li, Cong Wang, Jingsong Wang","doi":"10.1016/j.eswa.2025.128639","DOIUrl":null,"url":null,"abstract":"<div><div>The placement of dummy pads is critical in large-scale printed circuit board (PCB) design to ensure uniform copper plating. However, space constraints make dense arrangement difficult in blank areas. Thus, an efficient layout strategy is urgently needed to achieve optimal plating uniformity with limited dummy pads. Existing algorithms struggle with large search spaces, high evaluation costs, and limited accuracy due to the complexity and scale of full-board PCB optimization. To address these challenges, we propose a model framework that integrates neural network prediction with reinforcement learning optimization. The PCB is first partitioned into smaller sub-regions to reduce computational complexity. A reward network is then constructed, incorporating spatial pyramid pooling and external attention mechanisms to capture both local and global spatial features. This network enables accurate prediction of plating outcomes under different dummy pad configurations. Guided by these predictions, we employ the proximal policy optimization (PPO) algorithm to train a dummy pad layout network that autonomously explores optimal design strategies. Importantly, a real-time reward function is introduced to decompose the contribution of each dummy pad, effectively mitigating the sparse reward problem and accelerating convergence. Experimental results demonstrate that our approach outperforms traditional engineering methods in terms of copper thickness uniformity and layout efficiency. Furthermore, it reveals hidden design patterns and underlying physical principles, providing both practical guidance and theoretical insight into PCB layout optimization.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"292 ","pages":"Article 128639"},"PeriodicalIF":7.5000,"publicationDate":"2025-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A deep reinforcement learning framework for optimized dummy pad placement in PCB electroplating\",\"authors\":\"Qiuzhan Zhou, Yinggang Li, Cong Wang, Jingsong Wang\",\"doi\":\"10.1016/j.eswa.2025.128639\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The placement of dummy pads is critical in large-scale printed circuit board (PCB) design to ensure uniform copper plating. However, space constraints make dense arrangement difficult in blank areas. Thus, an efficient layout strategy is urgently needed to achieve optimal plating uniformity with limited dummy pads. Existing algorithms struggle with large search spaces, high evaluation costs, and limited accuracy due to the complexity and scale of full-board PCB optimization. To address these challenges, we propose a model framework that integrates neural network prediction with reinforcement learning optimization. The PCB is first partitioned into smaller sub-regions to reduce computational complexity. A reward network is then constructed, incorporating spatial pyramid pooling and external attention mechanisms to capture both local and global spatial features. This network enables accurate prediction of plating outcomes under different dummy pad configurations. Guided by these predictions, we employ the proximal policy optimization (PPO) algorithm to train a dummy pad layout network that autonomously explores optimal design strategies. Importantly, a real-time reward function is introduced to decompose the contribution of each dummy pad, effectively mitigating the sparse reward problem and accelerating convergence. Experimental results demonstrate that our approach outperforms traditional engineering methods in terms of copper thickness uniformity and layout efficiency. Furthermore, it reveals hidden design patterns and underlying physical principles, providing both practical guidance and theoretical insight into PCB layout optimization.</div></div>\",\"PeriodicalId\":50461,\"journal\":{\"name\":\"Expert Systems with Applications\",\"volume\":\"292 \",\"pages\":\"Article 128639\"},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2025-06-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Expert Systems with Applications\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0957417425022584\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417425022584","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
A deep reinforcement learning framework for optimized dummy pad placement in PCB electroplating
The placement of dummy pads is critical in large-scale printed circuit board (PCB) design to ensure uniform copper plating. However, space constraints make dense arrangement difficult in blank areas. Thus, an efficient layout strategy is urgently needed to achieve optimal plating uniformity with limited dummy pads. Existing algorithms struggle with large search spaces, high evaluation costs, and limited accuracy due to the complexity and scale of full-board PCB optimization. To address these challenges, we propose a model framework that integrates neural network prediction with reinforcement learning optimization. The PCB is first partitioned into smaller sub-regions to reduce computational complexity. A reward network is then constructed, incorporating spatial pyramid pooling and external attention mechanisms to capture both local and global spatial features. This network enables accurate prediction of plating outcomes under different dummy pad configurations. Guided by these predictions, we employ the proximal policy optimization (PPO) algorithm to train a dummy pad layout network that autonomously explores optimal design strategies. Importantly, a real-time reward function is introduced to decompose the contribution of each dummy pad, effectively mitigating the sparse reward problem and accelerating convergence. Experimental results demonstrate that our approach outperforms traditional engineering methods in terms of copper thickness uniformity and layout efficiency. Furthermore, it reveals hidden design patterns and underlying physical principles, providing both practical guidance and theoretical insight into PCB layout optimization.
期刊介绍:
Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.