Nishant Mysore, Gopabandhu Hota, S. Deiss, B. Pedroni, G. Cauwenberghs
{"title":"Hierarchical Network Partitioning for Reconfigurable Large-Scale Neuromorphic Systems","authors":"Nishant Mysore, Gopabandhu Hota, S. Deiss, B. Pedroni, G. Cauwenberghs","doi":"10.1109/ICRC53822.2021.00020","DOIUrl":null,"url":null,"abstract":"We present an efficient and scalable partitioning method for mapping large-scale neural network models to reconfigurable neuromorphic hardware. The partitioning framework is optimized for compute-balanced, memory -efficient parallel processing targeting low-latency execution and dense synaptic storage, with minimal routing across various compute cores. We demonstrate highly scalable and efficient partitioning for connectivity-aware and hierarchical address-event routing resource-optimized mapping, significantly reducing the total communication volume recursively when compared to random balanced assignment. We evaluate the partitioning algorithm on synthetic small-world networks with varying degrees of sparsity factor and fan-out. The combination of our method and practical results suggest a promising path towards extending to very large-scale networks and more degrees of hierarchy.","PeriodicalId":139766,"journal":{"name":"2021 International Conference on Rebooting Computing (ICRC)","volume":"11 6","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 International Conference on Rebooting Computing (ICRC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICRC53822.2021.00020","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2
Abstract
We present an efficient and scalable partitioning method for mapping large-scale neural network models to reconfigurable neuromorphic hardware. The partitioning framework is optimized for compute-balanced, memory -efficient parallel processing targeting low-latency execution and dense synaptic storage, with minimal routing across various compute cores. We demonstrate highly scalable and efficient partitioning for connectivity-aware and hierarchical address-event routing resource-optimized mapping, significantly reducing the total communication volume recursively when compared to random balanced assignment. We evaluate the partitioning algorithm on synthetic small-world networks with varying degrees of sparsity factor and fan-out. The combination of our method and practical results suggest a promising path towards extending to very large-scale networks and more degrees of hierarchy.