{"title":"基于混合空间编码的硬件效率随机计算","authors":"Yakun Zhou, Yizhuo Zhou, Jiajun Yan, Jienan Chen","doi":"10.1145/3565478.3572535","DOIUrl":null,"url":null,"abstract":"As the era of silicon-based microchips advances by Moores Law approach to physical limits, new computational paradigms are proposed for future systems, i.e., stochastic computation. However, the current stochastic computing faces the challenge of high latency and low accuracy. In this work, we propose spatial coding based on the hybrid stochastic computation (SHSC) method, which is a stochastic-binary hybrid domain computation. Instead of sequential bits computing, the proposed SHSC expands stochastic bits in the spatial dimension. To balance the accuracy and complexity, the multiplication is divided into high and low precision parts, where the high precision parts are performed in the binary domain, and low precision parts are performed in the stochastic domain. A low-cost error compensation circuit is proposed to further improve the computation accuracy. According to the implementation outcomes, the proposed method exhibits a 28% hardware efficiency improvement with the same inference accuracy as traditional neural network applications.","PeriodicalId":125590,"journal":{"name":"Proceedings of the 17th ACM International Symposium on Nanoscale Architectures","volume":"339 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Hardware Efficiency Stochastic Computing based on Hybrid Spatial Coding\",\"authors\":\"Yakun Zhou, Yizhuo Zhou, Jiajun Yan, Jienan Chen\",\"doi\":\"10.1145/3565478.3572535\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"As the era of silicon-based microchips advances by Moores Law approach to physical limits, new computational paradigms are proposed for future systems, i.e., stochastic computation. However, the current stochastic computing faces the challenge of high latency and low accuracy. In this work, we propose spatial coding based on the hybrid stochastic computation (SHSC) method, which is a stochastic-binary hybrid domain computation. Instead of sequential bits computing, the proposed SHSC expands stochastic bits in the spatial dimension. To balance the accuracy and complexity, the multiplication is divided into high and low precision parts, where the high precision parts are performed in the binary domain, and low precision parts are performed in the stochastic domain. A low-cost error compensation circuit is proposed to further improve the computation accuracy. According to the implementation outcomes, the proposed method exhibits a 28% hardware efficiency improvement with the same inference accuracy as traditional neural network applications.\",\"PeriodicalId\":125590,\"journal\":{\"name\":\"Proceedings of the 17th ACM International Symposium on Nanoscale Architectures\",\"volume\":\"339 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 17th ACM International Symposium on Nanoscale Architectures\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3565478.3572535\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 17th ACM International Symposium on Nanoscale Architectures","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3565478.3572535","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Hardware Efficiency Stochastic Computing based on Hybrid Spatial Coding
As the era of silicon-based microchips advances by Moores Law approach to physical limits, new computational paradigms are proposed for future systems, i.e., stochastic computation. However, the current stochastic computing faces the challenge of high latency and low accuracy. In this work, we propose spatial coding based on the hybrid stochastic computation (SHSC) method, which is a stochastic-binary hybrid domain computation. Instead of sequential bits computing, the proposed SHSC expands stochastic bits in the spatial dimension. To balance the accuracy and complexity, the multiplication is divided into high and low precision parts, where the high precision parts are performed in the binary domain, and low precision parts are performed in the stochastic domain. A low-cost error compensation circuit is proposed to further improve the computation accuracy. According to the implementation outcomes, the proposed method exhibits a 28% hardware efficiency improvement with the same inference accuracy as traditional neural network applications.