利用CMOS技术实现的大型自组织映射的高效初始化问题

M. Kolasa, R. Dlugosz, W. Pedrycz
{"title":"利用CMOS技术实现的大型自组织映射的高效初始化问题","authors":"M. Kolasa, R. Dlugosz, W. Pedrycz","doi":"10.1109/CYBConf.2015.7175903","DOIUrl":null,"url":null,"abstract":"Initialization of neuron weights is one of key problems in artificial neural networks (ANNs). This problem is particularly important in ANNs implemented as Application Specific Integrated Circuits (ASICs), where the number of the weights becomes large. When ANNs are implemented in software, the weights can be easily programmed. In contrast, in parallel systems of this type realized as ASICs it is necessary to provide programming and addressing lines to each weight that causes a large increase in the complexity of such designs. In this paper we present investigations that demonstrate that Self-Organizing Maps (SOMs) in many situations may be trained without the initialization (with zeroed weights). We present example results of several thousands simulations for different topologies of the SOM, for different neighborhood functions and two distance measures between the learning patterns and particular neurons in the input data space. Simulations were performed for zero initial values, for small values (up to 1 % of full scale range) and for neurons randomly distributed over the overall input data space. The results are comparable that allows to reduce the complexity of the SOM implemented in the CMOS technology.","PeriodicalId":177233,"journal":{"name":"2015 IEEE 2nd International Conference on Cybernetics (CYBCONF)","volume":"53 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Problem of efficient initialization of large Self-Organizing Maps implemented in the CMOS technology\",\"authors\":\"M. Kolasa, R. Dlugosz, W. Pedrycz\",\"doi\":\"10.1109/CYBConf.2015.7175903\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Initialization of neuron weights is one of key problems in artificial neural networks (ANNs). This problem is particularly important in ANNs implemented as Application Specific Integrated Circuits (ASICs), where the number of the weights becomes large. When ANNs are implemented in software, the weights can be easily programmed. In contrast, in parallel systems of this type realized as ASICs it is necessary to provide programming and addressing lines to each weight that causes a large increase in the complexity of such designs. In this paper we present investigations that demonstrate that Self-Organizing Maps (SOMs) in many situations may be trained without the initialization (with zeroed weights). We present example results of several thousands simulations for different topologies of the SOM, for different neighborhood functions and two distance measures between the learning patterns and particular neurons in the input data space. Simulations were performed for zero initial values, for small values (up to 1 % of full scale range) and for neurons randomly distributed over the overall input data space. The results are comparable that allows to reduce the complexity of the SOM implemented in the CMOS technology.\",\"PeriodicalId\":177233,\"journal\":{\"name\":\"2015 IEEE 2nd International Conference on Cybernetics (CYBCONF)\",\"volume\":\"53 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-06-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2015 IEEE 2nd International Conference on Cybernetics (CYBCONF)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CYBConf.2015.7175903\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2015 IEEE 2nd International Conference on Cybernetics (CYBCONF)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CYBConf.2015.7175903","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3

摘要

神经元权值的初始化是人工神经网络中的关键问题之一。这个问题在作为专用集成电路(asic)实现的人工神经网络中尤为重要,因为权重的数量变得很大。当人工神经网络在软件中实现时,权重可以很容易地编程。相反,在asic实现的这种类型的并行系统中,有必要为每个权重提供编程和寻址线,这导致此类设计的复杂性大大增加。在本文中,我们提出了一些研究,证明在许多情况下,自组织映射(SOMs)可以在没有初始化的情况下进行训练(具有零权重)。我们给出了数千个模拟的示例结果,这些模拟是针对SOM的不同拓扑、不同邻域函数和学习模式与输入数据空间中特定神经元之间的两种距离度量进行的。对零初始值、小值(满量程的1%)和随机分布在整个输入数据空间的神经元进行模拟。结果具有可比性,可以降低在CMOS技术中实现的SOM的复杂性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Problem of efficient initialization of large Self-Organizing Maps implemented in the CMOS technology
Initialization of neuron weights is one of key problems in artificial neural networks (ANNs). This problem is particularly important in ANNs implemented as Application Specific Integrated Circuits (ASICs), where the number of the weights becomes large. When ANNs are implemented in software, the weights can be easily programmed. In contrast, in parallel systems of this type realized as ASICs it is necessary to provide programming and addressing lines to each weight that causes a large increase in the complexity of such designs. In this paper we present investigations that demonstrate that Self-Organizing Maps (SOMs) in many situations may be trained without the initialization (with zeroed weights). We present example results of several thousands simulations for different topologies of the SOM, for different neighborhood functions and two distance measures between the learning patterns and particular neurons in the input data space. Simulations were performed for zero initial values, for small values (up to 1 % of full scale range) and for neurons randomly distributed over the overall input data space. The results are comparable that allows to reduce the complexity of the SOM implemented in the CMOS technology.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信