{"title":"局部编码的神经网络联想记忆","authors":"A. Mofrad, Zahra Ferdosi, M. Parker, M. Tadayon","doi":"10.1109/CWIT.2015.7255180","DOIUrl":null,"url":null,"abstract":"In this paper the approach is to embed coding techniques into neural networks in order to increase their performance as associative memories in the presence of partial erasures. The motivation comes from the recent works by Gripon and Berrou, which benefit from error correcting codes in neural networks schemes like Hopfield neural networks. The construction introduced stores messages as cliques of small size which can be retrieved in spite of partial error. We improve on the success of retrieving learnt messages by doing a local coding and by mapping codewords of a code on an extension field of G F (2) in clusters. We also use the fractal approach and a slightly different decoding scheme, which is appropriate for partial erasures, in order to reduce the complexity of retrieval. The approach is an improvement over previous methods in terms of computational complexity, and simulations show an improved error performance.","PeriodicalId":426245,"journal":{"name":"2015 IEEE 14th Canadian Workshop on Information Theory (CWIT)","volume":"35 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-07-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Neural network associative memories with local coding\",\"authors\":\"A. Mofrad, Zahra Ferdosi, M. Parker, M. Tadayon\",\"doi\":\"10.1109/CWIT.2015.7255180\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper the approach is to embed coding techniques into neural networks in order to increase their performance as associative memories in the presence of partial erasures. The motivation comes from the recent works by Gripon and Berrou, which benefit from error correcting codes in neural networks schemes like Hopfield neural networks. The construction introduced stores messages as cliques of small size which can be retrieved in spite of partial error. We improve on the success of retrieving learnt messages by doing a local coding and by mapping codewords of a code on an extension field of G F (2) in clusters. We also use the fractal approach and a slightly different decoding scheme, which is appropriate for partial erasures, in order to reduce the complexity of retrieval. The approach is an improvement over previous methods in terms of computational complexity, and simulations show an improved error performance.\",\"PeriodicalId\":426245,\"journal\":{\"name\":\"2015 IEEE 14th Canadian Workshop on Information Theory (CWIT)\",\"volume\":\"35 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-07-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2015 IEEE 14th Canadian Workshop on Information Theory (CWIT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CWIT.2015.7255180\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2015 IEEE 14th Canadian Workshop on Information Theory (CWIT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CWIT.2015.7255180","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Neural network associative memories with local coding
In this paper the approach is to embed coding techniques into neural networks in order to increase their performance as associative memories in the presence of partial erasures. The motivation comes from the recent works by Gripon and Berrou, which benefit from error correcting codes in neural networks schemes like Hopfield neural networks. The construction introduced stores messages as cliques of small size which can be retrieved in spite of partial error. We improve on the success of retrieving learnt messages by doing a local coding and by mapping codewords of a code on an extension field of G F (2) in clusters. We also use the fractal approach and a slightly different decoding scheme, which is appropriate for partial erasures, in order to reduce the complexity of retrieval. The approach is an improvement over previous methods in terms of computational complexity, and simulations show an improved error performance.