{"title":"横向连接瓣成分分析:精度和地形","authors":"M. Luciw, J. Weng","doi":"10.1109/DEVLRN.2009.5175541","DOIUrl":null,"url":null,"abstract":"Due to the pressure of evolution, the brains of organisms need to self-organize at different scales during different developmental stages. In early stages, the brain must organize globally (e.g., large cortical areas) to form “smooth” topographic representation that is critical for superior generalization with its limited connections. At later stages, the brain must fine tune its microstructures of representation for “precision” - high-level performance and specialization. But smoothness and precision are two conflicting criteria. The self-organizing map (SOM) mechanisms of self-organization through isotropic updating and other published computational variants have dealt with global to local smoothing and lateral adaptation, but we show in our work that they are insufficient to deliver superior performance. In this paper, we introduce a combination of several mechanisms that, together, address these two conflicting criteria: lateral excitation through adaptive connections, explicit adaptive top-down connections (attention), dually-optimal lobe component analysis (LCA) for synaptic updating, simulated lateral inhibition through winners-take-all, and a developmental schedule that sets the number of winners, which decreases over time. Major performance improvements due to the combination of these mechanisms are shown in the reported experiments.","PeriodicalId":192225,"journal":{"name":"2009 IEEE 8th International Conference on Development and Learning","volume":"41 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2009-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"10","resultStr":"{\"title\":\"Laterally connected lobe component analysis: Precision and topography\",\"authors\":\"M. Luciw, J. Weng\",\"doi\":\"10.1109/DEVLRN.2009.5175541\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Due to the pressure of evolution, the brains of organisms need to self-organize at different scales during different developmental stages. In early stages, the brain must organize globally (e.g., large cortical areas) to form “smooth” topographic representation that is critical for superior generalization with its limited connections. At later stages, the brain must fine tune its microstructures of representation for “precision” - high-level performance and specialization. But smoothness and precision are two conflicting criteria. The self-organizing map (SOM) mechanisms of self-organization through isotropic updating and other published computational variants have dealt with global to local smoothing and lateral adaptation, but we show in our work that they are insufficient to deliver superior performance. In this paper, we introduce a combination of several mechanisms that, together, address these two conflicting criteria: lateral excitation through adaptive connections, explicit adaptive top-down connections (attention), dually-optimal lobe component analysis (LCA) for synaptic updating, simulated lateral inhibition through winners-take-all, and a developmental schedule that sets the number of winners, which decreases over time. Major performance improvements due to the combination of these mechanisms are shown in the reported experiments.\",\"PeriodicalId\":192225,\"journal\":{\"name\":\"2009 IEEE 8th International Conference on Development and Learning\",\"volume\":\"41 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2009-06-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"10\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2009 IEEE 8th International Conference on Development and Learning\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/DEVLRN.2009.5175541\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2009 IEEE 8th International Conference on Development and Learning","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/DEVLRN.2009.5175541","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Laterally connected lobe component analysis: Precision and topography
Due to the pressure of evolution, the brains of organisms need to self-organize at different scales during different developmental stages. In early stages, the brain must organize globally (e.g., large cortical areas) to form “smooth” topographic representation that is critical for superior generalization with its limited connections. At later stages, the brain must fine tune its microstructures of representation for “precision” - high-level performance and specialization. But smoothness and precision are two conflicting criteria. The self-organizing map (SOM) mechanisms of self-organization through isotropic updating and other published computational variants have dealt with global to local smoothing and lateral adaptation, but we show in our work that they are insufficient to deliver superior performance. In this paper, we introduce a combination of several mechanisms that, together, address these two conflicting criteria: lateral excitation through adaptive connections, explicit adaptive top-down connections (attention), dually-optimal lobe component analysis (LCA) for synaptic updating, simulated lateral inhibition through winners-take-all, and a developmental schedule that sets the number of winners, which decreases over time. Major performance improvements due to the combination of these mechanisms are shown in the reported experiments.