{"title":"空间彩色自然图像有效编码中策略锥加权的出现。","authors":"Alexander Belsten, Bruno A Olshausen","doi":"10.1364/JOSAA.545141","DOIUrl":null,"url":null,"abstract":"<p><p>We develop an efficient coding model to address how a population of retinal ganglion cells (RGCs) can optimally combine signals from the retinal cone mosaic to maximize information transfer through the optic nerve. The model takes into account the redundancies inherent in color natural images and predicts how they should be reduced in order to make the best use of channel capacity in the optic nerve, given metabolic constraints, wiring constraints, and input and channel noise. RGCs are modeled as a set of linear-nonlinear neurons whose instantaneous firing rate is computed via a weighted sum of cone responses from a simulated L- and M-cone mosaic, followed by a rectifying nonlinearity. When adapted to a set of calibrated color natural images so as to maximize mutual information between the retinal image and RGC outputs, the learned weights exhibit a circularly symmetric, center-surround structure, and the population of RGCs tile visual space via ON- and OFF-mosaics, in line with previous studies that use only luminance variations in natural scenes. Over a range of cone-to-neuron ratios, the model RGCs strategically weight cones of a particular spectral type to construct a stronger form of L-M cone-opponency than would be obtained with purely random sampling, implying that such a specific arrangement increases information transfer through the optic nerve. Additionally, we find that the degree of cone-type-specific adaptation varies with the amount of noise in the cone activations, with less noise leading to more specific adaptation. The results of this study point to the benefits of strategic cone weighting for maximizing information transfer for spatiochromatic natural scenes.</p>","PeriodicalId":17382,"journal":{"name":"Journal of The Optical Society of America A-optics Image Science and Vision","volume":"42 5","pages":"B495-B502"},"PeriodicalIF":1.5000,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Emergence of strategic cone weighting from efficient coding of spatiochromatic natural images.\",\"authors\":\"Alexander Belsten, Bruno A Olshausen\",\"doi\":\"10.1364/JOSAA.545141\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>We develop an efficient coding model to address how a population of retinal ganglion cells (RGCs) can optimally combine signals from the retinal cone mosaic to maximize information transfer through the optic nerve. The model takes into account the redundancies inherent in color natural images and predicts how they should be reduced in order to make the best use of channel capacity in the optic nerve, given metabolic constraints, wiring constraints, and input and channel noise. RGCs are modeled as a set of linear-nonlinear neurons whose instantaneous firing rate is computed via a weighted sum of cone responses from a simulated L- and M-cone mosaic, followed by a rectifying nonlinearity. When adapted to a set of calibrated color natural images so as to maximize mutual information between the retinal image and RGC outputs, the learned weights exhibit a circularly symmetric, center-surround structure, and the population of RGCs tile visual space via ON- and OFF-mosaics, in line with previous studies that use only luminance variations in natural scenes. Over a range of cone-to-neuron ratios, the model RGCs strategically weight cones of a particular spectral type to construct a stronger form of L-M cone-opponency than would be obtained with purely random sampling, implying that such a specific arrangement increases information transfer through the optic nerve. Additionally, we find that the degree of cone-type-specific adaptation varies with the amount of noise in the cone activations, with less noise leading to more specific adaptation. The results of this study point to the benefits of strategic cone weighting for maximizing information transfer for spatiochromatic natural scenes.</p>\",\"PeriodicalId\":17382,\"journal\":{\"name\":\"Journal of The Optical Society of America A-optics Image Science and Vision\",\"volume\":\"42 5\",\"pages\":\"B495-B502\"},\"PeriodicalIF\":1.5000,\"publicationDate\":\"2025-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of The Optical Society of America A-optics Image Science and Vision\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://doi.org/10.1364/JOSAA.545141\",\"RegionNum\":3,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"OPTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of The Optical Society of America A-optics Image Science and Vision","FirstCategoryId":"101","ListUrlMain":"https://doi.org/10.1364/JOSAA.545141","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0
摘要
我们开发了一个有效的编码模型,以解决视网膜神经节细胞(RGCs)群体如何最佳地组合来自视网膜锥镶嵌的信号,以最大限度地通过视神经传递信息。该模型考虑了彩色自然图像中固有的冗余,并预测了如何减少冗余,以便在给定代谢约束、布线约束以及输入和信道噪声的情况下,最大限度地利用视神经中的信道容量。rgc被建模为一组线性-非线性神经元,其瞬时放电率通过模拟L-和m -锥马赛克的锥响应加权和计算,然后进行非线性校正。当适应一组经过校准的彩色自然图像,以最大限度地提高视网膜图像和RGC输出之间的相互信息时,学习到的权值呈现出圆对称的中心环绕结构,RGC通过ON- and - off马赛克填充视觉空间,这与之前只使用自然场景中亮度变化的研究一致。在锥体与神经元比率的范围内,模型rgc策略性地对特定光谱类型的锥体进行加权,以构建比纯随机抽样获得的更强形式的L-M锥体对抗,这意味着这种特定的排列增加了通过视神经的信息传递。此外,我们发现锥体类型特异性适应的程度随锥体激活中噪音的大小而变化,噪音越少,适应性越强。本研究的结果指出了策略锥加权对于最大化空间色彩自然场景的信息传递的好处。
Emergence of strategic cone weighting from efficient coding of spatiochromatic natural images.
We develop an efficient coding model to address how a population of retinal ganglion cells (RGCs) can optimally combine signals from the retinal cone mosaic to maximize information transfer through the optic nerve. The model takes into account the redundancies inherent in color natural images and predicts how they should be reduced in order to make the best use of channel capacity in the optic nerve, given metabolic constraints, wiring constraints, and input and channel noise. RGCs are modeled as a set of linear-nonlinear neurons whose instantaneous firing rate is computed via a weighted sum of cone responses from a simulated L- and M-cone mosaic, followed by a rectifying nonlinearity. When adapted to a set of calibrated color natural images so as to maximize mutual information between the retinal image and RGC outputs, the learned weights exhibit a circularly symmetric, center-surround structure, and the population of RGCs tile visual space via ON- and OFF-mosaics, in line with previous studies that use only luminance variations in natural scenes. Over a range of cone-to-neuron ratios, the model RGCs strategically weight cones of a particular spectral type to construct a stronger form of L-M cone-opponency than would be obtained with purely random sampling, implying that such a specific arrangement increases information transfer through the optic nerve. Additionally, we find that the degree of cone-type-specific adaptation varies with the amount of noise in the cone activations, with less noise leading to more specific adaptation. The results of this study point to the benefits of strategic cone weighting for maximizing information transfer for spatiochromatic natural scenes.
期刊介绍:
The Journal of the Optical Society of America A (JOSA A) is devoted to developments in any field of classical optics, image science, and vision. JOSA A includes original peer-reviewed papers on such topics as:
* Atmospheric optics
* Clinical vision
* Coherence and Statistical Optics
* Color
* Diffraction and gratings
* Image processing
* Machine vision
* Physiological optics
* Polarization
* Scattering
* Signal processing
* Thin films
* Visual optics
Also: j opt soc am a.