{"title":"Digital Twin Studies for Reverse Engineering the Origins of Visual Intelligence","authors":"Justin N. Wood, Lalit Pandey, Samantha M.W. Wood","doi":"10.1146/annurev-vision-101322-103628","DOIUrl":"https://doi.org/10.1146/annurev-vision-101322-103628","url":null,"abstract":"What are the core learning algorithms in brains? Nativists propose that intelligence emerges from innate domain-specific knowledge systems, whereas empiricists propose that intelligence emerges from domain-general systems that learn domain-specific knowledge from experience. We address this debate by reviewing digital twin studies designed to reverse engineer the learning algorithms in newborn brains. In digital twin studies, newborn animals and artificial agents are raised in the same environments and tested with the same tasks, permitting direct comparison of their learning abilities. Supporting empiricism, digital twin studies show that domain-general algorithms learn animal-like object perception when trained on the first-person visual experiences of newborn animals. Supporting nativism, digital twin studies show that domain-general algorithms produce innate domain-specific knowledge when trained on prenatal experiences (retinal waves). We argue that learning across humans, animals, and machines can be explained by a universal principle, which we call space-time fitting. Space-time fitting explains both empiricist and nativist phenomena, providing a unified framework for understanding the origins of intelligence.","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":null,"pages":null},"PeriodicalIF":6.0,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142260929","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Crystal L. Sigulinsky, Rebecca L. Pfeiffer, Bryan William Jones
{"title":"Retinal Connectomics: A Review","authors":"Crystal L. Sigulinsky, Rebecca L. Pfeiffer, Bryan William Jones","doi":"10.1146/annurev-vision-102122-110414","DOIUrl":"https://doi.org/10.1146/annurev-vision-102122-110414","url":null,"abstract":"The retina is an ideal model for understanding the fundamental rules for how neural networks are constructed. The compact neural networks of the retina perform all of the initial processing of visual information before transmission to higher visual centers in the brain. The field of retinal connectomics uses high-resolution electron microscopy datasets to map the intricate organization of these networks and further our understanding of how these computations are performed by revealing the fundamental topologies and allowable networks behind retinal computations. In this article, we review some of the notable advances that retinal connectomics has provided in our understanding of the specific cells and the organization of their connectivities within the retina, as well as how these are shaped in development and break down in disease. Using these anatomical maps to inform modeling has been, and will continue to be, instrumental in understanding how the retina processes visual signals.","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":null,"pages":null},"PeriodicalIF":6.0,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142260925","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Eleonora M. Lad, Monika Fleckenstein, Frank G. Holz, Liangbo Shen, Lucian V. Del Priore, Rufino Silva, Giovanni Staurenghi, Nadia Waheed, Usha Chakravarthy
{"title":"Informing Endpoints for Clinical Trials of Geographic Atrophy","authors":"Eleonora M. Lad, Monika Fleckenstein, Frank G. Holz, Liangbo Shen, Lucian V. Del Priore, Rufino Silva, Giovanni Staurenghi, Nadia Waheed, Usha Chakravarthy","doi":"10.1146/annurev-vision-101922-045110","DOIUrl":"https://doi.org/10.1146/annurev-vision-101922-045110","url":null,"abstract":"Geographic atrophy (GA), the non-neovascular advanced form of age-related macular degeneration, remains an important disease area in which treatment needs are currently unmet. Recent clinical trials using drugs that target the complement pathway have shown modest yet consistent reductions in GA expansion but without commensurate changes in measures of visual function. In this review, we summarize information from the wide range of studies describing the characteristics of GA morphology and enumerate the factors influencing the growth rates of lesions and the directionality of expansion. In addition, we review the relationship between GA growth and the various measures of vision that reflect changes in function. We consider the reasons for the discordance between the anatomical and functional endpoints in current use and discuss methods to align these key outcomes.","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":null,"pages":null},"PeriodicalIF":6.0,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142260876","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Cellular and Molecular Mechanisms Regulating Retinal Synapse Development","authors":"Whitney A. Stevens-Sostre, Mrinalini Hoon","doi":"10.1146/annurev-vision-102122-105721","DOIUrl":"https://doi.org/10.1146/annurev-vision-102122-105721","url":null,"abstract":"Synapse formation within the retinal circuit ensures that distinct neuronal types can communicate efficiently to process visual signals. Synapses thus form the core of the visual computations performed by the retinal circuit. Retinal synapses are diverse but can be broadly categorized into multipartner ribbon synapses and 1:1 conventional synapses. In this article, we review our current understanding of the cellular and molecular mechanisms that regulate the functional establishment of mammalian retinal synapses, including the role of adhesion proteins, synaptic proteins, extracellular matrix and cytoskeletal-associated proteins, and activity-dependent cues. We outline future directions and areas of research that will expand our knowledge of these mechanisms. Understanding the regulators moderating synapse formation and function not only reveals the integrated developmental processes that establish retinal circuits, but also divulges the identity of mechanisms that could be engaged during disease and degeneration.","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":null,"pages":null},"PeriodicalIF":6.0,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142260928","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Eric R. Fossum, Nobukazu Teranishi, Albert J.P. Theuwissen
{"title":"Digital Image Sensor Evolution and New Frontiers","authors":"Eric R. Fossum, Nobukazu Teranishi, Albert J.P. Theuwissen","doi":"10.1146/annurev-vision-101322-105538","DOIUrl":"https://doi.org/10.1146/annurev-vision-101322-105538","url":null,"abstract":"This article reviews nearly 60 years of solid-state image sensor evolution and identifies potential new frontiers in the field. From early work in the 1960s, through the development of charge-coupled device image sensors, to the complementary metal oxide semiconductor image sensors now ubiquitous in our lives, we discuss highlights in the evolutionary chain. New frontiers, such as 3D stacked technology, photon-counting technology, and others, are briefly discussed.","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":null,"pages":null},"PeriodicalIF":6.0,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142260927","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Impact of Glaucomatous Ganglion Cell Damage on Central Visual Function","authors":"MiYoung Kwon","doi":"10.1146/annurev-vision-110223-123044","DOIUrl":"https://doi.org/10.1146/annurev-vision-110223-123044","url":null,"abstract":"Glaucoma, a leading cause of irreversible blindness, is characterized by the progressive loss of retinal ganglion cells (RGCs) and subsequent visual field defects. RGCs, as the final output neurons of the retina, perform key computations underpinning human pattern vision, such as contrast coding. Conventionally, glaucoma has been associated with peripheral vision loss, and thus, relatively little attention has been paid to deficits in central vision. However, recent advancements in retinal imaging techniques have significantly bolstered research into glaucomatous damage of the macula, revealing that it is prevalent even in the early stages of glaucoma. Thus, it is an opportune time to explore how glaucomatous damage undermines the perceptual processes associated with central visual function. This review showcases recent studies addressing central dysfunction in the early and moderate stages of glaucoma. It further emphasizes the need to characterize glaucomatous damage in both central and peripheral vision, as they jointly affect an individual's everyday activities.","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":null,"pages":null},"PeriodicalIF":6.0,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142260926","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Absorption, Storage, and Transport of Ocular Carotenoids and Retinoids.","authors":"Johannes von Lintig, Sepalika Bandera","doi":"10.1146/annurev-vision-102122-101846","DOIUrl":"https://doi.org/10.1146/annurev-vision-102122-101846","url":null,"abstract":"<p><p>Carotenoids, yellow and red pigments found abundantly in nature, play essential roles in various aspects of human physiology. They serve as critical molecules in vision by functioning as antioxidants and as filters for blue light within the retina. Furthermore, carotenoids are the natural precursors of vitamin A, which is indispensable for the synthesis of retinaldehyde, the visual chromophore, and retinoic acid, a small molecule that regulates gene expression. Insufficient levels of carotenoids and retinoids have been linked to age-related macular degeneration and xerophthalmia, respectively. Nevertheless, the mechanisms by which the eye maintains carotenoid and retinoid homeostasis have remained a mystery. Recent breakthroughs identified the molecular players involved in this process and provided valuable biochemical insights into their functioning. Mutations in the corresponding genes disrupt the homeostasis of carotenoids and retinoids, leading to visual system pathologies. This review aims to consolidate our current understanding of these pathways, including their regulatory principles.</p>","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":null,"pages":null},"PeriodicalIF":5.0,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141493943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Quest for an Integrated Set of Neural Mechanisms Underlying Object Recognition in Primates.","authors":"Kohitij Kar, James J DiCarlo","doi":"10.1146/annurev-vision-112823-030616","DOIUrl":"https://doi.org/10.1146/annurev-vision-112823-030616","url":null,"abstract":"<p><p>Inferences made about objects via vision, such as rapid and accurate categorization, are core to primate cognition despite the algorithmic challenge posed by varying viewpoints and scenes. Until recently, the brain mechanisms that support these capabilities were deeply mysterious. However, over the past decade, this scientific mystery has been illuminated by the discovery and development of brain-inspired, image-computable, artificial neural network (ANN) systems that rival primates in these behavioral feats. Apart from fundamentally changing the landscape of artificial intelligence, modified versions of these ANN systems are the current leading scientific hypotheses of an integrated set of mechanisms in the primate ventral visual stream that support core object recognition. What separates brain-mapped versions of these systems from prior conceptual models is that they are sensory computable, mechanistic, anatomically referenced, and testable (SMART). In this article, we review and provide perspective on the brain mechanisms addressed by the current leading SMART models. We review their empirical brain and behavioral alignment successes and failures, discuss the next frontiers for an even more accurate mechanistic understanding, and outline the likely applications.</p>","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":null,"pages":null},"PeriodicalIF":5.0,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141477753","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Role of Chromatic Aberration in Vision.","authors":"Timothy J Gawne, Martin S Banks","doi":"10.1146/annurev-vision-101222-052228","DOIUrl":"10.1146/annurev-vision-101222-052228","url":null,"abstract":"<p><p>The study of biological optics would be complicated enough if light only came in a single wavelength. However, altering the wavelength (or distribution of wavelengths) of light has multiple effects on optics, including on diffraction, scattering (of various sorts), transmission through and reflection by various media, fluorescence, and waveguiding properties, among others. In this review, we consider just one wavelength-dependent optical effect: longitudinal chromatic aberration (LCA). All vertebrate eyes that have been tested have significant LCA, with shorter (bluer) wavelengths of light focusing closer to the front of the eye than longer (redder) wavelengths. We consider the role of LCA in the visual system in terms of both how it could degrade visual acuity and how biological systems make use of it.</p>","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":null,"pages":null},"PeriodicalIF":5.0,"publicationDate":"2024-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141427999","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Using Illusions to Track the Emergence of Visual Perception.","authors":"Patrick Cavanagh","doi":"10.1146/annurev-vision-103023-012730","DOIUrl":"https://doi.org/10.1146/annurev-vision-103023-012730","url":null,"abstract":"<p><p>Everybody loves illusions. At times, the content on the internet seems to be mostly about illusions-shoes, dresses, straight lines looking bent. This attraction has a long history. Almost 2,000 years ago, Ptolemy marveled at how the sail of a distant boat could appear convex or concave. This sense of marvel continues to drive our fascination with illusions; indeed, few other corners of science can boast of such a large reach. However, illusions not only draw in the crowds; they also offer insights into visual processes. This review starts with a simple definition of illusions as conflicts between perception and cognition, where what we see does not agree with what we believe we should see. This mismatch can be either because cognition has misunderstood how perception works or because perception has misjudged the visual input. It is the perceptual errors that offer the chance to track the development of perception across visual regions. Unfortunately, the effects of illusions in different brain regions cannot be isolated in any simple way: Top-down projections from attention broadcast the expected perceptual properties everywhere, obscuring the critical evidence of where the illusion and perception emerge. The second part of this review then highlights the roadblocks to research raised by attention and describes current solutions for accessing what illusions can offer.</p>","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":null,"pages":null},"PeriodicalIF":6.0,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141318659","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}