{"title":"Are Deep Neural Networks Adequate Behavioral Models of Human Visual Perception?","authors":"Felix A Wichmann, Robert Geirhos","doi":"10.1146/annurev-vision-120522-031739","DOIUrl":"10.1146/annurev-vision-120522-031739","url":null,"abstract":"<p><p>Deep neural networks (DNNs) are machine learning algorithms that have revolutionized computer vision due to their remarkable successes in tasks like object classification and segmentation. The success of DNNs as computer vision algorithms has led to the suggestion that DNNs may also be good models of human visual perception. In this article, we review evidence regarding current DNNs as adequate behavioral models of human core object recognition. To this end, we argue that it is important to distinguish between statistical tools and computational models and to understand model quality as a multidimensional concept in which clarity about modeling goals is key. Reviewing a large number of psychophysical and computational explorations of core object recognition performance in humans and DNNs, we argue that DNNs are highly valuable scientific tools but that, as of today, DNNs should only be regarded as promising-but not yet adequate-computational models of human core object recognition behavior. On the way, we dispel several myths surrounding DNNs in vision science.</p>","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":"9 ","pages":"501-524"},"PeriodicalIF":6.0,"publicationDate":"2023-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10278871","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Suppressing Retinal Remodeling to Mitigate Vision Loss in Photoreceptor Degenerative Disorders.","authors":"Richard H Kramer","doi":"10.1146/annurev-vision-112122-020957","DOIUrl":"10.1146/annurev-vision-112122-020957","url":null,"abstract":"<p><p>Rod and cone photoreceptors degenerate in retinitis pigmentosa and age-related macular degeneration, robbing the visual system of light-triggered signals necessary for sight. However, changes in the retina do not stop with the photoreceptors. A stereotypical set of morphological and physiological changes, known as remodeling, occur in downstream retinal neurons. Some aspects of remodeling are homeostatic, with structural or functional changes compensating for partial loss of visual inputs. However, other aspects are nonhomeostatic, corrupting retinal information processing to obscure vision mediated naturally by surviving photoreceptors or artificially by vision-restoration technologies. In this review, I consider the mechanism of remodeling and its consequences for residual and restored visual function; discuss the role of retinoic acid, a critical molecular trigger of detrimental remodeling; and discuss strategies for suppressing retinoic acid biosynthesis or signaling as therapeutic possibilities for mitigating vision loss.</p>","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":"9 ","pages":"131-153"},"PeriodicalIF":6.0,"publicationDate":"2023-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10633048","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Joana E Andoh, Agnes C Ezekwesili, Kristen Nwanyanwu, Angela Elam
{"title":"Disparities in Eye Care Access and Utilization: A Narrative Review.","authors":"Joana E Andoh, Agnes C Ezekwesili, Kristen Nwanyanwu, Angela Elam","doi":"10.1146/annurev-vision-112122-020934","DOIUrl":"10.1146/annurev-vision-112122-020934","url":null,"abstract":"<p><p>This narrative review summarizes the literature on factors related to eye care access and utilization in the United States. Using the Healthy People 2030 framework, this review investigates social determinants of health associated with general and follow-up engagement, screenings, diagnostic visits, treatment, technology, and teleophthalmology. We provide hypotheses for these documented eye care disparities, featuring qualitative, patient-centered research. Lastly, we provide recommendations in the hopes of appropriately eliminating these disparities and reimagining eye care.</p>","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":"9 ","pages":"15-37"},"PeriodicalIF":6.0,"publicationDate":"2023-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10282092","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ziad M Hafed, Klaus-Peter Hoffmann, Chih-Yang Chen, Amarender R Bogadhi
{"title":"Visual Functions of the Primate Superior Colliculus.","authors":"Ziad M Hafed, Klaus-Peter Hoffmann, Chih-Yang Chen, Amarender R Bogadhi","doi":"10.1146/annurev-vision-111022-123817","DOIUrl":"10.1146/annurev-vision-111022-123817","url":null,"abstract":"<p><p>The superior colliculus (SC) is a subcortical brain structure that is relevant for sensation, cognition, and action. In nonhuman primates, a rich history of studies has provided unprecedented detail about this structure's role in controlling orienting behaviors; as a result, the primate SC has become primarily regarded as a motor control structure. However, as in other species, the primate SC is also a highly visual structure: A fraction of its inputs is retinal and complemented by inputs from visual cortical areas, including the primary visual cortex. Motivated by this, recent investigations are revealing the rich visual pattern analysis capabilities of the primate SC, placing this structure in an ideal position to guide orienting movements. The anatomical proximity of the primate SC to both early visual inputs and final motor control apparatuses, as well as its ascending feedback projections to the cortex, affirms an important role for this structure in active perception.</p>","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":"9 ","pages":"361-383"},"PeriodicalIF":6.0,"publicationDate":"2023-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10277945","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Factors Affecting Stem Cell-Based Regenerative Approaches in Retinal Degeneration.","authors":"Sachin H Patel, Deepak A Lamba","doi":"10.1146/annurev-vision-120222-012817","DOIUrl":"10.1146/annurev-vision-120222-012817","url":null,"abstract":"<p><p>Inherited and age-associated vision loss is often associated with degeneration of the cells of the retina, the light-sensitive layer at the back of the eye. The mammalian retina, being a postmitotic neural tissue, does not have the capacity to repair itself through endogenous regeneration. There has been considerable excitement for the development of cell replacement approaches since the isolation and development of culture methods for human pluripotent stem cells, as well as the generation of induced pluripotent stem cells. This has now been combined with novel three-dimensional organoid culture systems that closely mimic human retinal development in vitro. In this review, we cover the current state of the field, with emphasis on the cell delivery challenges, role of the recipient immunological microenvironment, and challenges related to connectivity between transplanted cells and host circuitry both locally and centrally to the different areas of the brain.</p>","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":"9 ","pages":"155-175"},"PeriodicalIF":6.0,"publicationDate":"2023-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10337451","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Perception and Memory in the Ventral Visual Stream and Medial Temporal Lobe.","authors":"Chris B Martin, Morgan D Barense","doi":"10.1146/annurev-vision-120222-014200","DOIUrl":"10.1146/annurev-vision-120222-014200","url":null,"abstract":"<p><p>Perception and memory are traditionally thought of as separate cognitive functions, supported by distinct brain regions. The canonical perspective is that perceptual processing of visual information is supported by the ventral visual stream, whereas long-term declarative memory is supported by the medial temporal lobe. However, this modular framework cannot account for the increasingly large body of evidence that reveals a role for early visual areas in long-term recognition memory and a role for medial temporal lobe structures in high-level perceptual processing. In this article, we review relevant research conducted in humans, nonhuman primates, and rodents. We conclude that the evidence is largely inconsistent with theoretical proposals that draw sharp functional boundaries between perceptual and memory systems in the brain. Instead, the weight of the empirical findings is best captured by a representational-hierarchical model that emphasizes differences in content, rather than in cognitive processes within the ventral visual stream and medial temporal lobe.</p>","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":"9 ","pages":"409-434"},"PeriodicalIF":6.0,"publicationDate":"2023-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10282494","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Eye Morphogenesis in Vertebrates.","authors":"Macaulie A Casey, Sarah Lusk, Kristen M Kwan","doi":"10.1146/annurev-vision-100720-111125","DOIUrl":"10.1146/annurev-vision-100720-111125","url":null,"abstract":"<p><p>Proper eye structure is essential for visual function: Multiple essential eye tissues must take shape and assemble into a precise three-dimensional configuration. Accordingly, alterations to eye structure can lead to pathological conditions of visual impairment. Changes in eye shape can also be adaptive over evolutionary time. Eye structure is first established during development with the formation of the optic cup, which contains the neural retina, retinal pigment epithelium, and lens. This crucial yet deceptively simple hemispherical structure lays the foundation for all later elaborations of the eye. Building on descriptions of the embryonic eye that started with hand drawings and micrographs, the field is beginning to identify mechanisms driving dynamic changes in three-dimensional cell and tissue shape. A combination of molecular genetics, imaging, and pharmacological approaches is defining connections among transcription factors, signaling pathways, and the intracellular machinery governing the emergence of this crucial structure.</p>","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":"9 ","pages":"221-243"},"PeriodicalIF":6.0,"publicationDate":"2023-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10277944","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Envisioning a Woman Scientist.","authors":"Suzanne P McKee","doi":"10.1146/annurev-vision-111022-123844","DOIUrl":"10.1146/annurev-vision-111022-123844","url":null,"abstract":"<p><p>I entered science at a particularly lucky time. By the mid-1960s, women were being encouraged to pursue serious scientific careers. During the 60-year span of my career, women have become equal partners with men in scientific research, particularly in the biological sciences. There also has been abundant funding for research, which allowed me to succeed in a \"soft-money\" position at Smith-Kettlewell Eye Research Institute, a place that was especially supportive for a woman scientist with children. In this article, I describe the findings that I think represent the most interesting and enduring scientific work from my career.</p>","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":"9 ","pages":"1-14"},"PeriodicalIF":6.0,"publicationDate":"2023-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10330602","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Luminita Tarita-Nistor, Irina Sverdlichenko, Mark S Mandelcorn
{"title":"What Is a Preferred Retinal Locus?","authors":"Luminita Tarita-Nistor, Irina Sverdlichenko, Mark S Mandelcorn","doi":"10.1146/annurev-vision-111022-123909","DOIUrl":"10.1146/annurev-vision-111022-123909","url":null,"abstract":"<p><p>This review examines the concept of the preferred retinal locus (PRL) in patients with macular diseases. Considering monocular and binocular viewing, we (<i>a</i>) explain how to identify the PRL and discuss the pitfalls associated with its measurement, (<i>b</i>) review the current hypotheses for PRL development, (<i>c</i>) assess whether the PRL is the new reference point of the ocular motor system, and discuss (<i>d</i>) the functional and (<i>e</i>) the clinical implications of the PRL. We conclude that the current definition of the PRL is probably incomplete and should incorporate the need to evaluate the PRL in the framework of binocular viewing. We emphasize the need for more research.</p>","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":"9 ","pages":"201-220"},"PeriodicalIF":6.0,"publicationDate":"2023-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10330606","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ari Rosenberg, Lowell W Thompson, Raymond Doudlah, Ting-Yu Chang
{"title":"Neuronal Representations Supporting Three-Dimensional Vision in Nonhuman Primates.","authors":"Ari Rosenberg, Lowell W Thompson, Raymond Doudlah, Ting-Yu Chang","doi":"10.1146/annurev-vision-111022-123857","DOIUrl":"10.1146/annurev-vision-111022-123857","url":null,"abstract":"<p><p>The visual system must reconstruct the dynamic, three-dimensional (3D) world from ambiguous two-dimensional (2D) retinal images. In this review, we synthesize current literature on how the visual system of nonhuman primates performs this transformation through multiple channels within the classically defined dorsal (where) and ventral (what) pathways. Each of these channels is specialized for processing different 3D features (e.g., the shape, orientation, or motion of objects, or the larger scene structure). Despite the common goal of 3D reconstruction, neurocomputational differences between the channels impose distinct information-limiting constraints on perception. Convergent evidence further points to the little-studied area V3A as a potential branchpoint from which multiple 3D-fugal processing channels diverge. We speculate that the expansion of V3A in humans may have supported the emergence of advanced 3D spatial reasoning skills. Lastly, we discuss future directions for exploring 3D information transmission across brain areas and experimental approaches that can further advance the understanding of 3D vision.</p>","PeriodicalId":48658,"journal":{"name":"Annual Review of Vision Science","volume":"9 ","pages":"337-359"},"PeriodicalIF":6.0,"publicationDate":"2023-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10330608","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}