{"title":"On Evaluating Abstraction and Analogy in Humans and Machines","authors":"Melanie Mitchell","doi":"10.1177/09637214261433528","DOIUrl":null,"url":null,"abstract":"This article reviews two case studies in which AI systems were evaluated for abstraction and analogy-making capabilities and compared with those of humans. These studies illustrate how AI systems should be evaluated not only for accuracy on benchmark tasks but also for robustness to task variations and for insight into how the system is solving the tasks. These studies also illuminate the need for transparency, interpretability, and scientifically informed experimental methodology in AI evaluations.","PeriodicalId":10802,"journal":{"name":"Current Directions in Psychological Science","volume":"18 1","pages":""},"PeriodicalIF":5.8000,"publicationDate":"2026-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Current Directions in Psychological Science","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/09637214261433528","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
This article reviews two case studies in which AI systems were evaluated for abstraction and analogy-making capabilities and compared with those of humans. These studies illustrate how AI systems should be evaluated not only for accuracy on benchmark tasks but also for robustness to task variations and for insight into how the system is solving the tasks. These studies also illuminate the need for transparency, interpretability, and scientifically informed experimental methodology in AI evaluations.
期刊介绍:
Current Directions in Psychological Science publishes reviews by leading experts covering all of scientific psychology and its applications. Each issue of Current Directions features a diverse mix of reports on various topics such as language, memory and cognition, development, the neural basis of behavior and emotions, various aspects of psychopathology, and theory of mind. These articles allow readers to stay apprised of important developments across subfields beyond their areas of expertise and bodies of research they might not otherwise be aware of. The articles in Current Directions are also written to be accessible to non-experts, making them ideally suited for use in the classroom as teaching supplements.