{"title":"多巴胺神经元在联想学习过程中的预测误差","authors":"Ryunosuke Amo","doi":"10.1016/j.neures.2023.07.003","DOIUrl":null,"url":null,"abstract":"<div><p>Dopamine neurons have long been thought to facilitate learning by broadcasting reward prediction error (RPE), a teaching signal used in machine learning, but more recent work has advanced alternative models of dopamine’s computational role. Here, I revisit this critical issue and review new experimental evidences that tighten the link between dopamine activity and RPE. First, I introduce the recent observation of a gradual backward shift of dopamine activity that had eluded researchers for over a decade. I also discuss several other findings, such as dopamine ramping, that were initially interpreted to conflict but later found to be consistent with RPE. These findings improve our understanding of neural computation in dopamine neurons.</p></div>","PeriodicalId":19146,"journal":{"name":"Neuroscience Research","volume":"199 ","pages":"Pages 12-20"},"PeriodicalIF":2.4000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0168010223001384/pdfft?md5=1eca1a91d1806ae97bd932bec1e1e9e4&pid=1-s2.0-S0168010223001384-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Prediction error in dopamine neurons during associative learning\",\"authors\":\"Ryunosuke Amo\",\"doi\":\"10.1016/j.neures.2023.07.003\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Dopamine neurons have long been thought to facilitate learning by broadcasting reward prediction error (RPE), a teaching signal used in machine learning, but more recent work has advanced alternative models of dopamine’s computational role. Here, I revisit this critical issue and review new experimental evidences that tighten the link between dopamine activity and RPE. First, I introduce the recent observation of a gradual backward shift of dopamine activity that had eluded researchers for over a decade. I also discuss several other findings, such as dopamine ramping, that were initially interpreted to conflict but later found to be consistent with RPE. These findings improve our understanding of neural computation in dopamine neurons.</p></div>\",\"PeriodicalId\":19146,\"journal\":{\"name\":\"Neuroscience Research\",\"volume\":\"199 \",\"pages\":\"Pages 12-20\"},\"PeriodicalIF\":2.4000,\"publicationDate\":\"2024-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S0168010223001384/pdfft?md5=1eca1a91d1806ae97bd932bec1e1e9e4&pid=1-s2.0-S0168010223001384-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neuroscience Research\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0168010223001384\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"NEUROSCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neuroscience Research","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168010223001384","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"NEUROSCIENCES","Score":null,"Total":0}
Prediction error in dopamine neurons during associative learning
Dopamine neurons have long been thought to facilitate learning by broadcasting reward prediction error (RPE), a teaching signal used in machine learning, but more recent work has advanced alternative models of dopamine’s computational role. Here, I revisit this critical issue and review new experimental evidences that tighten the link between dopamine activity and RPE. First, I introduce the recent observation of a gradual backward shift of dopamine activity that had eluded researchers for over a decade. I also discuss several other findings, such as dopamine ramping, that were initially interpreted to conflict but later found to be consistent with RPE. These findings improve our understanding of neural computation in dopamine neurons.
期刊介绍:
The international journal publishing original full-length research articles, short communications, technical notes, and reviews on all aspects of neuroscience
Neuroscience Research is an international journal for high quality articles in all branches of neuroscience, from the molecular to the behavioral levels. The journal is published in collaboration with the Japan Neuroscience Society and is open to all contributors in the world.