{"title":"t型迷宫环境中序列运动学习中缺陷相关驱动作用的计算模型","authors":"Wei Li, Jeffrey D. Johnson","doi":"10.1109/BIBE.2003.1188962","DOIUrl":null,"url":null,"abstract":"We present a computational model of approach teaming in a T-maze environment. We show that our model learns the correct sequence of six decisions that lead to the location of positive reinforcement and in a manner consistent with experimental observations. Our model exhibits many properties that are characteristic of animal learning in maze environments including delay conditioning, secondary conditioning, and backward chaining. Our model incorporates a comprehensive definition of drive that consists of a primary drive (food) and deficit-related signal (hunger), and an acquired drive (the learned expectation for future reward or punishment). In the T-maze environment, the deficit-related drive of hunger motivates the teaming system to search for food. After several trials in the T-maze, the acquired drive (learned expectation) will shape the teaming system's behavior and allow it to consistently find the food. We propose that changes in drive level, not merely the level of the drive, lead to teaming. Positive changes in drive level results in the enhanced behavior and negative changes result in the depressed behavior. Our comprehensive definition of drive allows us to explain teaming in a biologically plausible manner and is supported by results from hypertension, obesity, and Parkinson's disease research.","PeriodicalId":178814,"journal":{"name":"Third IEEE Symposium on Bioinformatics and Bioengineering, 2003. Proceedings.","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2003-03-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Computational model of the role of deficit-related drives in sequential movement learning in a T-maze environment\",\"authors\":\"Wei Li, Jeffrey D. Johnson\",\"doi\":\"10.1109/BIBE.2003.1188962\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We present a computational model of approach teaming in a T-maze environment. We show that our model learns the correct sequence of six decisions that lead to the location of positive reinforcement and in a manner consistent with experimental observations. Our model exhibits many properties that are characteristic of animal learning in maze environments including delay conditioning, secondary conditioning, and backward chaining. Our model incorporates a comprehensive definition of drive that consists of a primary drive (food) and deficit-related signal (hunger), and an acquired drive (the learned expectation for future reward or punishment). In the T-maze environment, the deficit-related drive of hunger motivates the teaming system to search for food. After several trials in the T-maze, the acquired drive (learned expectation) will shape the teaming system's behavior and allow it to consistently find the food. We propose that changes in drive level, not merely the level of the drive, lead to teaming. Positive changes in drive level results in the enhanced behavior and negative changes result in the depressed behavior. Our comprehensive definition of drive allows us to explain teaming in a biologically plausible manner and is supported by results from hypertension, obesity, and Parkinson's disease research.\",\"PeriodicalId\":178814,\"journal\":{\"name\":\"Third IEEE Symposium on Bioinformatics and Bioengineering, 2003. Proceedings.\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2003-03-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Third IEEE Symposium on Bioinformatics and Bioengineering, 2003. Proceedings.\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/BIBE.2003.1188962\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Third IEEE Symposium on Bioinformatics and Bioengineering, 2003. Proceedings.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/BIBE.2003.1188962","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Computational model of the role of deficit-related drives in sequential movement learning in a T-maze environment
We present a computational model of approach teaming in a T-maze environment. We show that our model learns the correct sequence of six decisions that lead to the location of positive reinforcement and in a manner consistent with experimental observations. Our model exhibits many properties that are characteristic of animal learning in maze environments including delay conditioning, secondary conditioning, and backward chaining. Our model incorporates a comprehensive definition of drive that consists of a primary drive (food) and deficit-related signal (hunger), and an acquired drive (the learned expectation for future reward or punishment). In the T-maze environment, the deficit-related drive of hunger motivates the teaming system to search for food. After several trials in the T-maze, the acquired drive (learned expectation) will shape the teaming system's behavior and allow it to consistently find the food. We propose that changes in drive level, not merely the level of the drive, lead to teaming. Positive changes in drive level results in the enhanced behavior and negative changes result in the depressed behavior. Our comprehensive definition of drive allows us to explain teaming in a biologically plausible manner and is supported by results from hypertension, obesity, and Parkinson's disease research.