灵活决策与策略学习、模仿性试验和错误以及空间集合转移过程中的内侧前额叶节律有关。

IF 1.8 4区 医学 Q4 NEUROSCIENCES
Learning & memory Pub Date : 2024-07-22 Print Date: 2024-07-01 DOI:10.1101/lm.053911.123
Jesse T Miles, Ginger L Mullins, Sheri J Y Mizumori
{"title":"灵活决策与策略学习、模仿性试验和错误以及空间集合转移过程中的内侧前额叶节律有关。","authors":"Jesse T Miles, Ginger L Mullins, Sheri J Y Mizumori","doi":"10.1101/lm.053911.123","DOIUrl":null,"url":null,"abstract":"<p><p>Flexible decision-making requires a balance between exploring features of an environment and exploiting prior knowledge. Behavioral flexibility is typically measured by how long it takes subjects to consistently make accurate choices after reward contingencies switch or task rules change. This measure, however, only allows for tracking flexibility across multiple trials, and does not assess the degree of flexibility. Plus, although increases in decision-making accuracy are strong indicators of learning, other decision-making behaviors have also been suggested as markers of flexibility, such as the on-the-fly decision reversals known as vicarious trial and error (VTE) or switches to a different, but incorrect, strategy. We sought to relate flexibility, learning, and neural activity by comparing choice history-derived evaluation of strategy use with changes in decision-making accuracy and VTE behavior while recording from the medial prefrontal cortex (mPFC) in rats. Using a set-shifting task that required rats to repeatedly switch between spatial decision-making strategies, we show that a previously developed strategy likelihood estimation procedure could identify putative learning points based on decision history. We confirm the efficacy of learning point estimation by showing increases in decision-making accuracy aligned to the learning point. Additionally, we show increases in the rate of VTE behavior surrounding identified learning points. By calculating changes in strategy likelihoods across trials, we tracked flexibility on a trial-by-trial basis and show that flexibility scores also increased around learning points. Further, we demonstrate that VTE behaviors could be separated into indecisive and deliberative subtypes depending on whether they occurred during periods of high or low flexibility and whether they led to correct or incorrect choice outcomes. Field potential recordings from the mPFC during decisions exhibited increased beta band activity on trials with VTE compared to non-VTE trials, as well as increased gamma during periods when learned strategies could be exploited compared to prelearning, exploratory periods. This study demonstrates that increased behavioral flexibility and VTE rates are often aligned to task learning. These relationships can break down, however, suggesting that VTE is not always an indicator of deliberative decision-making. Additionally, we further implicate the mPFC in decision-making and learning by showing increased beta-based activity on VTE trials and increased gamma after learning.</p>","PeriodicalId":18003,"journal":{"name":"Learning & memory","volume":null,"pages":null},"PeriodicalIF":1.8000,"publicationDate":"2024-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11369635/pdf/","citationCount":"0","resultStr":"{\"title\":\"Flexible decision-making is related to strategy learning, vicarious trial and error, and medial prefrontal rhythms during spatial set-shifting.\",\"authors\":\"Jesse T Miles, Ginger L Mullins, Sheri J Y Mizumori\",\"doi\":\"10.1101/lm.053911.123\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Flexible decision-making requires a balance between exploring features of an environment and exploiting prior knowledge. Behavioral flexibility is typically measured by how long it takes subjects to consistently make accurate choices after reward contingencies switch or task rules change. This measure, however, only allows for tracking flexibility across multiple trials, and does not assess the degree of flexibility. Plus, although increases in decision-making accuracy are strong indicators of learning, other decision-making behaviors have also been suggested as markers of flexibility, such as the on-the-fly decision reversals known as vicarious trial and error (VTE) or switches to a different, but incorrect, strategy. We sought to relate flexibility, learning, and neural activity by comparing choice history-derived evaluation of strategy use with changes in decision-making accuracy and VTE behavior while recording from the medial prefrontal cortex (mPFC) in rats. Using a set-shifting task that required rats to repeatedly switch between spatial decision-making strategies, we show that a previously developed strategy likelihood estimation procedure could identify putative learning points based on decision history. We confirm the efficacy of learning point estimation by showing increases in decision-making accuracy aligned to the learning point. Additionally, we show increases in the rate of VTE behavior surrounding identified learning points. By calculating changes in strategy likelihoods across trials, we tracked flexibility on a trial-by-trial basis and show that flexibility scores also increased around learning points. Further, we demonstrate that VTE behaviors could be separated into indecisive and deliberative subtypes depending on whether they occurred during periods of high or low flexibility and whether they led to correct or incorrect choice outcomes. Field potential recordings from the mPFC during decisions exhibited increased beta band activity on trials with VTE compared to non-VTE trials, as well as increased gamma during periods when learned strategies could be exploited compared to prelearning, exploratory periods. This study demonstrates that increased behavioral flexibility and VTE rates are often aligned to task learning. These relationships can break down, however, suggesting that VTE is not always an indicator of deliberative decision-making. Additionally, we further implicate the mPFC in decision-making and learning by showing increased beta-based activity on VTE trials and increased gamma after learning.</p>\",\"PeriodicalId\":18003,\"journal\":{\"name\":\"Learning & memory\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.8000,\"publicationDate\":\"2024-07-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11369635/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Learning & memory\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1101/lm.053911.123\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/7/1 0:00:00\",\"PubModel\":\"Print\",\"JCR\":\"Q4\",\"JCRName\":\"NEUROSCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Learning & memory","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1101/lm.053911.123","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/7/1 0:00:00","PubModel":"Print","JCR":"Q4","JCRName":"NEUROSCIENCES","Score":null,"Total":0}
引用次数: 0

摘要

灵活决策需要在探索环境特征和利用已有知识之间取得平衡。行为灵活性通常是通过受试者在奖励条件转换或任务规则改变后持续做出准确选择所需的时间来衡量的。然而,这种测量方法只能跟踪多次试验的灵活性,并不能评估灵活性的程度。此外,虽然决策准确性的提高是学习的有力指标,但其他决策行为也被认为是灵活性的标志,如被称为 "替代性试验和错误"(VTE)的即时决策逆转,或切换到不同但不正确的策略。我们试图将灵活性、学习和神经活动联系起来,方法是在记录大鼠内侧前额叶皮层(mPFC)的同时,比较由选择历史衍生的策略使用评估与决策准确性和VTE行为的变化。我们使用了一项要求大鼠在空间决策策略之间反复切换的集合转换任务,结果表明之前开发的策略可能性估计程序可以根据决策历史确定推定的学习点。我们证实了学习点估计的有效性,因为它显示了与学习点一致的决策准确性的提高。此外,我们还显示了在所识别的学习点周围 VTE 行为率的增加。通过计算各次试验中策略可能性的变化,我们对各次试验的灵活性进行了跟踪,结果表明学习点周围的灵活性得分也有所提高。此外,我们还证明,VTE 行为可根据其发生在灵活性高或低的时期,以及其导致的选择结果是正确还是错误,分为优柔寡断和深思熟虑两种亚型。在做决定时从 mPFC 进行的场电位记录显示,与非 VTE 试验相比,VTE 试验中的β波段活动增加了;与学习前的探索期相比,在学习策略可被利用的时期,γ波段活动增加了。这项研究表明,行为灵活性的提高和 VTE 率的增加往往与任务学习有关。然而,这些关系可能会破裂,这表明 VTE 并不总是慎重决策的指标。此外,我们通过显示 VTE 试验中增加的基于 beta 的活动和学习后增加的 gamma 活动,进一步揭示了 mPFC 在决策和学习中的作用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Flexible decision-making is related to strategy learning, vicarious trial and error, and medial prefrontal rhythms during spatial set-shifting.

Flexible decision-making requires a balance between exploring features of an environment and exploiting prior knowledge. Behavioral flexibility is typically measured by how long it takes subjects to consistently make accurate choices after reward contingencies switch or task rules change. This measure, however, only allows for tracking flexibility across multiple trials, and does not assess the degree of flexibility. Plus, although increases in decision-making accuracy are strong indicators of learning, other decision-making behaviors have also been suggested as markers of flexibility, such as the on-the-fly decision reversals known as vicarious trial and error (VTE) or switches to a different, but incorrect, strategy. We sought to relate flexibility, learning, and neural activity by comparing choice history-derived evaluation of strategy use with changes in decision-making accuracy and VTE behavior while recording from the medial prefrontal cortex (mPFC) in rats. Using a set-shifting task that required rats to repeatedly switch between spatial decision-making strategies, we show that a previously developed strategy likelihood estimation procedure could identify putative learning points based on decision history. We confirm the efficacy of learning point estimation by showing increases in decision-making accuracy aligned to the learning point. Additionally, we show increases in the rate of VTE behavior surrounding identified learning points. By calculating changes in strategy likelihoods across trials, we tracked flexibility on a trial-by-trial basis and show that flexibility scores also increased around learning points. Further, we demonstrate that VTE behaviors could be separated into indecisive and deliberative subtypes depending on whether they occurred during periods of high or low flexibility and whether they led to correct or incorrect choice outcomes. Field potential recordings from the mPFC during decisions exhibited increased beta band activity on trials with VTE compared to non-VTE trials, as well as increased gamma during periods when learned strategies could be exploited compared to prelearning, exploratory periods. This study demonstrates that increased behavioral flexibility and VTE rates are often aligned to task learning. These relationships can break down, however, suggesting that VTE is not always an indicator of deliberative decision-making. Additionally, we further implicate the mPFC in decision-making and learning by showing increased beta-based activity on VTE trials and increased gamma after learning.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Learning & memory
Learning & memory 医学-神经科学
CiteScore
3.60
自引率
5.00%
发文量
45
审稿时长
6-12 weeks
期刊介绍: The neurobiology of learning and memory is entering a new interdisciplinary era. Advances in neuropsychology have identified regions of brain tissue that are critical for certain types of function. Electrophysiological techniques have revealed behavioral correlates of neuronal activity. Studies of synaptic plasticity suggest that some mechanisms of memory formation may resemble those of neural development. And molecular approaches have identified genes with patterns of expression that influence behavior. It is clear that future progress depends on interdisciplinary investigations. The current literature of learning and memory is large but fragmented. Until now, there has been no single journal devoted to this area of study and no dominant journal that demands attention by serious workers in the area, regardless of specialty. Learning & Memory provides a forum for these investigations in the form of research papers and review articles.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信