{"title":"Choice-confirmation bias and gradual perseveration in human reinforcement learning.","authors":"Stefano Palminteri","doi":"10.1037/bne0000541","DOIUrl":"10.1037/bne0000541","url":null,"abstract":"<p><p>Do we preferentially learn from outcomes that confirm our choices? In recent years, we investigated this question in a series of studies implementing increasingly complex behavioral protocols. The learning rates fitted in experiments featuring partial or complete feedback, as well as free and forced choices, were systematically found to be consistent with a choice-confirmation bias. One of the prominent behavioral consequences of the confirmatory learning rate pattern is choice hysteresis: that is, the tendency of repeating previous choices, despite contradictory evidence. However, choice-confirmatory pattern of learning rates may spuriously arise from not taking into consideration an explicit choice (gradual) perseveration term in the model. In the present study, we reanalyze data from four published papers (nine experiments; 363 subjects; 126,192 trials), originally included in the studies demonstrating or criticizing the choice-confirmation bias in human participants. We fitted two models: one featured valence-specific updates (i.e., different learning rates for confirmatory and disconfirmatory outcomes) and one additionally including gradual perseveration. Our analysis confirms that the inclusion of the gradual perseveration process in the model significantly reduces the estimated choice-confirmation bias. However, in all considered experiments, the choice-confirmation bias remains present at the meta-analytical level, and significantly different from zero in most experiments. Our results demonstrate that the choice-confirmation bias resists the inclusion of a gradual perseveration term, thus proving to be a robust feature of human reinforcement learning. We conclude by pointing to additional computational processes that may play an important role in estimating and interpreting the computational biases under scrutiny. (PsycInfo Database Record (c) 2023 APA, all rights reserved).</p>","PeriodicalId":8739,"journal":{"name":"Behavioral neuroscience","volume":"137 1","pages":"78-88"},"PeriodicalIF":1.9,"publicationDate":"2023-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10633696","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Michelle A Frankot, Christopher M O'Hearn, Alyssa M Blancke, Bryan Rodriguez, Kristen M Pechacek, Jasleen Gandhi, Gangqing Hu, Kris M Martens, Cole Vonder Haar
{"title":"Acute gut microbiome changes after traumatic brain injury are associated with chronic deficits in decision-making and impulsivity in male rats.","authors":"Michelle A Frankot, Christopher M O'Hearn, Alyssa M Blancke, Bryan Rodriguez, Kristen M Pechacek, Jasleen Gandhi, Gangqing Hu, Kris M Martens, Cole Vonder Haar","doi":"10.1037/bne0000532","DOIUrl":"10.1037/bne0000532","url":null,"abstract":"<p><p>The mechanisms underlying chronic psychiatric-like impairments after traumatic brain injury (TBI) are currently unknown. The goal of the present study was to assess the role of diet and the gut microbiome in psychiatric symptoms after TBI. Rats were randomly assigned to receive a high-fat diet (HFD) or calorie-matched low-fat diet (LFD). After 2 weeks of free access, rats began training on the rodent gambling task (RGT), a measure of risky decision-making and motor impulsivity. After training, rats received a bilateral frontal TBI or a sham procedure and continued postinjury testing for 10 weeks. Fecal samples were collected before injury and 3-, 30-, and 60 days postinjury to evaluate the gut microbiome. HFD altered the microbiome, but ultimately had low-magnitude effects on behavior and did not modify functional outcomes after TBI. Injury-induced functional deficits were far more robust; TBI substantially decreased optimal choice and increased suboptimal choice and motor impulsivity on the RGT. TBI also affected the microbiome, and a model comparison approach revealed that bacterial diversity measured 3 days postinjury was predictive of chronic psychiatric-like deficits on the RGT. A functional metagenomic analysis identified changes to dopamine and serotonin synthesis pathways as a potential candidate mechanism. Thus, the gut may be a potential acute treatment target for psychiatric symptoms after TBI, as well as a biomarker for injury and deficit severity. However, further research will be needed to confirm and extend these findings. (PsycInfo Database Record (c) 2023 APA, all rights reserved).</p>","PeriodicalId":8739,"journal":{"name":"Behavioral neuroscience","volume":"137 1","pages":"15-28"},"PeriodicalIF":1.9,"publicationDate":"2023-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9996537/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9813188","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ashley R Deane, Yu Jing, Reza Shoorangiz, Ping Liu, Ryan D Ward
{"title":"Cognitive and arginine metabolic correlates of temporal dysfunction in the MIA rat model of schizophrenia risk.","authors":"Ashley R Deane, Yu Jing, Reza Shoorangiz, Ping Liu, Ryan D Ward","doi":"10.1037/bne0000540","DOIUrl":"https://doi.org/10.1037/bne0000540","url":null,"abstract":"<p><p>As a hallmark characteristic of schizophrenia, abnormal perception of time is thought to arise from cognitive impairment; however, the absence of translational models indexing this pathological relationship creates barriers to understanding the functional and biological bases of timing impairments. Here, we investigate the relationship between timing and cognition using the maternal immune activation (MIA) rat model of schizophrenia. We additionally investigate the role of prefrontal cortex L-arginine metabolism in these processes via high-performance liquid chromatography and liquid chromatography/mass spectrometry. Results revealed that MIA rats exhibit greater underestimation of interval durations (2-8 s); greater underestimation corresponded with declines in sustained attention capacity. Working memory impairments were not found to contribute to timing deficits. These findings represent the first direct identification of a timing-attention relationship within rodents and are discussed with respect to the dopamine hypothesis of temporal pace. We also found that MIA exposure altered aspects of arginine metabolism as observed in schizophrenia, and we present preliminary evidence suggesting that these changes have functional consequences for cognition. These findings support the MIA rat model as a valuable tool for future investigations exploring the biological instantiation of interrelated timing and cognitive deficits in schizophrenia. (PsycInfo Database Record (c) 2023 APA, all rights reserved).</p>","PeriodicalId":8739,"journal":{"name":"Behavioral neuroscience","volume":"137 1","pages":"67-77"},"PeriodicalIF":1.9,"publicationDate":"2023-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9187190","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Supplemental Material for Effect of Striatal Dopamine on Pavlovian Bias. A Large [18F]-DOPA PET Study","authors":"","doi":"10.1037/bne0000547.supp","DOIUrl":"https://doi.org/10.1037/bne0000547.supp","url":null,"abstract":"","PeriodicalId":8739,"journal":{"name":"Behavioral neuroscience","volume":" ","pages":""},"PeriodicalIF":1.9,"publicationDate":"2023-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48483624","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Supplemental Material for The Effects of Time Horizon and Guided Choices on Explore–Exploit Decisions in Rodents","authors":"","doi":"10.1037/bne0000549.supp","DOIUrl":"https://doi.org/10.1037/bne0000549.supp","url":null,"abstract":"","PeriodicalId":8739,"journal":{"name":"Behavioral neuroscience","volume":" ","pages":""},"PeriodicalIF":1.9,"publicationDate":"2023-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48000089","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Bailey Holt-Gosselin, Emily M Cohodes, Sarah McCauley, Jordan C Foster, Paola Odriozola, Sadie J Zacharek, Sahana Kribakaran, Jason T Haberman, H R Hodges, Dylan G Gee
{"title":"Lack of robust associations between prepandemic coping strategies and frontolimbic circuitry with depression and anxiety symptoms during the COVID-19 pandemic: A preregistered longitudinal study.","authors":"Bailey Holt-Gosselin, Emily M Cohodes, Sarah McCauley, Jordan C Foster, Paola Odriozola, Sadie J Zacharek, Sahana Kribakaran, Jason T Haberman, H R Hodges, Dylan G Gee","doi":"10.1037/bne0000534","DOIUrl":"10.1037/bne0000534","url":null,"abstract":"<p><p>The COVID-19 pandemic is an ongoing stressor that has resulted in the exacerbation of mental health problems worldwide. However, longitudinal studies that identify preexisting behavioral and neurobiological factors associated with mental health outcomes during the pandemic are lacking. Here, we examined associations between prepandemic coping strategy engagement and frontolimbic circuitry with internalizing symptoms during the pandemic. In 85 adults (71.8% female; age 18-30 years), we assessed prototypically adaptive coping strategies (Connor-Davidson Resilience Scale), resting-state functional magnetic resonance imaging functional connectivity (FC) of frontolimbic circuitry, and depression and anxiety symptoms (Beck Depression Inventory, Screen for Child Anxiety-Related Emotional Disorders-Adult, respectively). We conducted general linear models to test preregistered hypotheses that (1) lower coping engagement prepandemic and (2) weaker frontolimbic FC prepandemic would predict elevated symptoms during the pandemic; and (3) coping would interact with FC to predict symptoms during the pandemic. Depression and anxiety symptoms worsened during the pandemic (ps < .001). Prepandemic adaptive coping engagement and frontolimbic FC were not associated with depression or anxiety symptoms during the pandemic (uncorrected ps > .05). Coping interacted with insula-rostral anterior cingulate cortex (ACC) FC (p = .003, pFDR = .014) and with insula-ventral ACC FC (p < .001, pFDR < .001) to predict depression symptoms, but these findings did not survive FDR correction after removal of outliers. Findings from our preregistered study suggest that specific prepandemic factors, particularly adaptive coping and frontolimbic circuitry, are not robustly associated with emotional responses to the pandemic. Additional studies that identify preexisting neurobehavioral factors implicated in mental health outcomes during global health crises are needed. (PsycInfo Database Record (c) 2022 APA, all rights reserved).</p>","PeriodicalId":8739,"journal":{"name":"Behavioral neuroscience","volume":"136 6","pages":"528-540"},"PeriodicalIF":1.9,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9884515/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9200173","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
S Alex Marshall, Stacey L Robinson, Suzahn E Ebert, Michel A Companion, Todd E Thiele
{"title":"Chemogenetic inhibition of corticotropin-releasing factor neurons in the central amygdala alters binge-like ethanol consumption in male mice.","authors":"S Alex Marshall, Stacey L Robinson, Suzahn E Ebert, Michel A Companion, Todd E Thiele","doi":"10.1037/bne0000522","DOIUrl":"10.1037/bne0000522","url":null,"abstract":"<p><p>Repetitive bouts of binge drinking can lead to neuroplastic events that alter ethanol's pharmacologic effects and perpetuate excessive consumption. The corticotropin-releasing factor (CRF) system is an example of ethanol-induced neuroadaptations that drive excessive ethanol consumption. Our laboratory has previously shown that CRF antagonist, when infused into the central amygdala (CeA), reduces binge-like ethanol consumption. The present study extends this research by assessing the effects of silencing CRF-producing neurons in CeA on binge-like ethanol drinking stemming from \"Drinking in the Dark\" (DID) procedures. CRF-ires-Cre mice underwent surgery to infuse G<sub>i/o</sub>-coupled Designer Receptors Exclusively Activated by Designer Drugs (DREADD) virus or a control virus into either the CeA or basolateral amygdala (BLA). G<sub>i/o</sub>-DREADD-induced CRF-neuronal inhibition in the CeA resulted in a 33% decrease in binge-like ethanol consumption. However, no effect on ethanol consumption was seen after DREADD manipulation in the BLA. Moreover, CeA CRF-neuronal inhibition had no effect on sucrose consumption. The effects of silencing CRF neurons in the CeA on ethanol consumption are not secondary to changes in motor function or anxiety-like behaviors as assessed in the open-field test (OFT). Finally, the DREADD construct's functional ability to inhibit CRF-neuronal activity was demonstrated by reduced ethanol-induced c-Fos following DREADD activation. Together, these data suggest that the CRF neurons in the CeA play an important role in binge ethanol consumption and that inhibition of the CRF-signaling pathway remains a viable target for manipulating binge-like ethanol consumption. (PsycInfo Database Record (c) 2022 APA, all rights reserved).</p>","PeriodicalId":8739,"journal":{"name":"Behavioral neuroscience","volume":"136 6","pages":"541-550"},"PeriodicalIF":1.9,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9671851/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9501360","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Adam W Lester, Gianna A Jordan, Colton J Blum, Zachary P Philpot, Carol A Barnes
{"title":"Differential effects in young and aged rats' navigational accuracy following instantaneous rotation of environmental cues.","authors":"Adam W Lester, Gianna A Jordan, Colton J Blum, Zachary P Philpot, Carol A Barnes","doi":"10.1037/bne0000536","DOIUrl":"10.1037/bne0000536","url":null,"abstract":"<p><p>Successful navigation depends critically upon two broad categories of spatial navigation strategies that include allocentric and egocentric reference frames, relying on external or internal spatial information, respectively. As with older adults, aged rats show robust impairments on a number of different spatial navigation tasks. There is some evidence that these navigation impairments are accompanied by a bias toward relying on egocentric over allocentric navigation strategies. To test the degree to which young and aged animals utilize these two navigation approaches, a novel behavioral arena was used in which rats are trained to traverse a circular track and to stop at a learned goal location that is fixed with respect to a panorama of visual cues projected onto the surrounding walls. By instantaneously rotating the cues, allocentric and egocentric reference frames were put in direct and immediate conflict and goal navigation performance was assessed with respect to how accurately young and aged animals were able to utilize the rotated cues. Behavioral data collected from nine young and eight aged animals revealed that both age groups were able to update their navigation performance following cue rotation. Contrary to what was expected, however, aged animals showed more accurate overall goal navigation performance, stronger allocentric strategy use, and more evident changes in behavior in response to cue rotation compared to younger animals. The young rats appeared to mix egocentric and allocentric strategies for ICR task solution. (PsycInfo Database Record (c) 2022 APA, all rights reserved).</p>","PeriodicalId":8739,"journal":{"name":"Behavioral neuroscience","volume":"136 6","pages":"561-574"},"PeriodicalIF":1.9,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10482423/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10220283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Supplemental Material for Cognitive and Arginine Metabolic Correlates of Temporal Dysfunction in the MIA Rat Model of Schizophrenia Risk","authors":"","doi":"10.1037/bne0000540.supp","DOIUrl":"https://doi.org/10.1037/bne0000540.supp","url":null,"abstract":"","PeriodicalId":8739,"journal":{"name":"Behavioral neuroscience","volume":" ","pages":""},"PeriodicalIF":1.9,"publicationDate":"2022-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44311778","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Behavioral and neurochemical effects of nociceptin/orphanin FQ receptor activation in the social defeat protocol.","authors":"Alice Barros Câmara, Igor Augusto Brandão","doi":"10.1037/bne0000539.supp","DOIUrl":"https://doi.org/10.1037/bne0000539.supp","url":null,"abstract":"The nociceptin/orphanin FQ receptor (NOP receptor) has wide expression in the nervous system and is involved in neurotransmitter release. However, the role of the NOPR in depression is not widely recognized. This study aims to evaluate behavioral and biochemical effects of the NOPR agonist Ro 65-6570 in mice submitted to social defeat protocol. The open-field test, social interaction test, and tail suspension test were applied to evaluate depressive behavior in male Swiss mice. Blood and brain tissue samples were obtained to evaluate the oxidative stress. The NOP agonist, Ro 65-6570 (1 mg/kg), or the social defeat stress reduced exploration rate in the open-field test. The social defeat stress and/or the NOP agonist also increased immobility time in the tail suspension test and the grooming time, as well as reduced the social interaction on the last day of social defeat protocol. Seven days after the end of the protocol, only the drug alone was able to affect the animals' interaction. Additionally, the NOP agonist increased the concentration of carbonyl groups (CGs) in hippocampus and malondialdehyde in serum. The stress of social defeat and the NOP agonist, together, increased malondialdehyde in animals' serum and prefrontal cortex, as well as increased the CGs concentration in the prefrontal cortex. These findings indicate a chronic depressive effect induced by the NOPR activation, sometimes regardless of the social defeat stress. We suggest that the NOPR signaling can activate pathways involved in cellular oxidative stress, contributing to the depression pathology. (PsycInfo Database Record (c) 2022 APA, all rights reserved).","PeriodicalId":8739,"journal":{"name":"Behavioral neuroscience","volume":" ","pages":""},"PeriodicalIF":1.9,"publicationDate":"2022-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48465774","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}