Impact of provoked stress on model-free and model-based reinforcement learning in individuals with alcohol use disorder

Q1 Psychology
Florent Wyckmans , Armand Chatard , Charles Kornreich , Damien Gruson , Nemat Jaafari , Xavier Noël
{"title":"Impact of provoked stress on model-free and model-based reinforcement learning in individuals with alcohol use disorder","authors":"Florent Wyckmans ,&nbsp;Armand Chatard ,&nbsp;Charles Kornreich ,&nbsp;Damien Gruson ,&nbsp;Nemat Jaafari ,&nbsp;Xavier Noël","doi":"10.1016/j.abrep.2024.100574","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><div>From both clinical and theoretical perspectives, understanding the functionality of evaluative reinforcement learning mechanisms (Model-Free, MF, and Model-Based, MB) under provoked stress, particularly in Alcohol Use Disorder (AUD), is crucial yet underexplored. This study aims to evaluate whether individuals with AUD who do not seek treatment show a greater tendency towards retrospective behaviors (MF) rather than prospective and deliberative simulations (MB) compared to controls. Additionally, it examines the impact of induced social stress on these decision-making processes.</div></div><div><h3>Methods</h3><div>A cohort comprising 117 participants, including 55 individuals with AUD and 62 controls, was examined. Acute social stress was induced through the socially evaluated cold pressor task (SECPT), followed by engagement in a Two-Step Markov task to assess MB and MF learning tendencies. We measured hypothalamic–pituitary–adrenal axis stress response using salivary cortisol levels.</div></div><div><h3>Results</h3><div>Both groups showed similar baseline cortisol levels and responses to the SECPT. Our findings indicate that participants with AUD exhibit a reduced reliance on MB strategies compared to those without AUD. Furthermore, stress decreases reliance on MB strategies in healthy participants, but this effect is not observed in those with AUD.</div></div><div><h3>Conclusion</h3><div>An atypical pattern of stress modulation impacting the balance between MB and MF reinforcement learning was identified in individuals with AUD who are not seeking treatment. Potential explanations for these findings and their clinical implications are explored.</div></div>","PeriodicalId":38040,"journal":{"name":"Addictive Behaviors Reports","volume":"20 ","pages":"Article 100574"},"PeriodicalIF":0.0000,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Addictive Behaviors Reports","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2352853224000518","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Psychology","Score":null,"Total":0}
引用次数: 0

Abstract

Background

From both clinical and theoretical perspectives, understanding the functionality of evaluative reinforcement learning mechanisms (Model-Free, MF, and Model-Based, MB) under provoked stress, particularly in Alcohol Use Disorder (AUD), is crucial yet underexplored. This study aims to evaluate whether individuals with AUD who do not seek treatment show a greater tendency towards retrospective behaviors (MF) rather than prospective and deliberative simulations (MB) compared to controls. Additionally, it examines the impact of induced social stress on these decision-making processes.

Methods

A cohort comprising 117 participants, including 55 individuals with AUD and 62 controls, was examined. Acute social stress was induced through the socially evaluated cold pressor task (SECPT), followed by engagement in a Two-Step Markov task to assess MB and MF learning tendencies. We measured hypothalamic–pituitary–adrenal axis stress response using salivary cortisol levels.

Results

Both groups showed similar baseline cortisol levels and responses to the SECPT. Our findings indicate that participants with AUD exhibit a reduced reliance on MB strategies compared to those without AUD. Furthermore, stress decreases reliance on MB strategies in healthy participants, but this effect is not observed in those with AUD.

Conclusion

An atypical pattern of stress modulation impacting the balance between MB and MF reinforcement learning was identified in individuals with AUD who are not seeking treatment. Potential explanations for these findings and their clinical implications are explored.
诱发应激对酒精使用障碍个体无模型和基于模型的强化学习的影响
从临床和理论的角度来看,理解诱发性压力下,特别是酒精使用障碍(AUD)中评估性强化学习机制(无模型,MF和基于模型,MB)的功能是至关重要的,但尚未得到充分探索。本研究旨在评估与对照组相比,不寻求治疗的AUD患者是否更倾向于回顾性行为(MF),而不是前瞻性和审慎模拟(MB)。此外,它还考察了诱发的社会压力对这些决策过程的影响。方法对117名参与者进行队列研究,其中55名AUD患者和62名对照组。通过社会评价冷压任务(SECPT)诱发急性社会压力,然后参与两步马尔可夫任务来评估MB和MF学习倾向。我们使用唾液皮质醇水平测量下丘脑-垂体-肾上腺轴应激反应。结果两组的基线皮质醇水平和对SECPT的反应相似。我们的研究结果表明,与没有AUD的参与者相比,AUD参与者对MB策略的依赖程度降低。此外,压力降低了健康参与者对MB策略的依赖,但在AUD患者中没有观察到这种影响。结论在不寻求治疗的AUD患者中发现了影响MB和MF强化学习平衡的非典型应激调节模式。对这些发现的潜在解释及其临床意义进行了探讨。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Addictive Behaviors Reports
Addictive Behaviors Reports Medicine-Psychiatry and Mental Health
CiteScore
6.80
自引率
0.00%
发文量
69
审稿时长
71 days
期刊介绍: Addictive Behaviors Reports is an open-access and peer reviewed online-only journal offering an interdisciplinary forum for the publication of research in addictive behaviors. The journal accepts submissions that are scientifically sound on all forms of addictive behavior (alcohol, drugs, gambling, Internet, nicotine and technology) with a primary focus on behavioral and psychosocial research. The emphasis of the journal is primarily empirical. That is, sound experimental design combined with valid, reliable assessment and evaluation procedures are a requisite for acceptance. We are particularly interested in ''non-traditional'', innovative and empirically oriented research such as negative/null data papers, replication studies, case reports on novel treatments, and cross-cultural research. Studies that might encourage new lines of inquiry as well as scholarly commentaries on topical issues, systematic reviews, and mini reviews are also very much encouraged. We also welcome multimedia submissions that incorporate video or audio components to better display methodology or findings.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信