通过使用机器学习从多模态数据中进行唤醒检测,增强生物反馈驱动的自我引导虚拟现实暴露治疗。

Q1 Computer Science
Muhammad Arifur Rahman, David J Brown, Mufti Mahmud, Matthew Harris, Nicholas Shopland, Nadja Heym, Alexander Sumich, Zakia Batool Turabee, Bradley Standen, David Downes, Yangang Xing, Carolyn Thomas, Sean Haddick, Preethi Premkumar, Simona Nastase, Andrew Burton, James Lewis
{"title":"通过使用机器学习从多模态数据中进行唤醒检测,增强生物反馈驱动的自我引导虚拟现实暴露治疗。","authors":"Muhammad Arifur Rahman,&nbsp;David J Brown,&nbsp;Mufti Mahmud,&nbsp;Matthew Harris,&nbsp;Nicholas Shopland,&nbsp;Nadja Heym,&nbsp;Alexander Sumich,&nbsp;Zakia Batool Turabee,&nbsp;Bradley Standen,&nbsp;David Downes,&nbsp;Yangang Xing,&nbsp;Carolyn Thomas,&nbsp;Sean Haddick,&nbsp;Preethi Premkumar,&nbsp;Simona Nastase,&nbsp;Andrew Burton,&nbsp;James Lewis","doi":"10.1186/s40708-023-00193-9","DOIUrl":null,"url":null,"abstract":"<p><p>Virtual reality exposure therapy (VRET) is a novel intervention technique that allows individuals to experience anxiety-evoking stimuli in a safe environment, recognise specific triggers and gradually increase their exposure to perceived threats. Public-speaking anxiety (PSA) is a prevalent form of social anxiety, characterised by stressful arousal and anxiety generated when presenting to an audience. In self-guided VRET, participants can gradually increase their tolerance to exposure and reduce anxiety-induced arousal and PSA over time. However, creating such a VR environment and determining physiological indices of anxiety-induced arousal or distress is an open challenge. Environment modelling, character creation and animation, psychological state determination and the use of machine learning (ML) models for anxiety or stress detection are equally important, and multi-disciplinary expertise is required. In this work, we have explored a series of ML models with publicly available data sets (using electroencephalogram and heart rate variability) to predict arousal states. If we can detect anxiety-induced arousal, we can trigger calming activities to allow individuals to cope with and overcome distress. Here, we discuss the means of effective selection of ML models and parameters in arousal detection. We propose a pipeline to overcome the model selection problem with different parameter settings in the context of virtual reality exposure therapy. This pipeline can be extended to other domains of interest where arousal detection is crucial. Finally, we have implemented a biofeedback framework for VRET where we successfully provided feedback as a form of heart rate and brain laterality index from our acquired multimodal data for psychological intervention to overcome anxiety.</p>","PeriodicalId":37465,"journal":{"name":"Brain Informatics","volume":"10 1","pages":"14"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10284788/pdf/","citationCount":"1","resultStr":"{\"title\":\"Enhancing biofeedback-driven self-guided virtual reality exposure therapy through arousal detection from multimodal data using machine learning.\",\"authors\":\"Muhammad Arifur Rahman,&nbsp;David J Brown,&nbsp;Mufti Mahmud,&nbsp;Matthew Harris,&nbsp;Nicholas Shopland,&nbsp;Nadja Heym,&nbsp;Alexander Sumich,&nbsp;Zakia Batool Turabee,&nbsp;Bradley Standen,&nbsp;David Downes,&nbsp;Yangang Xing,&nbsp;Carolyn Thomas,&nbsp;Sean Haddick,&nbsp;Preethi Premkumar,&nbsp;Simona Nastase,&nbsp;Andrew Burton,&nbsp;James Lewis\",\"doi\":\"10.1186/s40708-023-00193-9\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Virtual reality exposure therapy (VRET) is a novel intervention technique that allows individuals to experience anxiety-evoking stimuli in a safe environment, recognise specific triggers and gradually increase their exposure to perceived threats. Public-speaking anxiety (PSA) is a prevalent form of social anxiety, characterised by stressful arousal and anxiety generated when presenting to an audience. In self-guided VRET, participants can gradually increase their tolerance to exposure and reduce anxiety-induced arousal and PSA over time. However, creating such a VR environment and determining physiological indices of anxiety-induced arousal or distress is an open challenge. Environment modelling, character creation and animation, psychological state determination and the use of machine learning (ML) models for anxiety or stress detection are equally important, and multi-disciplinary expertise is required. In this work, we have explored a series of ML models with publicly available data sets (using electroencephalogram and heart rate variability) to predict arousal states. If we can detect anxiety-induced arousal, we can trigger calming activities to allow individuals to cope with and overcome distress. Here, we discuss the means of effective selection of ML models and parameters in arousal detection. We propose a pipeline to overcome the model selection problem with different parameter settings in the context of virtual reality exposure therapy. This pipeline can be extended to other domains of interest where arousal detection is crucial. Finally, we have implemented a biofeedback framework for VRET where we successfully provided feedback as a form of heart rate and brain laterality index from our acquired multimodal data for psychological intervention to overcome anxiety.</p>\",\"PeriodicalId\":37465,\"journal\":{\"name\":\"Brain Informatics\",\"volume\":\"10 1\",\"pages\":\"14\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-06-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10284788/pdf/\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Brain Informatics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1186/s40708-023-00193-9\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"Computer Science\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Brain Informatics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1186/s40708-023-00193-9","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Computer Science","Score":null,"Total":0}
引用次数: 1

摘要

虚拟现实暴露疗法(VRET)是一种新颖的干预技术,它允许个体在安全的环境中体验引起焦虑的刺激,识别特定的触发因素,并逐渐增加他们对感知威胁的暴露。公共演讲焦虑(PSA)是一种普遍的社交焦虑形式,其特征是在向听众演讲时产生压力性兴奋和焦虑。在自我引导的VRET中,参与者可以逐渐增加对暴露的耐受性,并随着时间的推移减少焦虑引起的唤醒和PSA。然而,创造这样一个虚拟现实环境并确定焦虑引起的唤醒或痛苦的生理指标是一个公开的挑战。环境建模、角色创作和动画、心理状态测定以及使用机器学习(ML)模型进行焦虑或压力检测同样重要,需要多学科的专业知识。在这项工作中,我们利用公开可用的数据集(使用脑电图和心率变异性)探索了一系列ML模型来预测唤醒状态。如果我们能检测到焦虑引起的觉醒,我们就能触发平静活动,让人们应对和克服痛苦。在此,我们讨论了唤醒检测中ML模型和参数的有效选择方法。我们提出了一个管道来克服虚拟现实暴露治疗中不同参数设置的模型选择问题。这个管道可以扩展到其他感兴趣的领域,在那里唤醒检测是至关重要的。最后,我们为VRET实施了一个生物反馈框架,我们成功地从我们获得的多模态数据中提供反馈,作为心率和脑侧性指数的一种形式,用于心理干预,以克服焦虑。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Enhancing biofeedback-driven self-guided virtual reality exposure therapy through arousal detection from multimodal data using machine learning.

Enhancing biofeedback-driven self-guided virtual reality exposure therapy through arousal detection from multimodal data using machine learning.

Enhancing biofeedback-driven self-guided virtual reality exposure therapy through arousal detection from multimodal data using machine learning.

Enhancing biofeedback-driven self-guided virtual reality exposure therapy through arousal detection from multimodal data using machine learning.

Virtual reality exposure therapy (VRET) is a novel intervention technique that allows individuals to experience anxiety-evoking stimuli in a safe environment, recognise specific triggers and gradually increase their exposure to perceived threats. Public-speaking anxiety (PSA) is a prevalent form of social anxiety, characterised by stressful arousal and anxiety generated when presenting to an audience. In self-guided VRET, participants can gradually increase their tolerance to exposure and reduce anxiety-induced arousal and PSA over time. However, creating such a VR environment and determining physiological indices of anxiety-induced arousal or distress is an open challenge. Environment modelling, character creation and animation, psychological state determination and the use of machine learning (ML) models for anxiety or stress detection are equally important, and multi-disciplinary expertise is required. In this work, we have explored a series of ML models with publicly available data sets (using electroencephalogram and heart rate variability) to predict arousal states. If we can detect anxiety-induced arousal, we can trigger calming activities to allow individuals to cope with and overcome distress. Here, we discuss the means of effective selection of ML models and parameters in arousal detection. We propose a pipeline to overcome the model selection problem with different parameter settings in the context of virtual reality exposure therapy. This pipeline can be extended to other domains of interest where arousal detection is crucial. Finally, we have implemented a biofeedback framework for VRET where we successfully provided feedback as a form of heart rate and brain laterality index from our acquired multimodal data for psychological intervention to overcome anxiety.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Brain Informatics
Brain Informatics Computer Science-Computer Science Applications
CiteScore
9.50
自引率
0.00%
发文量
27
审稿时长
13 weeks
期刊介绍: Brain Informatics is an international, peer-reviewed, interdisciplinary open-access journal published under the brand SpringerOpen, which provides a unique platform for researchers and practitioners to disseminate original research on computational and informatics technologies related to brain. This journal addresses the computational, cognitive, physiological, biological, physical, ecological and social perspectives of brain informatics. It also welcomes emerging information technologies and advanced neuro-imaging technologies, such as big data analytics and interactive knowledge discovery related to various large-scale brain studies and their applications. This journal will publish high-quality original research papers, brief reports and critical reviews in all theoretical, technological, clinical and interdisciplinary studies that make up the field of brain informatics and its applications in brain-machine intelligence, brain-inspired intelligent systems, mental health and brain disorders, etc. The scope of papers includes the following five tracks: Track 1: Cognitive and Computational Foundations of Brain Science Track 2: Human Information Processing Systems Track 3: Brain Big Data Analytics, Curation and Management Track 4: Informatics Paradigms for Brain and Mental Health Research Track 5: Brain-Machine Intelligence and Brain-Inspired Computing
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信