Expanding the scope: multimodal dimensions in aphasia discourse analysis-preliminary findings.

IF 2.4 3区 医学 Q3 NEUROSCIENCES
Frontiers in Human Neuroscience Pub Date : 2024-09-25 eCollection Date: 2024-01-01 DOI:10.3389/fnhum.2024.1419311
Manaswita Dutta, Bijoyaa Mohapatra
{"title":"Expanding the scope: multimodal dimensions in aphasia discourse analysis-preliminary findings.","authors":"Manaswita Dutta, Bijoyaa Mohapatra","doi":"10.3389/fnhum.2024.1419311","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Aphasia, resulting from acquired brain injury, disrupts language processing and usage, significantly impacting individuals' social communication and life participation. Given the limitations of traditional assessments in capturing the nuanced challenges faced by individuals with aphasia, this study seeks to explore the potential benefits of integrating multimodal communication elements into discourse analysis to better capture narrative proficiency in this population.</p><p><strong>Objective: </strong>This study examined how incorporating multimodal communication elements (e.g., physical gestures, writing, drawing) into discourse analysis may affect the narrative outcomes of persons with aphasia compared to those observed using methods that exclude multimodal considerations.</p><p><strong>Methods: </strong>Participants included individuals with chronic aphasia and age-and education-matched healthy controls who completed a storytelling task-the Bear and the Fly story. Macrolinguistic scores were obtained using verbal-only and multimodal scoring approaches. Additionally, the frequency and type of multimodal communication use during storytelling were examined in relation to aphasia characteristics. Statistical analyses included both within-group and between-group comparisons as well as correlational analyses.</p><p><strong>Results: </strong>Individuals with aphasia scored significantly higher in terms of their macrolinguistic abilities when multimodal scoring was considered compared to verbal-only scoring. Within the aphasia group, there were prominent differences noted in macrolinguistic scores for both fluent and nonfluent aphasia. Specifically, both groups scored higher on Main Concepts when multimodal scoring was considered, with the nonfluent group demonstrating significantly higher Main Concept and total macrolinguistic rubric scores in multimodal scoring compared to verbal scoring on the storytelling task. Additionally, aphasia severity showed moderate positive correlations with total macrolinguistic scores, indicating that individuals with less severe aphasia tended to produce higher quality narratives. Lastly, although persons with aphasia used different types of nonverbal modalities (i.e., drawing, writing), the use of meaning-laden gestures was most predominant during storytelling, emphasizing the importance of multimodal elements in communication for individuals with aphasia.</p><p><strong>Conclusion: </strong>Our preliminary study findings underscore the importance of considering multimodal communication in assessing discourse performance among individuals with aphasia. Tailoring assessment approaches based on aphasia subtypes can provide valuable insights into linguistic abilities and inform targeted intervention strategies for improving communication outcomes.</p>","PeriodicalId":12536,"journal":{"name":"Frontiers in Human Neuroscience","volume":"18 ","pages":"1419311"},"PeriodicalIF":2.4000,"publicationDate":"2024-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11461255/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in Human Neuroscience","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3389/fnhum.2024.1419311","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"Q3","JCRName":"NEUROSCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Aphasia, resulting from acquired brain injury, disrupts language processing and usage, significantly impacting individuals' social communication and life participation. Given the limitations of traditional assessments in capturing the nuanced challenges faced by individuals with aphasia, this study seeks to explore the potential benefits of integrating multimodal communication elements into discourse analysis to better capture narrative proficiency in this population.

Objective: This study examined how incorporating multimodal communication elements (e.g., physical gestures, writing, drawing) into discourse analysis may affect the narrative outcomes of persons with aphasia compared to those observed using methods that exclude multimodal considerations.

Methods: Participants included individuals with chronic aphasia and age-and education-matched healthy controls who completed a storytelling task-the Bear and the Fly story. Macrolinguistic scores were obtained using verbal-only and multimodal scoring approaches. Additionally, the frequency and type of multimodal communication use during storytelling were examined in relation to aphasia characteristics. Statistical analyses included both within-group and between-group comparisons as well as correlational analyses.

Results: Individuals with aphasia scored significantly higher in terms of their macrolinguistic abilities when multimodal scoring was considered compared to verbal-only scoring. Within the aphasia group, there were prominent differences noted in macrolinguistic scores for both fluent and nonfluent aphasia. Specifically, both groups scored higher on Main Concepts when multimodal scoring was considered, with the nonfluent group demonstrating significantly higher Main Concept and total macrolinguistic rubric scores in multimodal scoring compared to verbal scoring on the storytelling task. Additionally, aphasia severity showed moderate positive correlations with total macrolinguistic scores, indicating that individuals with less severe aphasia tended to produce higher quality narratives. Lastly, although persons with aphasia used different types of nonverbal modalities (i.e., drawing, writing), the use of meaning-laden gestures was most predominant during storytelling, emphasizing the importance of multimodal elements in communication for individuals with aphasia.

Conclusion: Our preliminary study findings underscore the importance of considering multimodal communication in assessing discourse performance among individuals with aphasia. Tailoring assessment approaches based on aphasia subtypes can provide valuable insights into linguistic abilities and inform targeted intervention strategies for improving communication outcomes.

扩大范围:失语症话语分析中的多模态维度--初步发现。
背景:后天性脑损伤导致的失语症会破坏语言的处理和使用,严重影响患者的社会交流和生活参与。鉴于传统评估在捕捉失语症患者所面临的细微挑战方面存在局限性,本研究试图探索将多模态交流元素融入话语分析的潜在益处,以更好地捕捉这一人群的叙事能力:本研究探讨了在话语分析中融入多模态交流元素(如肢体手势、书写、绘画)与使用排除多模态因素的方法所观察到的结果相比,会如何影响失语症患者的叙述结果:参与者包括慢性失语症患者和年龄与教育程度相匹配的健康对照组,他们都完成了讲故事任务--熊和苍蝇的故事。采用纯言语和多模态评分法获得宏观语言评分。此外,还研究了讲故事过程中使用多模态交流的频率和类型与失语症特征的关系。统计分析包括组内和组间比较以及相关分析:结果:与仅使用口头语言评分相比,使用多模态评分时,失语症患者的宏观语言能力得分明显更高。在失语症组中,流利性和非流利性失语症患者的宏观语言能力得分存在明显差异。具体来说,在考虑多模态评分时,两组的主要概念得分都较高,其中非流利组在讲故事任务中的主要概念和宏观语言评分标准总分在多模态评分中明显高于口头评分。此外,失语症的严重程度与宏观语言学总分呈中度正相关,表明失语症程度较轻的人往往能创作出更高质量的叙事。最后,虽然失语症患者使用了不同类型的非语言模式(如绘画、书写),但在讲故事的过程中,使用意义丰富的手势是最主要的,这强调了多模式元素在失语症患者交流中的重要性:我们的初步研究结果强调了在评估失语症患者的话语表现时考虑多模态交流的重要性。根据失语症亚型调整评估方法可以为语言能力提供有价值的见解,并为改善交流结果的针对性干预策略提供依据。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Frontiers in Human Neuroscience
Frontiers in Human Neuroscience 医学-神经科学
CiteScore
4.70
自引率
6.90%
发文量
830
审稿时长
2-4 weeks
期刊介绍: Frontiers in Human Neuroscience is a first-tier electronic journal devoted to understanding the brain mechanisms supporting cognitive and social behavior in humans, and how these mechanisms might be altered in disease states. The last 25 years have seen an explosive growth in both the methods and the theoretical constructs available to study the human brain. Advances in electrophysiological, neuroimaging, neuropsychological, psychophysical, neuropharmacological and computational approaches have provided key insights into the mechanisms of a broad range of human behaviors in both health and disease. Work in human neuroscience ranges from the cognitive domain, including areas such as memory, attention, language and perception to the social domain, with this last subject addressing topics, such as interpersonal interactions, social discourse and emotional regulation. How these processes unfold during development, mature in adulthood and often decline in aging, and how they are altered in a host of developmental, neurological and psychiatric disorders, has become increasingly amenable to human neuroscience research approaches. Work in human neuroscience has influenced many areas of inquiry ranging from social and cognitive psychology to economics, law and public policy. Accordingly, our journal will provide a forum for human research spanning all areas of human cognitive, social, developmental and translational neuroscience using any research approach.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信