American Journal of Speech-Language Pathology最新文献

筛选
英文 中文
Stuttering Representation on X: A Detailed Analysis of Content, Sentiment, and Influences. X上的口吃表征:内容、情绪和影响的详细分析。
IF 2.3 3区 医学
American Journal of Speech-Language Pathology Pub Date : 2025-05-02 DOI: 10.1044/2025_AJSLP-24-00375
Amir Hossein Rasoli Jokar, Hamid Karimi, J Scott Yaruss
{"title":"Stuttering Representation on X: A Detailed Analysis of Content, Sentiment, and Influences.","authors":"Amir Hossein Rasoli Jokar, Hamid Karimi, J Scott Yaruss","doi":"10.1044/2025_AJSLP-24-00375","DOIUrl":"https://doi.org/10.1044/2025_AJSLP-24-00375","url":null,"abstract":"<p><strong>Background and aims: </strong>Social media shapes public perceptions of various topics, including health conditions and communication challenges, such as stuttering. This study analyzed the stuttering-related posts on X (formerly Twitter), a platform chosen for its unique features, including real-time interaction, concise messaging, and public accessibility. X's hashtag system also enables efficient tracking of trends and aggregating relevant posts, making it ideal for thematic and sentiment analysis. This study examined X to explore how stuttering is represented and perceived in top stuttering-related posts. It focused on these posts' themes, sentiments, and engagement patterns, as well as their influence on perceptions of stuttering on the platform.</p><p><strong>Method: </strong>In this exploratory study, data from 153 highly engaged posts containing the hashtag \"#stuttering\" were analyzed using sentiment analysis, thematic analysis, and network analysis. Posts were selected based on engagement scores calculated from the number of likes, comments, and reposts.</p><p><strong>Results: </strong>The sentiment analysis revealed that 69.93% of posts conveyed positive sentiments, with the majority of these posted by self-identified stuttering advocates, while 6.54% reflected negative sentiments and 23.53% were neutral. Five key themes emerged from the data: (a) celebrating stuttering success, (b) enhancing awareness and education about stuttering, (c) navigating challenges through support, (d) addressing misconceptions and reducing stigma, and (e) systematic advocacy and policy reform. Network analysis reflected the critical role of health care professionals and advocacy organizations in shaping public perceptions.</p><p><strong>Conclusions: </strong>This study highlighted both the supportive and stigmatizing aspects of stuttering representation on X. While prominent figures and organizations drive positive engagement, targeted efforts are still needed to address negative stereotypes. These findings provide insights for future public health communication and advocacy strategies in the stuttering community.</p>","PeriodicalId":49240,"journal":{"name":"American Journal of Speech-Language Pathology","volume":" ","pages":"1-14"},"PeriodicalIF":2.3,"publicationDate":"2025-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144034482","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparing Self-Efficacy, Self-Compassion, and Growth Mindset Among Adults With and Without Traumatic Brain Injury. 创伤性脑损伤与非创伤性脑损伤成人自我效能、自我同情和成长心态的比较
IF 2.3 3区 医学
American Journal of Speech-Language Pathology Pub Date : 2025-05-02 DOI: 10.1044/2025_AJSLP-24-00327
Danielle H Girard, Leah L Kapa, Kristen Ackley
{"title":"Comparing Self-Efficacy, Self-Compassion, and Growth Mindset Among Adults With and Without Traumatic Brain Injury.","authors":"Danielle H Girard, Leah L Kapa, Kristen Ackley","doi":"10.1044/2025_AJSLP-24-00327","DOIUrl":"https://doi.org/10.1044/2025_AJSLP-24-00327","url":null,"abstract":"<p><strong>Purpose: </strong>We investigated whether performance on predictors of academic achievement, namely, self-efficacy, self-compassion, and growth mindset, differ between adults, primarily college students, with a history of traumatic brain injury (TBI) and their peers without TBI history.</p><p><strong>Method: </strong>Eighty-nine respondents anonymously completed an online survey that included demographic questions and three predictive measures of academic achievement: the New General Self-Efficacy Scale (NGSE), the Self-Compassion Scale-Short Form (SCS-SF), and the Growth Mindset Scale. An additional 12 participants with TBI from a previous study (Ackley, 2022) were included in our data analyses, which compared results between participants with and without a TBI history.</p><p><strong>Results: </strong>At the group level, respondents with a TBI history demonstrated a significantly higher growth mindset than uninjured peers. An age- and gender-matched comparison of a smaller subsample of college student participants confirmed the group difference on growth mindset and revealed higher self-efficacy scores among the student group with a TBI history.</p><p><strong>Conclusions: </strong>As a group, individuals with TBI did not demonstrate significant differences on self-efficacy and self-compassion measures relative to uninjured peers and also demonstrated higher growth mindset. Thus, evidence does not support the assumption that these are areas of deficit for individuals with TBI history, which suggests that the NGSE, the SCS-SF, and the Growth Mindset Scale are not meaningful ways of measuring progress during cognitive-linguistic treatment in college students who have sustained TBIs unless an individual demonstrates specific deficits in these areas.</p>","PeriodicalId":49240,"journal":{"name":"American Journal of Speech-Language Pathology","volume":" ","pages":"1-15"},"PeriodicalIF":2.3,"publicationDate":"2025-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144056422","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Understanding Problems in Communication and Cognition Experienced by Uninsured Individuals Following Brain and Spinal Cord Injuries. 了解无保险个体在脑和脊髓损伤后的沟通和认知问题。
IF 2.3 3区 医学
American Journal of Speech-Language Pathology Pub Date : 2025-04-29 DOI: 10.1044/2025_AJSLP-24-00093
Juliet Haarbauer-Krupa, Tracey Wallace, Dajuandra Eugene, Jordan Tucker, Susan Johnson
{"title":"Understanding Problems in Communication and Cognition Experienced by Uninsured Individuals Following Brain and Spinal Cord Injuries.","authors":"Juliet Haarbauer-Krupa, Tracey Wallace, Dajuandra Eugene, Jordan Tucker, Susan Johnson","doi":"10.1044/2025_AJSLP-24-00093","DOIUrl":"10.1044/2025_AJSLP-24-00093","url":null,"abstract":"<p><strong>Purpose: </strong>Uninsured individuals who experience brain injury and spinal cord injury (SCI) may not have access to health care services following their injury. We describe the demographic characteristics and reported problems in communication and cognition of individuals attending the Georgia Rehabilitation Services Volunteer Partnership (RSVP) Clinic, a free clinic that provides rehabilitative care to uninsured and underinsured individuals who experience these injuries.</p><p><strong>Method: </strong>Descriptive statistics examined at admission include injury type, age, race/ethnicity, highest level of education completed, employment status, and insurance type. Clinic participants are asked if they experience problems with having a conversation, reading, writing/typing, remembering things, paying attention, making decisions/solving problems, and the importance of addressing these areas in clinic.</p><p><strong>Results: </strong>Of the 63 participants, 49% had an acquired brain injury (ABI) and 56% had an SCI. Individuals served in our clinic have a mean age of 38 years old, are primarily male (68%), are Black or African American (75%), and were unemployed at the time of admission (98%). Fifty-seven individuals (ABI = 29, SCI = 30, dual ABI and SCI = 2) responded to questions about difficulties in communication and cognition at clinic intake of which 40 of those individuals identified one or more challenges in these areas. Writing/typing was the most prevalent communication complaint, whereas remembering was the most frequently reported cognitive challenge. One participant completed these questions at clinic discharge, demonstrating improvement in communication and cognition.</p><p><strong>Conclusions: </strong>The Georgia RSVP Clinic provides opportunity to understand uninsured adults who experience a brain injury or SCI. Clinic data provide insight on important patient experiences related to problems with communication and cognition. The clinic offers a unique opportunity to observe the \"invisible\" population of individuals who experience brain injury and SCI who do not have access to resources in Georgia.</p>","PeriodicalId":49240,"journal":{"name":"American Journal of Speech-Language Pathology","volume":" ","pages":"1-7"},"PeriodicalIF":2.3,"publicationDate":"2025-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144058782","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Speech-Language Pathologists' Perspectives On Virtual Reality for Childhood Traumatic Brain Injury. 语言病理学家对儿童创伤性脑损伤虚拟现实的看法。
IF 2.3 3区 医学
American Journal of Speech-Language Pathology Pub Date : 2025-04-28 DOI: 10.1044/2025_AJSLP-24-00416
Jessica Salley Riccardi, Paul D S Fink, Justin R Brown, Helen Murray-James
{"title":"Speech-Language Pathologists' Perspectives On Virtual Reality for Childhood Traumatic Brain Injury.","authors":"Jessica Salley Riccardi, Paul D S Fink, Justin R Brown, Helen Murray-James","doi":"10.1044/2025_AJSLP-24-00416","DOIUrl":"https://doi.org/10.1044/2025_AJSLP-24-00416","url":null,"abstract":"<p><strong>Purpose: </strong>Although evidence supports virtual reality (VR) applications in rehabilitation and education, investigations into VR technology for children with traumatic brain injury (TBI) are still evolving and lack robust evidence related to design or effectiveness. The purpose of the present study was to understand the perspectives of speech-language pathologists (SLPs) for designing VR tools that are acceptable and feasible for clinical practice.</p><p><strong>Method: </strong>Thirty-one SLPs completed a self-administered online survey related to their awareness and opinions on VR and its potential application to childhood TBI broadly and within a case study of a child with TBI. Data were analyzed descriptively and using a modified version of systematic text condensation.</p><p><strong>Results: </strong>Participants, on average, reported being \"somewhat aware\" of VR and \"neither not aware or unaware\" of the idea of VR as a clinical tool. Participants generally had positive ratings for the potential use of VR to childhood TBI generally and in response to a case study centered on cognitive-communication skills. Through open-ended questions, participants identified various (a) benefits (e.g., ability for VR to simulate functional tasks or contexts) or (b) hesitations or challenges (e.g., limitations related to client ability, lack of equipment access) for using VR with children with brain injury related to design and implementation.</p><p><strong>Conclusion: </strong>Although further development and translation research is needed, the perspectives of SLPs included in the present study can be utilized to inform future development and implementation efforts to ensure VR design that is inclusive, participatory, and best fit to future SLP practice with children with TBI.</p>","PeriodicalId":49240,"journal":{"name":"American Journal of Speech-Language Pathology","volume":" ","pages":"1-15"},"PeriodicalIF":2.3,"publicationDate":"2025-04-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144044976","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Narrative Discourse Intervention for Patients in Posttraumatic Amnesia: A Feasibility Study. 创伤后失忆症患者叙事话语干预的可行性研究。
IF 2.3 3区 医学
American Journal of Speech-Language Pathology Pub Date : 2025-04-23 DOI: 10.1044/2025_AJSLP-24-00096
Aashna Vazirani, Martin Checklin, Adam McKay, Dean McKenzie, Joanne Steel
{"title":"Narrative Discourse Intervention for Patients in Posttraumatic Amnesia: A Feasibility Study.","authors":"Aashna Vazirani, Martin Checklin, Adam McKay, Dean McKenzie, Joanne Steel","doi":"10.1044/2025_AJSLP-24-00096","DOIUrl":"https://doi.org/10.1044/2025_AJSLP-24-00096","url":null,"abstract":"<p><strong>Purpose: </strong>Recent INCOG 2.0 guidelines for posttraumatic amnesia (PTA) recommend commencing multidisciplinary functional intervention for patients who do not demonstrate severe behavioral disturbance. This pilot feasibility study aimed to determine if people with traumatic brain injury (TBI) could engage in a narrative discourse intervention during PTA.</p><p><strong>Method: </strong>A narrative discourse intervention was developed based on existing evidence for discourse treatment and allied health treatments with patients in PTA. The study setting was a TBI-specific facility. Participants were screened on ward admission for PTA status and received daily discourse intervention comprising a story retell with visual supports and self-generated task during PTA. Measures included the Pittsburgh Rehabilitation Participation Scale (PRPS), the Agitated Behavior Scale (ABS), number of sessions attended, length of session, narrative organization, and patient enjoyment of sessions.</p><p><strong>Results: </strong>Ten patients participated in this pilot study, in a total of 56 sessions overall. Average session duration was approximately 25 min. Participation (PRPS) scores ranged from 3 to 5 (<i>good</i> to <i>very good</i>), and agitation scores were mostly within normal limits on the ABS. Narrative samples produced with picture supports were more organized than self-generated samples. Participants reported enjoying sessions.</p><p><strong>Conclusions: </strong>Discourse intervention conducted in the early PTA recovery period was feasible for this cohort, within a specialized TBI setting. Future research is required to examine the feasibility of intervention with patients in PTA in other settings, and the potential efficacy of narrative discourse intervention during PTA.</p>","PeriodicalId":49240,"journal":{"name":"American Journal of Speech-Language Pathology","volume":" ","pages":"1-14"},"PeriodicalIF":2.3,"publicationDate":"2025-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144062864","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
"Do I Need Anything More Specific?": Experiences of Autistic Participants in a Language-Focused Research Study. “我还需要更具体的说明吗?”:一项以语言为中心的研究中自闭症参与者的经验。
IF 2.3 3区 医学
American Journal of Speech-Language Pathology Pub Date : 2025-04-23 DOI: 10.1044/2025_AJSLP-24-00470
Kelly L Coburn, Emma P Shipley
{"title":"\"Do I Need Anything More Specific?\": Experiences of Autistic Participants in a Language-Focused Research Study.","authors":"Kelly L Coburn, Emma P Shipley","doi":"10.1044/2025_AJSLP-24-00470","DOIUrl":"https://doi.org/10.1044/2025_AJSLP-24-00470","url":null,"abstract":"<p><strong>Background: </strong>Autistic advocates have called for researchers to engage with the needs and experiences of autistic people when planning and designing research studies. The purpose of the present study was to better understand the experiences of autistic adults participating in a language research study and how researchers can design more accessible future studies.</p><p><strong>Method: </strong>The present study was a secondary thematic analysis of data recorded during a larger study of spoken narratives by autistic adults. During virtual research interviews, participants frequently expressed comments about the nature of the research tasks and their experiences of participation in the study. The full interview transcripts were analyzed to identify data relating to participants' subjective experiences of research participation. Thematic analysis was applied to transcripts of all comments not directly elicited by the structured narrative prompts.</p><p><strong>Results: </strong>Four main topics and their subthemes were established based on analysis of the data set: processing strategies, attitudes toward research, awareness of the research process, and self-reflective comments about the narrative tasks. The main topics and their subthemes are discussed to derive insight into the experiences of autistic research participants.</p><p><strong>Discussion: </strong>The findings are especially relevant to researchers and practitioners who conduct spoken language tasks with autistic people. To make research participation more accessible and affirming for autistic people, researchers can share specific information about what to expect before, during, and after participation.</p>","PeriodicalId":49240,"journal":{"name":"American Journal of Speech-Language Pathology","volume":" ","pages":"1-11"},"PeriodicalIF":2.3,"publicationDate":"2025-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144023042","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Pilot Study of Listening Fatigue: Impacts of Pediatric Dysarthria on Adult Listeners. 听力疲劳的初步研究:儿童构音障碍对成人听者的影响。
IF 2.3 3区 医学
American Journal of Speech-Language Pathology Pub Date : 2025-04-04 DOI: 10.1044/2024_AJSLP-24-00259
Jennifer U Soriano, Tristan J Mahr, Paul J Rathouz, Katherine C Hustad
{"title":"A Pilot Study of Listening Fatigue: Impacts of Pediatric Dysarthria on Adult Listeners.","authors":"Jennifer U Soriano, Tristan J Mahr, Paul J Rathouz, Katherine C Hustad","doi":"10.1044/2024_AJSLP-24-00259","DOIUrl":"https://doi.org/10.1044/2024_AJSLP-24-00259","url":null,"abstract":"<p><strong>Purpose: </strong>We sought to characterize fatigue of adults when listening to speech of children with cerebral palsy (CP).</p><p><strong>Method: </strong>Fifty-seven children with CP (19 without dysarthria and 38 with dysarthria) produced single-word and multiword speech samples. One hundred fourteen adult listeners completed transcription intelligibility tasks and provided listening fatigue ratings. Multiword utterances were analyzed in terms of speech rate and communication efficiency.</p><p><strong>Results: </strong>Intraclass correlations showed large individual differences for listening fatigue ratings. Pearson correlations showed negative relationships between listening fatigue and intelligibility; however, the magnitude varied depending upon utterance length and dysarthria status of child speakers. Pearson correlations between listening fatigue and speech rate and between listening fatigue and communication efficiency varied depending upon dysarthria status of child speakers. Welch's <i>t</i> test showed that listeners of children with dysarthria had higher fatigue ratings than listeners of children without dysarthria. Listeners of children with dysarthria were more fatigued following multiword utterances than single-word utterances. Best subset regression showed that the combined effect of dysarthria status, intelligibility, and speech rate best explained listening fatigue of adult listeners.</p><p><strong>Conclusions: </strong>Listeners had increased levels of fatigue when they heard dysarthric speech relative to nondysarthric speech. The needs of both speaker and listener should be considered when supporting children with CP and dysarthria to achieve successful communication.</p>","PeriodicalId":49240,"journal":{"name":"American Journal of Speech-Language Pathology","volume":" ","pages":"1-16"},"PeriodicalIF":2.3,"publicationDate":"2025-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143784616","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring Person-Centered Goals in Speech-Language Pathology Services for Mild Traumatic Brain Injury. 探讨轻度创伤性脑损伤言语病理服务中以人为本的目标。
IF 2.3 3区 医学
American Journal of Speech-Language Pathology Pub Date : 2025-04-03 DOI: 10.1044/2025_AJSLP-24-00117
Tracey Wallace, Yalian Pei, Amy M Kemp, Rebecca Gartell, Cheryl Appleberry, Russell K Gore, Katy H O'Brien
{"title":"Exploring Person-Centered Goals in Speech-Language Pathology Services for Mild Traumatic Brain Injury.","authors":"Tracey Wallace, Yalian Pei, Amy M Kemp, Rebecca Gartell, Cheryl Appleberry, Russell K Gore, Katy H O'Brien","doi":"10.1044/2025_AJSLP-24-00117","DOIUrl":"https://doi.org/10.1044/2025_AJSLP-24-00117","url":null,"abstract":"<p><strong>Purpose: </strong>Person-centered goals represent meaningful and motivating aspirations of patients and help rehabilitation professionals shape treatment plans to meet individual needs. The purpose of this research note is to describe person-centered goals identified among individuals receiving speech-language pathology services after mild traumatic brain injury (mTBI) and to consider how goals might be informed by existing self-report measures and guide treatment planning.</p><p><strong>Method: </strong>Using a retrospective chart review approach, we extracted person-centered goals of patients between the ages of 14 and 65 years who received care from a speech-language pathologist at an outpatient specialty concussion clinic between August 2019 and March 2020. Goals were coded according to impairment, activity, and participation domains; environmental setting; treatment domain; rehabilitative expectation (restorative or compensatory); as well as by alignment with items in a concussion symptom scale. Three reviewers independently coded goals, with discrepancies in ratings resolved through consensus. Data were analyzed descriptively.</p><p><strong>Results: </strong>In total, 59 patient charts met inclusion criteria. Mean patient age was 31.85 (<i>SD</i> = 17.31). Most goals were at the activity level (46%), followed by participation (32%), and impairment (22%). Return to productivity was central to patient goals, with almost half addressing return to school (49%) and 21% specifying return to work. By domain, goals were primarily cognitive in nature (62%), followed by communication (13%), emotional regulation (13%), or unspecified (12%). Almost all goals were restorative (86%). Just 37% of goals were represented on the symptom scale, as expected, those that were reflected cognitive needs.</p><p><strong>Conclusion: </strong>Person-centered goals are not well captured by standard mTBI symptom scales, thus emphasizing a need for rehabilitation providers to use problem-focused interviewing, motivational interviewing, or other person-centered methods to identify personally relevant and meaningful goals in this population.</p>","PeriodicalId":49240,"journal":{"name":"American Journal of Speech-Language Pathology","volume":" ","pages":"1-11"},"PeriodicalIF":2.3,"publicationDate":"2025-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143773954","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Large Language Models' Ability to Assess Main Concepts in Story Retelling: A Proof-of-Concept Comparison of Human Versus Machine Ratings. 大型语言模型在故事复述中评估主要概念的能力:人类与机器评级的概念验证比较。
IF 2.3 3区 医学
American Journal of Speech-Language Pathology Pub Date : 2025-03-31 DOI: 10.1044/2025_AJSLP-24-00400
Jacquie Kurland, Vishnupriya Varadharaju, Anna Liu, Polly Stokes, Ankita Gupta, Marisa Hudspeth, Brendan O'Connor
{"title":"Large Language Models' Ability to Assess Main Concepts in Story Retelling: A Proof-of-Concept Comparison of Human Versus Machine Ratings.","authors":"Jacquie Kurland, Vishnupriya Varadharaju, Anna Liu, Polly Stokes, Ankita Gupta, Marisa Hudspeth, Brendan O'Connor","doi":"10.1044/2025_AJSLP-24-00400","DOIUrl":"https://doi.org/10.1044/2025_AJSLP-24-00400","url":null,"abstract":"<p><strong>Purpose: </strong>Despite an abundance of manual, labor-intensive discourse analysis methods, there remains a dearth of clinically convenient, psychometrically robust instruments to measure change in real-world communication in aphasia. The Brief Assessment of Transactional Success (BATS) addresses this gap while developing automated methods for analyzing story retelling discourse. This study investigated automation of main concept (MC) analysis of stories by comparing scores from three large language models (LLMs) to those of human raters.</p><p><strong>Method: </strong>After watching/listening to each of the eight short video/audio BATS stimuli and retelling each story, 96 persons with aphasia (PWA; <i>n</i> = 48 female) engaged in topic-constrained conversations over Zoom with 94 familiar and 107 unfamiliar conversation partners (CPs). CPs then retold each story as co-constructed during their conversations with PWA. Audio files from the resulting 1,760 story retells were transcribed using Python and AssemblyAI's speech-to-text application programming interface. Each MC was first scored by human raters for presence, accuracy, and completeness. Raters used a semiautomated application, MainConcept. For each transcript, an MC composite ratio score was obtained. We evaluated three state-of-the-art LLMs: two proprietary models, GPT-4 and GPT-4o, and one open-source model, Llama-3-70B. The interrater reliability between each LLM versus human MC scoring was assessed via the Pearson correlation coefficient and reliability coefficients based on the generalizability theory (G-theory).</p><p><strong>Results: </strong>The Pearson correlation coefficients indicate strong positive linear relationships between LLM and human MC scores. G-theory reliability coefficients also indicate reliable scoring between LLM and human scoring across the spectrum of participants and conditions.</p><p><strong>Conclusions: </strong>This promising proof-of-concept study affirms the reliability of three LLMs in evaluating BATS story retell MCs and justifies ongoing investigation into their use. Providing clinicians and clinical researchers with automated tools for analyzing discourse without the need for prohibitively labor-intensive manual scoring could be a paradigm shift, potentially revolutionizing the aphasia intervention landscape.</p>","PeriodicalId":49240,"journal":{"name":"American Journal of Speech-Language Pathology","volume":" ","pages":"1-11"},"PeriodicalIF":2.3,"publicationDate":"2025-03-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143755459","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Speech Sound Production in Australian English-Dutch Bilingual Children. 澳大利亚英语-荷兰语双语儿童的发音能力
IF 2.3 3区 医学
American Journal of Speech-Language Pathology Pub Date : 2025-03-26 DOI: 10.1044/2024_AJSLP-24-00261
Hayo Terband, Bhavana Bhat, Anniek van Doornik
{"title":"Speech Sound Production in Australian English-Dutch Bilingual Children.","authors":"Hayo Terband, Bhavana Bhat, Anniek van Doornik","doi":"10.1044/2024_AJSLP-24-00261","DOIUrl":"https://doi.org/10.1044/2024_AJSLP-24-00261","url":null,"abstract":"<p><strong>Purpose: </strong>Determining if suspected speech errors in bilingual children are due to bilingual language acquisition or a speech sound disorder is challenging for speech-language pathologists (SLPs). This study investigates how the productions of nonword imitation (NWI) tasks of English-Dutch bilingual children differ from other speech tasks, both in direct comparison and relative to norm data.</p><p><strong>Method: </strong>Seventy-seven typically developing Australian English-Dutch bilingual children aged 4-12 years participated in this study. All children completed the Dutch test battery called the Computer Articulation Instrument. Data on language exposure were collected through parent/caregiver questionnaires.</p><p><strong>Results: </strong>The English-Dutch bilingual children scored lower than the norm data on the picture-naming and consistency task but not on NWI and diadochokinesis tasks. Specific phonological processes were more evident in bilingual children, and these patterns differed according to the task. The consistency task revealed a unique pattern of production in bilingual children.</p><p><strong>Conclusions: </strong>The results confirm that the NWI task may be the most language neutral. Detailed phonological error analysis indicates that SLPs assessing English-Dutch bilingual children should pay attention to voice onset time, fricatives, and vowels.</p>","PeriodicalId":49240,"journal":{"name":"American Journal of Speech-Language Pathology","volume":" ","pages":"1-12"},"PeriodicalIF":2.3,"publicationDate":"2025-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143732736","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信