... Workshop on Computational Linguistics and Clinical Psychology最新文献

筛选

英文中文

Bigger But Not Better: Small Neural Language Models Outperform Large Language Models in Detection of Thought Disorder. 更大但不是更好：小型神经语言模型在检测思维障碍方面优于大型语言模型。

... Workshop on Computational Linguistics and Clinical Psychology Pub Date : 2025-05-01 DOI: 10.18653/v1/2025.clpsych-1.8

Changye Li, Weizhe Xu, Serguei Pakhomov, Ellen Bradley, Dror Ben-Zeev, Trevor Cohen

{"title":"Bigger But Not Better: Small Neural Language Models Outperform Large Language Models in Detection of Thought Disorder.","authors":"Changye Li, Weizhe Xu, Serguei Pakhomov, Ellen Bradley, Dror Ben-Zeev, Trevor Cohen","doi":"10.18653/v1/2025.clpsych-1.8","DOIUrl":"10.18653/v1/2025.clpsych-1.8","url":null,"abstract":"<p><p>Disorganized thinking is a key diagnostic indicator of schizophrenia-spectrum disorders. Recently, clinical estimates of the severity of disorganized thinking have been shown to correlate with measures of how difficult speech transcripts would be for large language models (LLMs) to predict. However, LLMs' deployment challenges - including privacy concerns, computational and financial costs, and lack of transparency of training data - limit their clinical utility. We investigate whether smaller neural language models can serve as effective alternatives for detecting positive formal thought disorder, using the same sliding window based perplexity measurements that proved effective with larger models. Surprisingly, our results show that smaller models are more sensitive to linguistic differences associated with formal thought disorder than their larger counterparts. Detection capability declines beyond a certain model size and context length, challenging the common assumption of \"bigger is better\" for LLM-based applications. Our findings generalize across audio diaries and clinical interview speech samples from individuals with psychotic symptoms, suggesting a promising direction for developing efficient, cost-effective, and privacy-preserving screening tools that can be deployed in both clinical and naturalistic settings.</p>","PeriodicalId":521144,"journal":{"name":"... Workshop on Computational Linguistics and Clinical Psychology","volume":"2025 ","pages":"90-105"},"PeriodicalIF":0.0,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12677091/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145702532","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0