Quantifying the diagnostic contribution of neuropsychological evaluation using natural language processing.

IF 2.6 3区 心理学 Q2 CLINICAL NEUROLOGY
Brittany Wolff, Laura Glass Umfleet, Daniel L Drane, Joseph M Gullett, Russell M Bauer, Lucia Cavanagh, Adriana M Strutt, Steven P Reise, Keith F Widaman, Douglas S Bell, April D Thames
{"title":"Quantifying the diagnostic contribution of neuropsychological evaluation using natural language processing.","authors":"Brittany Wolff, Laura Glass Umfleet, Daniel L Drane, Joseph M Gullett, Russell M Bauer, Lucia Cavanagh, Adriana M Strutt, Steven P Reise, Keith F Widaman, Douglas S Bell, April D Thames","doi":"10.1080/13854046.2026.2738661","DOIUrl":null,"url":null,"abstract":"<p><p><b>Objective:</b> Diagnostic clarification is regarded as a core function of neuropsychological evaluation, yet its impact has rarely been quantified because diagnoses are typically embedded within unstructured narrative reports. This pilot study quantified the diagnostic contribution of neuropsychological evaluation by examining diagnostic reclassification and diagnostic clarification using a novel natural language processing (NLP) pipeline. <b>Method:</b> A retrospective observational study was conducted using 220 adult outpatient neuropsychological evaluation reports from the National Neuropsychology Network. A rule-based NLP pipeline extracted and harmonized pre-evaluation referral diagnoses and post-evaluation clinician diagnoses from reports in the UCLA electronic health records into structured diagnostic profiles. Diagnostic reclassification, diagnostic specificity gain, and changes in diagnostic category distributions were quantified. Exploratory analyses examined demographic correlates of diagnostic clarification. <b>Results:</b> Diagnostic reclassification was common following neuropsychological evaluation. Overall, 87.7% of patients received at least one new diagnosis, 55.0% had at least one preexisting diagnosis not retained, and 84.5% demonstrated increased diagnostic specificity. Among patients with nonspecific cognitive symptom codes, 90.1% transitioned to formal psychiatric, neurological, or neurocognitive diagnoses. Collectively, these changes shifted diagnostic profiles away from nonspecific cognitive diagnoses toward more specific formal psychiatric and neurocognitive diagnoses (all <i>p</i> < .001). Exploratory demographic associations were modest. <b>Conclusions:</b> Neuropsychological evaluation provides substantial incremental diagnostic information beyond referral documentation by increasing diagnostic specificity and refining diagnostic formulation. These pilot findings establish diagnostic clarification as a measurable clinical outcome and demonstrate the potential of NLP to transform routine neuropsychological reports into scalable metrics for evaluating the clinical impact of neuropsychological services.</p>","PeriodicalId":55250,"journal":{"name":"Clinical Neuropsychologist","volume":" ","pages":"1-21"},"PeriodicalIF":2.6000,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical Neuropsychologist","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1080/13854046.2026.2738661","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Objective: Diagnostic clarification is regarded as a core function of neuropsychological evaluation, yet its impact has rarely been quantified because diagnoses are typically embedded within unstructured narrative reports. This pilot study quantified the diagnostic contribution of neuropsychological evaluation by examining diagnostic reclassification and diagnostic clarification using a novel natural language processing (NLP) pipeline. Method: A retrospective observational study was conducted using 220 adult outpatient neuropsychological evaluation reports from the National Neuropsychology Network. A rule-based NLP pipeline extracted and harmonized pre-evaluation referral diagnoses and post-evaluation clinician diagnoses from reports in the UCLA electronic health records into structured diagnostic profiles. Diagnostic reclassification, diagnostic specificity gain, and changes in diagnostic category distributions were quantified. Exploratory analyses examined demographic correlates of diagnostic clarification. Results: Diagnostic reclassification was common following neuropsychological evaluation. Overall, 87.7% of patients received at least one new diagnosis, 55.0% had at least one preexisting diagnosis not retained, and 84.5% demonstrated increased diagnostic specificity. Among patients with nonspecific cognitive symptom codes, 90.1% transitioned to formal psychiatric, neurological, or neurocognitive diagnoses. Collectively, these changes shifted diagnostic profiles away from nonspecific cognitive diagnoses toward more specific formal psychiatric and neurocognitive diagnoses (all p < .001). Exploratory demographic associations were modest. Conclusions: Neuropsychological evaluation provides substantial incremental diagnostic information beyond referral documentation by increasing diagnostic specificity and refining diagnostic formulation. These pilot findings establish diagnostic clarification as a measurable clinical outcome and demonstrate the potential of NLP to transform routine neuropsychological reports into scalable metrics for evaluating the clinical impact of neuropsychological services.

使用自然语言处理量化神经心理学评估的诊断贡献。
目的:诊断澄清被认为是神经心理学评估的核心功能,但其影响很少被量化,因为诊断通常嵌入在非结构化的叙述性报告中。本初步研究通过使用新颖的自然语言处理(NLP)管道检查诊断重新分类和诊断澄清,量化了神经心理学评估的诊断贡献。方法:采用国家神经心理学网络220例成人门诊神经心理学评估报告进行回顾性观察研究。基于规则的NLP管道从UCLA电子健康记录报告中提取和协调评估前转诊诊断和评估后临床医生诊断到结构化诊断概要中。对诊断再分类、诊断特异性增加和诊断类别分布的变化进行量化。探索性分析检查了诊断澄清的人口学相关性。结果:诊断性再分类在神经心理学评估后较为常见。总体而言,87.7%的患者至少接受了一项新诊断,55.0%的患者至少有一项先前存在的诊断未保留,84.5%的患者诊断特异性增加。在非特异性认知症状编码的患者中,90.1%转化为正式的精神病学、神经学或神经认知诊断。总的来说,这些变化将诊断谱从非特异性认知诊断转向更具体的正式精神病学和神经认知诊断(均p < 0.001)。探索性人口统计学关联不大。结论:神经心理学评估通过增加诊断特异性和完善诊断公式,提供了大量的诊断信息。这些初步研究结果将诊断澄清作为可测量的临床结果,并展示了NLP将常规神经心理学报告转化为可扩展指标的潜力,用于评估神经心理学服务的临床影响。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Clinical Neuropsychologist
Clinical Neuropsychologist 医学-临床神经学
CiteScore
8.40
自引率
12.80%
发文量
61
审稿时长
6-12 weeks
期刊介绍: The Clinical Neuropsychologist (TCN) serves as the premier forum for (1) state-of-the-art clinically-relevant scientific research, (2) in-depth professional discussions of matters germane to evidence-based practice, and (3) clinical case studies in neuropsychology. Of particular interest are papers that can make definitive statements about a given topic (thereby having implications for the standards of clinical practice) and those with the potential to expand today’s clinical frontiers. Research on all age groups, and on both clinical and normal populations, is considered.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书