Jessica I Alva, Ryan C Brewster, Zanjbeel Mahmood, Kathryn M Harrell, Natalie C Kaiser, Paul Riesthuis, Kaitlyn YoungSciortino, Hannah E Brunet, Megan E Johnson, Shannon Kovach
{"title":"远程神经心理学和面对面的评估分数有意义上的不同吗?系统回顾和荟萃分析。","authors":"Jessica I Alva, Ryan C Brewster, Zanjbeel Mahmood, Kathryn M Harrell, Natalie C Kaiser, Paul Riesthuis, Kaitlyn YoungSciortino, Hannah E Brunet, Megan E Johnson, Shannon Kovach","doi":"10.1080/13854046.2025.2493343","DOIUrl":null,"url":null,"abstract":"<p><p><b>Objectives:</b> Despite growing evidence supporting tele-neuropsychology (teleNP), clinicians have voiced concerns about comparability to traditional in-person testing and the limited availability of teleNP practice guidelines. In response, we completed a PRISMA-compliant systematic review and meta-analysis to investigate mean score differences in the context of test-level administration modifications. <b>Methods:</b> Eligible studies included adult participants, within-subject designs, commonly used English-language neuropsychological tests, and mean test scores for teleNP and in-person assessment. Studies were identified in databases (ProQuest, PubMed, EBSCOhost), reference lists, forward citation searches of eligible reports, and published teleNP reviews through July 2024. A multilevel random effects meta-analysis was conducted. <b>Results:</b> Twenty-four studies including 1,197 clinically and geographically diverse participants aged 18-96 and 46 neuropsychological tests representing 11 cognitive domains were synthesized. Results revealed a statistically nonsignificant mean of true effect sizes, Cohen's <i>d</i><sub>z</sub> = .01, 95% CI [-0.01, .04], 95% PI [-0.04, .07], <i>z =</i> .89, <i>p</i> = .37. Qualitative exploration of administration modifications revealed extensive variability and inconsistent reporting. <b>Discussion:</b> Limitations include publication bias favoring null findings. Risk of bias was judged to be low for most studies. Findings suggest teleNP has a nonsignificant and exceptionally minimal effect on test scores with a high certainty of evidence. Mean in-person test scores were 0.01 standard deviations greater than teleNP. Examination of mean differences revealed 77% of tests/subtests with a difference of less than one point. This updated review supports continued application of teleNP and encourages additional research on administration modifications to standardize practice. PROSPERO 2024: CRD42024530068.</p>","PeriodicalId":55250,"journal":{"name":"Clinical Neuropsychologist","volume":" ","pages":"1037-1072"},"PeriodicalIF":2.7000,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Are tele-neuropsychology and in-person assessment scores meaningfully different? A systematic review and meta-analysis.\",\"authors\":\"Jessica I Alva, Ryan C Brewster, Zanjbeel Mahmood, Kathryn M Harrell, Natalie C Kaiser, Paul Riesthuis, Kaitlyn YoungSciortino, Hannah E Brunet, Megan E Johnson, Shannon Kovach\",\"doi\":\"10.1080/13854046.2025.2493343\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p><b>Objectives:</b> Despite growing evidence supporting tele-neuropsychology (teleNP), clinicians have voiced concerns about comparability to traditional in-person testing and the limited availability of teleNP practice guidelines. In response, we completed a PRISMA-compliant systematic review and meta-analysis to investigate mean score differences in the context of test-level administration modifications. <b>Methods:</b> Eligible studies included adult participants, within-subject designs, commonly used English-language neuropsychological tests, and mean test scores for teleNP and in-person assessment. Studies were identified in databases (ProQuest, PubMed, EBSCOhost), reference lists, forward citation searches of eligible reports, and published teleNP reviews through July 2024. A multilevel random effects meta-analysis was conducted. <b>Results:</b> Twenty-four studies including 1,197 clinically and geographically diverse participants aged 18-96 and 46 neuropsychological tests representing 11 cognitive domains were synthesized. Results revealed a statistically nonsignificant mean of true effect sizes, Cohen's <i>d</i><sub>z</sub> = .01, 95% CI [-0.01, .04], 95% PI [-0.04, .07], <i>z =</i> .89, <i>p</i> = .37. Qualitative exploration of administration modifications revealed extensive variability and inconsistent reporting. <b>Discussion:</b> Limitations include publication bias favoring null findings. Risk of bias was judged to be low for most studies. Findings suggest teleNP has a nonsignificant and exceptionally minimal effect on test scores with a high certainty of evidence. Mean in-person test scores were 0.01 standard deviations greater than teleNP. Examination of mean differences revealed 77% of tests/subtests with a difference of less than one point. This updated review supports continued application of teleNP and encourages additional research on administration modifications to standardize practice. PROSPERO 2024: CRD42024530068.</p>\",\"PeriodicalId\":55250,\"journal\":{\"name\":\"Clinical Neuropsychologist\",\"volume\":\" \",\"pages\":\"1037-1072\"},\"PeriodicalIF\":2.7000,\"publicationDate\":\"2025-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Clinical Neuropsychologist\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1080/13854046.2025.2493343\",\"RegionNum\":3,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/4/21 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"CLINICAL NEUROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical Neuropsychologist","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1080/13854046.2025.2493343","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/4/21 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
摘要
目的:尽管越来越多的证据支持远程神经心理学(teleNP),但临床医生对其与传统的面对面测试的可比性以及teleNP实践指南的有限可用性表示担忧。作为回应,我们完成了一项符合prisma标准的系统评价和荟萃分析,以调查测试级给药修改背景下的平均得分差异。方法:符合条件的研究包括成人受试者、受试者内设计、常用的英语神经心理测试、teleNP和面对面评估的平均测试分数。研究在数据库(ProQuest、PubMed、EBSCOhost)、参考文献列表、符合条件的报告的转发引文搜索和2024年7月之前发表的teleNP评论中进行了鉴定。采用多水平随机效应荟萃分析。结果:24项研究,包括1197名年龄在18-96岁的临床和地理不同的参与者,以及46项代表11个认知领域的神经心理学测试。结果显示真实效应大小的平均值无统计学意义,Cohen's dz = 0.01, 95% CI [-0.01, .04], 95% PI [-0.04, .07], z = .89, p = .37。定性探索行政修改揭示了广泛的可变性和不一致的报告。讨论:局限性包括发表偏倚倾向于无效发现。大多数研究的偏倚风险被认为是低的。研究结果表明,teleNP对考试成绩的影响不显著,而且非常小,证据确凿。面对面测试的平均得分比teleNP高0.01个标准差。对平均差异的检查显示,77%的测试/亚测试差异小于1点。这篇更新的综述支持teleNP的继续应用,并鼓励对管理修改进行更多的研究,以使实践标准化。普洛斯彼罗2024:crd42024530068。
Are tele-neuropsychology and in-person assessment scores meaningfully different? A systematic review and meta-analysis.
Objectives: Despite growing evidence supporting tele-neuropsychology (teleNP), clinicians have voiced concerns about comparability to traditional in-person testing and the limited availability of teleNP practice guidelines. In response, we completed a PRISMA-compliant systematic review and meta-analysis to investigate mean score differences in the context of test-level administration modifications. Methods: Eligible studies included adult participants, within-subject designs, commonly used English-language neuropsychological tests, and mean test scores for teleNP and in-person assessment. Studies were identified in databases (ProQuest, PubMed, EBSCOhost), reference lists, forward citation searches of eligible reports, and published teleNP reviews through July 2024. A multilevel random effects meta-analysis was conducted. Results: Twenty-four studies including 1,197 clinically and geographically diverse participants aged 18-96 and 46 neuropsychological tests representing 11 cognitive domains were synthesized. Results revealed a statistically nonsignificant mean of true effect sizes, Cohen's dz = .01, 95% CI [-0.01, .04], 95% PI [-0.04, .07], z = .89, p = .37. Qualitative exploration of administration modifications revealed extensive variability and inconsistent reporting. Discussion: Limitations include publication bias favoring null findings. Risk of bias was judged to be low for most studies. Findings suggest teleNP has a nonsignificant and exceptionally minimal effect on test scores with a high certainty of evidence. Mean in-person test scores were 0.01 standard deviations greater than teleNP. Examination of mean differences revealed 77% of tests/subtests with a difference of less than one point. This updated review supports continued application of teleNP and encourages additional research on administration modifications to standardize practice. PROSPERO 2024: CRD42024530068.
期刊介绍:
The Clinical Neuropsychologist (TCN) serves as the premier forum for (1) state-of-the-art clinically-relevant scientific research, (2) in-depth professional discussions of matters germane to evidence-based practice, and (3) clinical case studies in neuropsychology. Of particular interest are papers that can make definitive statements about a given topic (thereby having implications for the standards of clinical practice) and those with the potential to expand today’s clinical frontiers. Research on all age groups, and on both clinical and normal populations, is considered.