Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrument.

IF 1.4 4区心理学 Q4 CLINICAL NEUROLOGY

Applied Neuropsychology-Adult Pub Date : 2025-03-01 Epub Date: 2023-02-08 DOI:10.1080/23279095.2023.2170800

Joana O Pinto, Artemisa R Dores, Bruno Peixoto, Fernando Barbosa

{"title":"Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrument.","authors":"Joana O Pinto, Artemisa R Dores, Bruno Peixoto, Fernando Barbosa","doi":"10.1080/23279095.2023.2170800","DOIUrl":null,"url":null,"abstract":"Objectives: The main objectives of this study are to identify the dimensions of Ecological Validity (EV) within the definitions of this concept, understand how they are operationalized in neurocognitive tests, and propose a checklist for EV attributes in neurocognitive tests.Method: A systematized review was combined with content analysis of the selected papers, using the inductive method. We analyzed 82 studies on the EV of neurocognitive tests, 19 literature reviews and 63 empirical studies. Based on this review, we identified the relevant criteria for evaluating EV.Results: EV is a multidimensional concept with two main dimensions: representativeness and generalization. Representativeness involves the subdimensions simplicity-complexity and artificial-natural and several criteria organized on a continuum from low EV to high EV. Generalization is dependent on representativeness and is influenced by different cognitive and non-cognitive factors. We propose six stages for operationalizing EV, from defining the objectives of the neurocognitive assessment to the methodology for scoring and interpreting the results.Conclusion: This systematized review helps to operationalize the concept of EV by providing a tool for evaluating and improving EV while developing new tests. Further studies with a longitudinal design can compare the predictive value of tests with higher versus lower EV-checklist scores.","PeriodicalId":51308,"journal":{"name":"Applied Neuropsychology-Adult","volume":" ","pages":"577-594"},"PeriodicalIF":1.4000,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Neuropsychology-Adult","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1080/23279095.2023.2170800","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/2/8 0:00:00","PubModel":"Epub","JCR":"Q4","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}

引用次数: 0

Abstract

Objectives: The main objectives of this study are to identify the dimensions of Ecological Validity (EV) within the definitions of this concept, understand how they are operationalized in neurocognitive tests, and propose a checklist for EV attributes in neurocognitive tests.

Method: A systematized review was combined with content analysis of the selected papers, using the inductive method. We analyzed 82 studies on the EV of neurocognitive tests, 19 literature reviews and 63 empirical studies. Based on this review, we identified the relevant criteria for evaluating EV.

Results: EV is a multidimensional concept with two main dimensions: representativeness and generalization. Representativeness involves the subdimensions simplicity-complexity and artificial-natural and several criteria organized on a continuum from low EV to high EV. Generalization is dependent on representativeness and is influenced by different cognitive and non-cognitive factors. We propose six stages for operationalizing EV, from defining the objectives of the neurocognitive assessment to the methodology for scoring and interpreting the results.

Conclusion: This systematized review helps to operationalize the concept of EV by providing a tool for evaluating and improving EV while developing new tests. Further studies with a longitudinal design can compare the predictive value of tests with higher versus lower EV-checklist scores.

查看原文本刊更多论文

神经认知评估的生态有效性：系统回顾、内容分析和工具建议。

研究目的本研究的主要目的是确定生态有效性（EV）概念定义中的各个维度，了解神经认知测试中如何操作这些维度，并提出神经认知测试中生态有效性属性的核对表：方法：采用归纳法对所选论文进行了系统综述和内容分析。我们分析了 82 篇关于神经认知测试 EV 的研究，其中包括 19 篇文献综述和 63 篇实证研究。在此基础上，我们确定了评价 EV 的相关标准：结果：EV 是一个多维概念，有两个主要维度：代表性和概括性。代表性包括简单-复杂和人工-自然两个子维度，以及从低 EV 到高 EV 的连续统一体中的若干标准。概括性取决于代表性，并受到不同认知和非认知因素的影响。我们提出了将 EV 操作化的六个阶段，从确定神经认知评估的目标到评分和解释结果的方法：这篇系统化的综述在开发新测试的同时，为评估和改进 EV 提供了一个工具，有助于 EV 概念的可操作性。采用纵向设计的进一步研究可以比较 EV 检查表得分较高和较低的测试的预测价值：了解EV的定义、其维度和子维度、EV在神经认知测试中的操作方法，并提出神经认知测试EV属性核对表：主要发现：代表性和概括性是 EV 的主要维度。代表性涉及多个子维度，而概括性则取决于代表性，并受认知和非认知因素的影响。我们提供了一份 EV 检查表，分为六个部分：重要性：EV 检查表可用于指导开发生态有效的神经认知测试和/或评估现有测试的 EV：下一步：研究EV检查表得分较高的测试的预测价值。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Applied Neuropsychology-Adult CLINICAL NEUROLOGY-PSYCHOLOGY

CiteScore

4.50

自引率

11.80%

发文量

134

期刊介绍： pplied Neuropsychology-Adult publishes clinical neuropsychological articles concerning assessment, brain functioning and neuroimaging, neuropsychological treatment, and rehabilitation in adults. Full-length articles and brief communications are included. Case studies of adult patients carefully assessing the nature, course, or treatment of clinical neuropsychological dysfunctions in the context of scientific literature, are suitable. Review manuscripts addressing critical issues are encouraged. Preference is given to papers of clinical relevance to others in the field. All submitted manuscripts are subject to initial appraisal by the Editor-in-Chief, and, if found suitable for further considerations are peer reviewed by independent, anonymous expert referees. All peer review is single-blind and submission is online via ScholarOne Manuscripts.