Computerized adaptive test strategies for the matrix reasoning subtest of the Wechsler Adult Intelligence Scale, 4th Edition (WAIS-IV).

IF 2.6 4区 心理学 Q2 CLINICAL NEUROLOGY
Steven P Reise, Emily Wong, Jared Block, Keith F Widaman, Joseph M Gullett, Russell M Bauer, Daniel L Drane, David W Loring, Laura Glass Umfleet, Dustin Wahlstrom, Kristen Enriquez, Fiona Whelan, Stone Shih, Robert M Bilder
{"title":"Computerized adaptive test strategies for the matrix reasoning subtest of the Wechsler Adult Intelligence Scale, 4th Edition (WAIS-IV).","authors":"Steven P Reise, Emily Wong, Jared Block, Keith F Widaman, Joseph M Gullett, Russell M Bauer, Daniel L Drane, David W Loring, Laura Glass Umfleet, Dustin Wahlstrom, Kristen Enriquez, Fiona Whelan, Stone Shih, Robert M Bilder","doi":"10.1017/S1355617723000401","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Most neuropsychological tests were developed without the benefit of modern psychometric theory. We used item response theory (IRT) methods to determine whether a widely used test - the 26-item Matrix Reasoning subtest of the WAIS-IV - might be used more efficiently if it were administered using computerized adaptive testing (CAT).</p><p><strong>Method: </strong>Data on the Matrix Reasoning subtest from 2197 participants enrolled in the National Neuropsychology Network (NNN) were analyzed using a two-parameter logistic (2PL) IRT model. Simulated CAT results were generated to examine optimal short forms using fixed-length CATs of 3, 6, and 12 items and scores were compared to the original full subtest score. CAT models further explored how many items were needed to achieve a selected precision of measurement (standard error ≤ .40).</p><p><strong>Results: </strong>The fixed-length CATs of 3, 6, and 12 items correlated well with full-length test results (with <i>r</i> = .90, .97 and .99, respectively). To achieve a standard error of .40 (approximate reliability = .84) only 3-7 items had to be administered for a large percentage of individuals.</p><p><strong>Conclusions: </strong>This proof-of-concept investigation suggests that the widely used Matrix Reasoning subtest of the WAIS-IV might be shortened by more than 70% in most examinees while maintaining acceptable measurement precision. If similar savings could be realized in other tests, the accessibility of neuropsychological assessment might be markedly enhanced, and more efficient time use could lead to broader subdomain assessment.</p>","PeriodicalId":49995,"journal":{"name":"Journal of the International Neuropsychological Society","volume":" ","pages":"152-161"},"PeriodicalIF":2.6000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10878120/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the International Neuropsychological Society","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1017/S1355617723000401","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/7/21 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Objective: Most neuropsychological tests were developed without the benefit of modern psychometric theory. We used item response theory (IRT) methods to determine whether a widely used test - the 26-item Matrix Reasoning subtest of the WAIS-IV - might be used more efficiently if it were administered using computerized adaptive testing (CAT).

Method: Data on the Matrix Reasoning subtest from 2197 participants enrolled in the National Neuropsychology Network (NNN) were analyzed using a two-parameter logistic (2PL) IRT model. Simulated CAT results were generated to examine optimal short forms using fixed-length CATs of 3, 6, and 12 items and scores were compared to the original full subtest score. CAT models further explored how many items were needed to achieve a selected precision of measurement (standard error ≤ .40).

Results: The fixed-length CATs of 3, 6, and 12 items correlated well with full-length test results (with r = .90, .97 and .99, respectively). To achieve a standard error of .40 (approximate reliability = .84) only 3-7 items had to be administered for a large percentage of individuals.

Conclusions: This proof-of-concept investigation suggests that the widely used Matrix Reasoning subtest of the WAIS-IV might be shortened by more than 70% in most examinees while maintaining acceptable measurement precision. If similar savings could be realized in other tests, the accessibility of neuropsychological assessment might be markedly enhanced, and more efficient time use could lead to broader subdomain assessment.

韦氏成人智力量表第四版(WAIS-IV)矩阵推理分测验的计算机自适应测验策略。
目的:大多数神经心理学测验都是在没有现代心理测量理论支持的情况下开发出来的。我们使用项目反应理论(IRT)方法来确定一个广泛使用的测验--WAIS-IV 的 26 个项目矩阵推理分测验--如果使用计算机化自适应测验(CAT)进行施测,是否会更有效:方法:使用双参数逻辑(2PL)IRT模型分析了国家神经心理学网络(NNN)2197名参与者的矩阵推理子测试数据。通过使用 3、6 和 12 个项目的固定长度 CAT 生成了模拟 CAT 结果,以检验最佳简表,并将分数与原始的完整子测试分数进行了比较。CAT模型进一步探讨了需要多少项目才能达到选定的测量精度(标准误差小于0.40):结果:3、6 和 12 个项目的固定长度 CAT 与完整测试结果相关性良好(r 分别为 0.90、0.97 和 0.99)。要达到 0.40 的标准误差(近似信度 = 0.84),只需对很大比例的人施测 3-7 个项目:这项概念验证调查表明,在保持可接受的测量精度的同时,WAIS-IV 中被广泛使用的矩阵推理分测验在大多数受试者中的使用时间可以缩短 70% 以上。如果其他测试也能实现类似的时间节省,那么神经心理评估的可及性将会显著提高,而更有效的时间利用也将会带来更广泛的子域评估。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
5.40
自引率
3.80%
发文量
185
审稿时长
4-8 weeks
期刊介绍: The Journal of the International Neuropsychological Society is the official journal of the International Neuropsychological Society, an organization of over 4,500 international members from a variety of disciplines. The Journal of the International Neuropsychological Society welcomes original, creative, high quality research papers covering all areas of neuropsychology. The focus of articles may be primarily experimental, applied, or clinical. Contributions will broadly reflect the interest of all areas of neuropsychology, including but not limited to: development of cognitive processes, brain-behavior relationships, adult and pediatric neuropsychology, neurobehavioral syndromes (such as aphasia or apraxia), and the interfaces of neuropsychology with related areas such as behavioral neurology, neuropsychiatry, genetics, and cognitive neuroscience. Papers that utilize behavioral, neuroimaging, and electrophysiological measures are appropriate. To assure maximum flexibility and to promote diverse mechanisms of scholarly communication, the following formats are available in addition to a Regular Research Article: Brief Communication is a shorter research article; Rapid Communication is intended for "fast breaking" new work that does not yet justify a full length article and is placed on a fast review track; Case Report is a theoretically important and unique case study; Critical Review and Short Review are thoughtful considerations of topics of importance to neuropsychology and include meta-analyses; Dialogue provides a forum for publishing two distinct positions on controversial issues in a point-counterpoint format; Special Issue and Special Section consist of several articles linked thematically; Letter to the Editor responds to recent articles published in the Journal of the International Neuropsychological Society; and Book Review, which is considered but is no longer solicited.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信