Steven P Reise, Emily Wong, Jared Block, Keith F Widaman, Joseph M Gullett, Russell M Bauer, Daniel L Drane, David W Loring, Laura Glass Umfleet, Dustin Wahlstrom, Kristen Enriquez, Fiona Whelan, Stone Shih, Robert M Bilder
{"title":"韦氏成人智力量表第四版（WAIS-IV）矩阵推理分测验的计算机自适应测验策略。","authors":"Steven P Reise, Emily Wong, Jared Block, Keith F Widaman, Joseph M Gullett, Russell M Bauer, Daniel L Drane, David W Loring, Laura Glass Umfleet, Dustin Wahlstrom, Kristen Enriquez, Fiona Whelan, Stone Shih, Robert M Bilder","doi":"10.1017/S1355617723000401","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Most neuropsychological tests were developed without the benefit of modern psychometric theory. We used item response theory (IRT) methods to determine whether a widely used test - the 26-item Matrix Reasoning subtest of the WAIS-IV - might be used more efficiently if it were administered using computerized adaptive testing (CAT).</p><p><strong>Method: </strong>Data on the Matrix Reasoning subtest from 2197 participants enrolled in the National Neuropsychology Network (NNN) were analyzed using a two-parameter logistic (2PL) IRT model. Simulated CAT results were generated to examine optimal short forms using fixed-length CATs of 3, 6, and 12 items and scores were compared to the original full subtest score. CAT models further explored how many items were needed to achieve a selected precision of measurement (standard error ≤ .40).</p><p><strong>Results: </strong>The fixed-length CATs of 3, 6, and 12 items correlated well with full-length test results (with <i>r</i> = .90, .97 and .99, respectively). To achieve a standard error of .40 (approximate reliability = .84) only 3-7 items had to be administered for a large percentage of individuals.</p><p><strong>Conclusions: </strong>This proof-of-concept investigation suggests that the widely used Matrix Reasoning subtest of the WAIS-IV might be shortened by more than 70% in most examinees while maintaining acceptable measurement precision. If similar savings could be realized in other tests, the accessibility of neuropsychological assessment might be markedly enhanced, and more efficient time use could lead to broader subdomain assessment.</p>","PeriodicalId":49995,"journal":{"name":"Journal of the International Neuropsychological Society","volume":" ","pages":"152-161"},"PeriodicalIF":2.6000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10878120/pdf/","citationCount":"0","resultStr":"{\"title\":\"Computerized adaptive test strategies for the matrix reasoning subtest of the Wechsler Adult Intelligence Scale, 4th Edition (WAIS-IV).\",\"authors\":\"Steven P Reise, Emily Wong, Jared Block, Keith F Widaman, Joseph M Gullett, Russell M Bauer, Daniel L Drane, David W Loring, Laura Glass Umfleet, Dustin Wahlstrom, Kristen Enriquez, Fiona Whelan, Stone Shih, Robert M Bilder\",\"doi\":\"10.1017/S1355617723000401\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>Most neuropsychological tests were developed without the benefit of modern psychometric theory. We used item response theory (IRT) methods to determine whether a widely used test - the 26-item Matrix Reasoning subtest of the WAIS-IV - might be used more efficiently if it were administered using computerized adaptive testing (CAT).</p><p><strong>Method: </strong>Data on the Matrix Reasoning subtest from 2197 participants enrolled in the National Neuropsychology Network (NNN) were analyzed using a two-parameter logistic (2PL) IRT model. Simulated CAT results were generated to examine optimal short forms using fixed-length CATs of 3, 6, and 12 items and scores were compared to the original full subtest score. CAT models further explored how many items were needed to achieve a selected precision of measurement (standard error ≤ .40).</p><p><strong>Results: </strong>The fixed-length CATs of 3, 6, and 12 items correlated well with full-length test results (with <i>r</i> = .90, .97 and .99, respectively). To achieve a standard error of .40 (approximate reliability = .84) only 3-7 items had to be administered for a large percentage of individuals.</p><p><strong>Conclusions: </strong>This proof-of-concept investigation suggests that the widely used Matrix Reasoning subtest of the WAIS-IV might be shortened by more than 70% in most examinees while maintaining acceptable measurement precision. If similar savings could be realized in other tests, the accessibility of neuropsychological assessment might be markedly enhanced, and more efficient time use could lead to broader subdomain assessment.</p>\",\"PeriodicalId\":49995,\"journal\":{\"name\":\"Journal of the International Neuropsychological Society\",\"volume\":\" \",\"pages\":\"152-161\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2024-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10878120/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of the International Neuropsychological Society\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1017/S1355617723000401\",\"RegionNum\":4,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2023/7/21 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"CLINICAL NEUROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the International Neuropsychological Society","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1017/S1355617723000401","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/7/21 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
Computerized adaptive test strategies for the matrix reasoning subtest of the Wechsler Adult Intelligence Scale, 4th Edition (WAIS-IV).
Objective: Most neuropsychological tests were developed without the benefit of modern psychometric theory. We used item response theory (IRT) methods to determine whether a widely used test - the 26-item Matrix Reasoning subtest of the WAIS-IV - might be used more efficiently if it were administered using computerized adaptive testing (CAT).
Method: Data on the Matrix Reasoning subtest from 2197 participants enrolled in the National Neuropsychology Network (NNN) were analyzed using a two-parameter logistic (2PL) IRT model. Simulated CAT results were generated to examine optimal short forms using fixed-length CATs of 3, 6, and 12 items and scores were compared to the original full subtest score. CAT models further explored how many items were needed to achieve a selected precision of measurement (standard error ≤ .40).
Results: The fixed-length CATs of 3, 6, and 12 items correlated well with full-length test results (with r = .90, .97 and .99, respectively). To achieve a standard error of .40 (approximate reliability = .84) only 3-7 items had to be administered for a large percentage of individuals.
Conclusions: This proof-of-concept investigation suggests that the widely used Matrix Reasoning subtest of the WAIS-IV might be shortened by more than 70% in most examinees while maintaining acceptable measurement precision. If similar savings could be realized in other tests, the accessibility of neuropsychological assessment might be markedly enhanced, and more efficient time use could lead to broader subdomain assessment.
期刊介绍：
The Journal of the International Neuropsychological Society is the official journal of the International Neuropsychological Society, an organization of over 4,500 international members from a variety of disciplines. The Journal of the International Neuropsychological Society welcomes original, creative, high quality research papers covering all areas of neuropsychology. The focus of articles may be primarily experimental, applied, or clinical. Contributions will broadly reflect the interest of all areas of neuropsychology, including but not limited to: development of cognitive processes, brain-behavior relationships, adult and pediatric neuropsychology, neurobehavioral syndromes (such as aphasia or apraxia), and the interfaces of neuropsychology with related areas such as behavioral neurology, neuropsychiatry, genetics, and cognitive neuroscience. Papers that utilize behavioral, neuroimaging, and electrophysiological measures are appropriate.
To assure maximum flexibility and to promote diverse mechanisms of scholarly communication, the following formats are available in addition to a Regular Research Article: Brief Communication is a shorter research article; Rapid Communication is intended for "fast breaking" new work that does not yet justify a full length article and is placed on a fast review track; Case Report is a theoretically important and unique case study; Critical Review and Short Review are thoughtful considerations of topics of importance to neuropsychology and include meta-analyses; Dialogue provides a forum for publishing two distinct positions on controversial issues in a point-counterpoint format; Special Issue and Special Section consist of several articles linked thematically; Letter to the Editor responds to recent articles published in the Journal of the International Neuropsychological Society; and Book Review, which is considered but is no longer solicited.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
