Brian Barger,Terri Deocampo Pigott,R Christopher Sheldrick,Jonathan Campbell,Alexa Gonzalez Laca,Jon Starnes,Betsy Davis,Rachel Waford,John Olmstead
{"title":"Estimating the impact of missed cases on the accuracy of autism screening tools.","authors":"Brian Barger,Terri Deocampo Pigott,R Christopher Sheldrick,Jonathan Campbell,Alexa Gonzalez Laca,Jon Starnes,Betsy Davis,Rachel Waford,John Olmstead","doi":"10.1037/pas0001445","DOIUrl":null,"url":null,"abstract":"A common problem for assessing psychiatric screening tools is that initial diagnostic accuracy estimates are conducted on cross-sectional data and later found to be lower than expected when longitudinal analyses are conducted. This article uses prevalence estimates to identify potentially missed cases and adjust diagnostic accuracy metrics. To display this approach, we meta-analyze and assess 27 population-level autism screening studies identified via an umbrella review and contrast four population adjustments (none, national, U.S.-centric, and world prevalence). Studies with no positive screen adjustments displayed adequate sensitivity (.75), but poor sensitivity resulted when applying national (.52), world (.50), and U.S.-centric (.33) population adjustments. We also address missing positive screen cases due to the common problem of attrition (Sheldrick et al., 2023). Positive screen adjustments suggested a range of sensitivity impacts ranging from very poor (.32) to good (.89). Across analyses, positive predictive value estimates also ranged from .20 to .73 depending on population and missed case assumptions. The strengths and benefits of blending epidemiology and psychometric perspectives to identify screening tools that are weaker than expected are discussed. (PsycInfo Database Record (c) 2026 APA, all rights reserved).","PeriodicalId":20770,"journal":{"name":"Psychological Assessment","volume":"67 1","pages":""},"PeriodicalIF":3.1000,"publicationDate":"2026-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychological Assessment","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/pas0001445","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, CLINICAL","Score":null,"Total":0}
引用次数: 0
Abstract
A common problem for assessing psychiatric screening tools is that initial diagnostic accuracy estimates are conducted on cross-sectional data and later found to be lower than expected when longitudinal analyses are conducted. This article uses prevalence estimates to identify potentially missed cases and adjust diagnostic accuracy metrics. To display this approach, we meta-analyze and assess 27 population-level autism screening studies identified via an umbrella review and contrast four population adjustments (none, national, U.S.-centric, and world prevalence). Studies with no positive screen adjustments displayed adequate sensitivity (.75), but poor sensitivity resulted when applying national (.52), world (.50), and U.S.-centric (.33) population adjustments. We also address missing positive screen cases due to the common problem of attrition (Sheldrick et al., 2023). Positive screen adjustments suggested a range of sensitivity impacts ranging from very poor (.32) to good (.89). Across analyses, positive predictive value estimates also ranged from .20 to .73 depending on population and missed case assumptions. The strengths and benefits of blending epidemiology and psychometric perspectives to identify screening tools that are weaker than expected are discussed. (PsycInfo Database Record (c) 2026 APA, all rights reserved).
期刊介绍:
Psychological Assessment is concerned mainly with empirical research on measurement and evaluation relevant to the broad field of clinical psychology. Submissions are welcome in the areas of assessment processes and methods. Included are - clinical judgment and the application of decision-making models - paradigms derived from basic psychological research in cognition, personality–social psychology, and biological psychology - development, validation, and application of assessment instruments, observational methods, and interviews