Kristen L Padilla, Regan Weston, Grant B Morgan, Providence Lively, Nicole O'Guinn
{"title":"基于应用行为分析的评估的效度和信度证据:系统综述。","authors":"Kristen L Padilla, Regan Weston, Grant B Morgan, Providence Lively, Nicole O'Guinn","doi":"10.1177/01454455221098151","DOIUrl":null,"url":null,"abstract":"<p><p>The current article presents the findings from a systematic review of the available reliability and validity evidence supporting the use of criterion-referenced assessments based on the applied behavior analysis framework. We identified 46 studies that reported reliability and/or validity evidence for six assessments, 37 of which presented reliability evidence and 43 presented validity evidence. Additionally, we extracted and summarized information related to participant characteristics (e.g., age, sex, diagnosis), geographic location, and research setting (e.g., residential facility, home). Overall, we found conflicting support for the use of the assessments. When coupled with the reported usage by behavior analysis professionals, our findings suggest a misalignment between the reportedly used assessments and the number of published studies providing validity and/or reliability evidence. We found inconsistent use of measurement-related vocabulary and that many studies could have been strengthened by conducting different statistical analyses. We provide a summary of studies, findings, and offer recommendations for clinical practice and future measurement research.</p>","PeriodicalId":48037,"journal":{"name":"Behavior Modification","volume":" ","pages":"247-288"},"PeriodicalIF":2.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Validity and Reliability Evidence for Assessments Based in Applied Behavior Analysis: A Systematic Review.\",\"authors\":\"Kristen L Padilla, Regan Weston, Grant B Morgan, Providence Lively, Nicole O'Guinn\",\"doi\":\"10.1177/01454455221098151\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>The current article presents the findings from a systematic review of the available reliability and validity evidence supporting the use of criterion-referenced assessments based on the applied behavior analysis framework. We identified 46 studies that reported reliability and/or validity evidence for six assessments, 37 of which presented reliability evidence and 43 presented validity evidence. Additionally, we extracted and summarized information related to participant characteristics (e.g., age, sex, diagnosis), geographic location, and research setting (e.g., residential facility, home). Overall, we found conflicting support for the use of the assessments. When coupled with the reported usage by behavior analysis professionals, our findings suggest a misalignment between the reportedly used assessments and the number of published studies providing validity and/or reliability evidence. We found inconsistent use of measurement-related vocabulary and that many studies could have been strengthened by conducting different statistical analyses. We provide a summary of studies, findings, and offer recommendations for clinical practice and future measurement research.</p>\",\"PeriodicalId\":48037,\"journal\":{\"name\":\"Behavior Modification\",\"volume\":\" \",\"pages\":\"247-288\"},\"PeriodicalIF\":2.0000,\"publicationDate\":\"2023-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Behavior Modification\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1177/01454455221098151\",\"RegionNum\":3,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2022/7/6 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q3\",\"JCRName\":\"PSYCHOLOGY, CLINICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Behavior Modification","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/01454455221098151","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2022/7/6 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"PSYCHOLOGY, CLINICAL","Score":null,"Total":0}
Validity and Reliability Evidence for Assessments Based in Applied Behavior Analysis: A Systematic Review.
The current article presents the findings from a systematic review of the available reliability and validity evidence supporting the use of criterion-referenced assessments based on the applied behavior analysis framework. We identified 46 studies that reported reliability and/or validity evidence for six assessments, 37 of which presented reliability evidence and 43 presented validity evidence. Additionally, we extracted and summarized information related to participant characteristics (e.g., age, sex, diagnosis), geographic location, and research setting (e.g., residential facility, home). Overall, we found conflicting support for the use of the assessments. When coupled with the reported usage by behavior analysis professionals, our findings suggest a misalignment between the reportedly used assessments and the number of published studies providing validity and/or reliability evidence. We found inconsistent use of measurement-related vocabulary and that many studies could have been strengthened by conducting different statistical analyses. We provide a summary of studies, findings, and offer recommendations for clinical practice and future measurement research.
期刊介绍:
For two decades, researchers and practitioners have turned to Behavior Modification for current scholarship on applied behavior modification. Starting in 1995, in addition to keeping you informed on assessment and modification techniques relevant to psychiatric, clinical, education, and rehabilitation settings, Behavior Modification revised and expanded its focus to include treatment manuals and program descriptions. With these features you can follow the process of clinical research and see how it can be applied to your own work. And, with Behavior Modification, successful clinical and administrative experts have an outlet for sharing their solutions in the field.