Angus Kittelman, Sara Izzard, Kent McIntosh, Kelsey R. Morris, Timothy J. Lewis
{"title":"自我评估调查:评估积极行为干预和支持的修订措施","authors":"Angus Kittelman, Sara Izzard, Kent McIntosh, Kelsey R. Morris, Timothy J. Lewis","doi":"10.1177/15345084241235226","DOIUrl":null,"url":null,"abstract":"The purpose of this study was to evaluate the psychometric properties of the Self-Assessment Survey (SAS) 4.0, an updated measure assessing implementation fidelity of positive behavioral interventions and supports (PBIS). A total of 627 school personnel from 33 schools in six U.S. states completed the SAS 4.0 during the 2021–2022 school year. We evaluated data demonstrating the measure’s reliability (internal consistency, interrater reliability between PBIS team and non-team members), internal structure, and convergent validity for assessing implementation of Tier 1, 2, and 3 systems. We found strong internal consistency (overall and across subscales) and evidence regarding the internal structure as a four-factor measure. In addition, we found the SAS 4.0 (overall score and subscales) to be statistically significantly correlated with another widely used and empirically evaluated PBIS fidelity measure, the Tiered Fidelity Inventory (TFI). We found a statistically significant correlation between the SAS 4.0 and the SAS 3.0 for the Schoolwide Systems subscale but not other subscales. We discuss limitations given the current sample and describe implications for how PBIS teams can use the measure for school improvement and decision making.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":"16 1","pages":""},"PeriodicalIF":1.2000,"publicationDate":"2024-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Self-Assessment Survey: Evaluation of a Revised Measure Assessing Positive Behavioral Interventions and Supports\",\"authors\":\"Angus Kittelman, Sara Izzard, Kent McIntosh, Kelsey R. Morris, Timothy J. Lewis\",\"doi\":\"10.1177/15345084241235226\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The purpose of this study was to evaluate the psychometric properties of the Self-Assessment Survey (SAS) 4.0, an updated measure assessing implementation fidelity of positive behavioral interventions and supports (PBIS). A total of 627 school personnel from 33 schools in six U.S. states completed the SAS 4.0 during the 2021–2022 school year. We evaluated data demonstrating the measure’s reliability (internal consistency, interrater reliability between PBIS team and non-team members), internal structure, and convergent validity for assessing implementation of Tier 1, 2, and 3 systems. We found strong internal consistency (overall and across subscales) and evidence regarding the internal structure as a four-factor measure. In addition, we found the SAS 4.0 (overall score and subscales) to be statistically significantly correlated with another widely used and empirically evaluated PBIS fidelity measure, the Tiered Fidelity Inventory (TFI). We found a statistically significant correlation between the SAS 4.0 and the SAS 3.0 for the Schoolwide Systems subscale but not other subscales. We discuss limitations given the current sample and describe implications for how PBIS teams can use the measure for school improvement and decision making.\",\"PeriodicalId\":46264,\"journal\":{\"name\":\"ASSESSMENT FOR EFFECTIVE INTERVENTION\",\"volume\":\"16 1\",\"pages\":\"\"},\"PeriodicalIF\":1.2000,\"publicationDate\":\"2024-03-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ASSESSMENT FOR EFFECTIVE INTERVENTION\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1177/15345084241235226\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ASSESSMENT FOR EFFECTIVE INTERVENTION","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/15345084241235226","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
摘要
本研究的目的是评估自我评估调查(SAS)4.0 的心理测量特性,这是一项评估积极行为干预与支持(PBIS)实施忠诚度的最新措施。在 2021-2022 学年期间,共有来自美国 6 个州 33 所学校的 627 名学校工作人员完成了 SAS 4.0。我们对数据进行了评估,以证明该测量方法在评估 1、2 和 3 级系统实施情况时的可靠性(内部一致性、PBIS 团队成员和非团队成员之间的互测可靠性)、内部结构和收敛有效性。我们发现其内部一致性(整体和各分量表之间)很强,并有证据表明其内部结构为四因素测量。此外,我们还发现 SAS 4.0(总分和分量表)与另一个广泛使用并经过实证评估的 PBIS 忠诚度测量方法--分层忠诚度量表(TFI)--在统计上有显著的相关性。我们发现,SAS 4.0 与 SAS 3.0 在全校系统分量表上存在统计意义上的显著相关性,但在其他分量表上则没有。我们讨论了当前样本的局限性,并阐述了 PBIS 团队如何使用该测量方法进行学校改进和决策的意义。
Self-Assessment Survey: Evaluation of a Revised Measure Assessing Positive Behavioral Interventions and Supports
The purpose of this study was to evaluate the psychometric properties of the Self-Assessment Survey (SAS) 4.0, an updated measure assessing implementation fidelity of positive behavioral interventions and supports (PBIS). A total of 627 school personnel from 33 schools in six U.S. states completed the SAS 4.0 during the 2021–2022 school year. We evaluated data demonstrating the measure’s reliability (internal consistency, interrater reliability between PBIS team and non-team members), internal structure, and convergent validity for assessing implementation of Tier 1, 2, and 3 systems. We found strong internal consistency (overall and across subscales) and evidence regarding the internal structure as a four-factor measure. In addition, we found the SAS 4.0 (overall score and subscales) to be statistically significantly correlated with another widely used and empirically evaluated PBIS fidelity measure, the Tiered Fidelity Inventory (TFI). We found a statistically significant correlation between the SAS 4.0 and the SAS 3.0 for the Schoolwide Systems subscale but not other subscales. We discuss limitations given the current sample and describe implications for how PBIS teams can use the measure for school improvement and decision making.