改进设计可比效应量在单例设计中的应用。

IF 3.9 2区 心理学 Q1 PSYCHOLOGY, EXPERIMENTAL
Yi-Kai Chen, Tong-Rong Yang, Li-Ting Chen, Cheng-Yu Hsieh, Che Cheng, Po-Ju Wu, Chao-Ying Joanne Peng
{"title":"改进设计可比效应量在单例设计中的应用。","authors":"Yi-Kai Chen, Tong-Rong Yang, Li-Ting Chen, Cheng-Yu Hsieh, Che Cheng, Po-Ju Wu, Chao-Ying Joanne Peng","doi":"10.3758/s13428-025-02715-1","DOIUrl":null,"url":null,"abstract":"<p><p>g<sub>AB</sub> is a design-comparable effect size that has been recommended by the What Works Clearinghouse since 2020 to assess an intervention effect in single-case studies and for meta-analyses. Yet, no research has systematically studied how g<sub>AB</sub>'s performance could be impacted by its non-convergence, and how g<sub>AB</sub>'s non-convergence and performance could be improved by increasing the case size (m) and measurement size (N). This study expanded on the work of Pustejovsky et al. (Journal of Educational and Behavioral Statistics, 39(5), 368-393, 2014) and Chen et al. (Behavioral Research Methods, 56, 379-405, 2024) to investigate the impact of a wide range of m and N, data distribution, autocorrelation, within-case reliability, and ratio of variance components on g<sub>AB</sub>'s non-convergence rate and performance in multiple-baseline designs. g<sub>AB</sub>'s performance was assessed by relative bias, relative bias of variance, and coverage rate of 95% symmetric CIs. Findings revealed that g<sub>AB</sub>'s performance was improved by convergence, especially when data were non-normal. In addition, g<sub>AB</sub>'s convergence improved by increasing m, within-case reliability, and ratio of variance components. When data distribution was normal, converged g<sub>AB</sub> improved with large m and large within-case reliability. When data distribution was mildly non-normal, converged g<sub>AB</sub> improved with medium to large m and small within-case reliability. When data distribution was moderately non-normal, converged g<sub>AB</sub> improved with small to medium m and small within-case reliability. Optimal m depended on data distribution and within-case reliability. N had a trivial impact on converged g<sub>AB</sub>. In sum, our findings demonstrated the importance of g<sub>AB</sub>'s convergence and optimal m to improve its application.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 10","pages":"279"},"PeriodicalIF":3.9000,"publicationDate":"2025-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Improving applications of a design-comparable effect size in single-case designs.\",\"authors\":\"Yi-Kai Chen, Tong-Rong Yang, Li-Ting Chen, Cheng-Yu Hsieh, Che Cheng, Po-Ju Wu, Chao-Ying Joanne Peng\",\"doi\":\"10.3758/s13428-025-02715-1\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>g<sub>AB</sub> is a design-comparable effect size that has been recommended by the What Works Clearinghouse since 2020 to assess an intervention effect in single-case studies and for meta-analyses. Yet, no research has systematically studied how g<sub>AB</sub>'s performance could be impacted by its non-convergence, and how g<sub>AB</sub>'s non-convergence and performance could be improved by increasing the case size (m) and measurement size (N). This study expanded on the work of Pustejovsky et al. (Journal of Educational and Behavioral Statistics, 39(5), 368-393, 2014) and Chen et al. (Behavioral Research Methods, 56, 379-405, 2024) to investigate the impact of a wide range of m and N, data distribution, autocorrelation, within-case reliability, and ratio of variance components on g<sub>AB</sub>'s non-convergence rate and performance in multiple-baseline designs. g<sub>AB</sub>'s performance was assessed by relative bias, relative bias of variance, and coverage rate of 95% symmetric CIs. Findings revealed that g<sub>AB</sub>'s performance was improved by convergence, especially when data were non-normal. In addition, g<sub>AB</sub>'s convergence improved by increasing m, within-case reliability, and ratio of variance components. When data distribution was normal, converged g<sub>AB</sub> improved with large m and large within-case reliability. When data distribution was mildly non-normal, converged g<sub>AB</sub> improved with medium to large m and small within-case reliability. When data distribution was moderately non-normal, converged g<sub>AB</sub> improved with small to medium m and small within-case reliability. Optimal m depended on data distribution and within-case reliability. N had a trivial impact on converged g<sub>AB</sub>. In sum, our findings demonstrated the importance of g<sub>AB</sub>'s convergence and optimal m to improve its application.</p>\",\"PeriodicalId\":8717,\"journal\":{\"name\":\"Behavior Research Methods\",\"volume\":\"57 10\",\"pages\":\"279\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2025-09-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Behavior Research Methods\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.3758/s13428-025-02715-1\",\"RegionNum\":2,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHOLOGY, EXPERIMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Behavior Research Methods","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.3758/s13428-025-02715-1","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, EXPERIMENTAL","Score":null,"Total":0}
引用次数: 0

摘要

gAB是自2020年以来由What Works Clearinghouse推荐的设计可比效应量,用于评估单例研究和荟萃分析中的干预效果。然而,目前还没有研究系统地研究gAB的非收敛性对其性能的影响,以及如何通过增加案例大小(m)和测量大小(N)来改善gAB的非收敛性和性能。本研究扩展了Pustejovsky等人(Journal of Educational and Behavioral Statistics, 39(5), 368-393, 2014)和Chen等人(Behavioral Research Methods, 56, 379-405, 2024)的工作,研究了大范围m和N、数据分布、自相关、案例内信度和方差成分比对gAB在多基线设计中的非收敛率和性能的影响。通过相对偏倚、相对方差偏倚和95%对称ci的覆盖率来评估gAB的性能。结果表明,gAB的性能通过收敛得到改善,特别是当数据是非正态时。此外,通过增加m、箱内信度和方差成分比,gAB的收敛性得到改善。当数据分布为正态分布时,收敛gAB具有较大的m值和较大的箱内可靠性。当数据分布轻度非正态分布时,收敛gAB提高了中~大m和较小的箱内可靠性。当数据分布适度非正态分布时,收敛gAB提高了小到中等m和较小的箱内可靠性。最优m取决于数据分布和箱内可靠性。N对聚合gAB的影响很小。总之,我们的研究结果证明了gAB的收敛性和最优m对于改进其应用的重要性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Improving applications of a design-comparable effect size in single-case designs.

gAB is a design-comparable effect size that has been recommended by the What Works Clearinghouse since 2020 to assess an intervention effect in single-case studies and for meta-analyses. Yet, no research has systematically studied how gAB's performance could be impacted by its non-convergence, and how gAB's non-convergence and performance could be improved by increasing the case size (m) and measurement size (N). This study expanded on the work of Pustejovsky et al. (Journal of Educational and Behavioral Statistics, 39(5), 368-393, 2014) and Chen et al. (Behavioral Research Methods, 56, 379-405, 2024) to investigate the impact of a wide range of m and N, data distribution, autocorrelation, within-case reliability, and ratio of variance components on gAB's non-convergence rate and performance in multiple-baseline designs. gAB's performance was assessed by relative bias, relative bias of variance, and coverage rate of 95% symmetric CIs. Findings revealed that gAB's performance was improved by convergence, especially when data were non-normal. In addition, gAB's convergence improved by increasing m, within-case reliability, and ratio of variance components. When data distribution was normal, converged gAB improved with large m and large within-case reliability. When data distribution was mildly non-normal, converged gAB improved with medium to large m and small within-case reliability. When data distribution was moderately non-normal, converged gAB improved with small to medium m and small within-case reliability. Optimal m depended on data distribution and within-case reliability. N had a trivial impact on converged gAB. In sum, our findings demonstrated the importance of gAB's convergence and optimal m to improve its application.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
10.30
自引率
9.30%
发文量
266
期刊介绍: Behavior Research Methods publishes articles concerned with the methods, techniques, and instrumentation of research in experimental psychology. The journal focuses particularly on the use of computer technology in psychological research. An annual special issue is devoted to this field.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信