整合有效性证据，修订针对幼儿教育机构的虐待儿童知识测试：混合方法。

IF 1.1 3区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

American Journal of Evaluation Pub Date : 2022-12-01 Epub Date: 2021-11-22 DOI:10.1177/10982140211002901

Carlomagno C Panlilio, Lisa Famularo, Jessica Masters, Sarah Dore, Nicole Verdiglione, Chengwu Yang, Erik Lehman, Robert M Hamm, Richard Fiene, David Bard, Karl M Kapp, Benjamin H Levi

{"title":"整合有效性证据，修订针对幼儿教育机构的虐待儿童知识测试：混合方法。","authors":"Carlomagno C Panlilio, Lisa Famularo, Jessica Masters, Sarah Dore, Nicole Verdiglione, Chengwu Yang, Erik Lehman, Robert M Hamm, Richard Fiene, David Bard, Karl M Kapp, Benjamin H Levi","doi":"10.1177/10982140211002901","DOIUrl":null,"url":null,"abstract":"Knowledge tests used to evaluate child protection training program effectiveness for early childhood education providers may suffer from threats to construct validity given the contextual variability inherent within state-specific regulations around mandated reporting requirements. Unfortunately, guidance on instrument revision that accounts for such state-specific mandated reporting requirements is lacking across research on evaluation practices. This study, therefore, explored how collection and integration of validity evidence using a mixed methods framework can guide the instrument revision process to arrive at a more valid program outcome measure.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":null,"pages":null},"PeriodicalIF":1.1000,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9733792/pdf/nihms-1810124.pdf","citationCount":"0","resultStr":"{\"title\":\"Integrating Validity Evidence to Revise a Child Abuse Knowledge Test for Early Childhood Education Providers: A Mixed Methods Approach.\",\"authors\":\"Carlomagno C Panlilio, Lisa Famularo, Jessica Masters, Sarah Dore, Nicole Verdiglione, Chengwu Yang, Erik Lehman, Robert M Hamm, Richard Fiene, David Bard, Karl M Kapp, Benjamin H Levi\",\"doi\":\"10.1177/10982140211002901\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Knowledge tests used to evaluate child protection training program effectiveness for early childhood education providers may suffer from threats to construct validity given the contextual variability inherent within state-specific regulations around mandated reporting requirements. Unfortunately, guidance on instrument revision that accounts for such state-specific mandated reporting requirements is lacking across research on evaluation practices. This study, therefore, explored how collection and integration of validity evidence using a mixed methods framework can guide the instrument revision process to arrive at a more valid program outcome measure.\",\"PeriodicalId\":51449,\"journal\":{\"name\":\"American Journal of Evaluation\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.1000,\"publicationDate\":\"2022-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9733792/pdf/nihms-1810124.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"American Journal of Evaluation\",\"FirstCategoryId\":\"90\",\"ListUrlMain\":\"https://doi.org/10.1177/10982140211002901\",\"RegionNum\":3,\"RegionCategory\":\"社会学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2021/11/22 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"SOCIAL SCIENCES, INTERDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"American Journal of Evaluation","FirstCategoryId":"90","ListUrlMain":"https://doi.org/10.1177/10982140211002901","RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2021/11/22 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"SOCIAL SCIENCES, INTERDISCIPLINARY","Score":null,"Total":0}

引用次数: 0

摘要

用于评估幼儿教育机构儿童保护培训计划有效性的知识测试，可能会因为各州围绕强制报告要求的具体规定所固有的环境变化而受到构建有效性的威胁。遗憾的是，在有关评估实践的研究中，还缺乏考虑到这些特定州强制报告要求的工具修订指南。因此，本研究探讨了如何利用混合方法框架收集和整合有效性证据，以指导工具修订过程，从而获得更有效的项目结果测量。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Integrating Validity Evidence to Revise a Child Abuse Knowledge Test for Early Childhood Education Providers: A Mixed Methods Approach.

Knowledge tests used to evaluate child protection training program effectiveness for early childhood education providers may suffer from threats to construct validity given the contextual variability inherent within state-specific regulations around mandated reporting requirements. Unfortunately, guidance on instrument revision that accounts for such state-specific mandated reporting requirements is lacking across research on evaluation practices. This study, therefore, explored how collection and integration of validity evidence using a mixed methods framework can guide the instrument revision process to arrive at a more valid program outcome measure.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

American Journal of Evaluation SOCIAL SCIENCES, INTERDISCIPLINARY-

CiteScore

4.40

自引率

11.80%

发文量

期刊介绍： The American Journal of Evaluation (AJE) publishes original papers about the methods, theory, practice, and findings of evaluation. The general goal of AJE is to present the best work in and about evaluation, in order to improve the knowledge base and practice of its readers. Because the field of evaluation is diverse, with different intellectual traditions, approaches to practice, and domains of application, the papers published in AJE will reflect this diversity. Nevertheless, preference is given to papers that are likely to be of interest to a wide range of evaluators and that are written to be accessible to most readers.