沟通元分析中统计报告实践不足及其后果的实证研究

IF 6.3 1区文学 Q1 COMMUNICATION

Communication Methods and Measures Pub Date : 2022-06-27 DOI:10.1080/19312458.2022.2088713

Stephanie K Van Stee, Qinghua Yang, Stephen A. Rains

{"title":"沟通元分析中统计报告实践不足及其后果的实证研究","authors":"Stephanie K Van Stee, Qinghua Yang, Stephen A. Rains","doi":"10.1080/19312458.2022.2088713","DOIUrl":null,"url":null,"abstract":"ABSTRACT Insufficient statistical reporting practices (ISRPs) involve failure to report effect sizes or the information necessary to compute them in quantitative research. ISRPs can present problems for advancing knowledge in the field of Communication. Because, among other issues, studies containing ISRPs cannot be included in meta-analytic reviews, this practice undermines our ability to quantitatively summarize the findings from communication research with precision. We examine the prevalence and consequences of ISRPs among 50 meta-analyses published in four flagship communication journals. Our findings indicate that 80% of meta-analyses excluded at least one otherwise qualified primary study due to ISRPs, with a median of 6.5% of studies (k = 2) excluded per meta-analysis. The amount of inaccuracy introduced by ISRPs in the results of meta-analyses was small. Implications of the findings for communication research are discussed.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"17 1","pages":"1 - 16"},"PeriodicalIF":6.3000,"publicationDate":"2022-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Empirical Investigation of Inadequate Statistical Reporting Practices in Communication Meta-Analyses and Their Consequences\",\"authors\":\"Stephanie K Van Stee, Qinghua Yang, Stephen A. Rains\",\"doi\":\"10.1080/19312458.2022.2088713\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"ABSTRACT Insufficient statistical reporting practices (ISRPs) involve failure to report effect sizes or the information necessary to compute them in quantitative research. ISRPs can present problems for advancing knowledge in the field of Communication. Because, among other issues, studies containing ISRPs cannot be included in meta-analytic reviews, this practice undermines our ability to quantitatively summarize the findings from communication research with precision. We examine the prevalence and consequences of ISRPs among 50 meta-analyses published in four flagship communication journals. Our findings indicate that 80% of meta-analyses excluded at least one otherwise qualified primary study due to ISRPs, with a median of 6.5% of studies (k = 2) excluded per meta-analysis. The amount of inaccuracy introduced by ISRPs in the results of meta-analyses was small. Implications of the findings for communication research are discussed.\",\"PeriodicalId\":47552,\"journal\":{\"name\":\"Communication Methods and Measures\",\"volume\":\"17 1\",\"pages\":\"1 - 16\"},\"PeriodicalIF\":6.3000,\"publicationDate\":\"2022-06-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Communication Methods and Measures\",\"FirstCategoryId\":\"98\",\"ListUrlMain\":\"https://doi.org/10.1080/19312458.2022.2088713\",\"RegionNum\":1,\"RegionCategory\":\"文学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMMUNICATION\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Communication Methods and Measures","FirstCategoryId":"98","ListUrlMain":"https://doi.org/10.1080/19312458.2022.2088713","RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMMUNICATION","Score":null,"Total":0}

引用次数: 0

摘要

摘要统计报告实践不足（ISRP）涉及未能在定量研究中报告影响大小或计算影响大小所需的信息。ISRP可能会给传播领域的知识进步带来问题。因为，除其他问题外，包含ISRP的研究不能包括在元分析综述中，这种做法破坏了我们准确定量总结传播研究结果的能力。我们在四种旗舰传播期刊上发表的50项荟萃分析中检验了ISRP的流行率和后果。我们的研究结果表明，80%的荟萃分析排除了至少一项因ISRP而合格的主要研究，每次荟萃分析的中位数为6.5%的研究（k=2）被排除。ISRP在荟萃分析结果中引入的不准确度很小。讨论了这些发现对传播学研究的启示。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

An Empirical Investigation of Inadequate Statistical Reporting Practices in Communication Meta-Analyses and Their Consequences

ABSTRACT Insufficient statistical reporting practices (ISRPs) involve failure to report effect sizes or the information necessary to compute them in quantitative research. ISRPs can present problems for advancing knowledge in the field of Communication. Because, among other issues, studies containing ISRPs cannot be included in meta-analytic reviews, this practice undermines our ability to quantitatively summarize the findings from communication research with precision. We examine the prevalence and consequences of ISRPs among 50 meta-analyses published in four flagship communication journals. Our findings indicate that 80% of meta-analyses excluded at least one otherwise qualified primary study due to ISRPs, with a median of 6.5% of studies (k = 2) excluded per meta-analysis. The amount of inaccuracy introduced by ISRPs in the results of meta-analyses was small. Implications of the findings for communication research are discussed.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Communication Methods and Measures COMMUNICATION-

CiteScore

21.10

自引率

1.80%

发文量

期刊介绍： Communication Methods and Measures aims to achieve several goals in the field of communication research. Firstly, it aims to bring attention to and showcase developments in both qualitative and quantitative research methodologies to communication scholars. This journal serves as a platform for researchers across the field to discuss and disseminate methodological tools and approaches. Additionally, Communication Methods and Measures seeks to improve research design and analysis practices by offering suggestions for improvement. It aims to introduce new methods of measurement that are valuable to communication scientists or enhance existing methods. The journal encourages submissions that focus on methods for enhancing research design and theory testing, employing both quantitative and qualitative approaches. Furthermore, the journal is open to articles devoted to exploring the epistemological aspects relevant to communication research methodologies. It welcomes well-written manuscripts that demonstrate the use of methods and articles that highlight the advantages of lesser-known or newer methods over those traditionally used in communication. In summary, Communication Methods and Measures strives to advance the field of communication research by showcasing and discussing innovative methodologies, improving research practices, and introducing new measurement methods.