William M. Cready, Jiapeng He, Wen-Hsiang Lin, Chengdao Shao, Di Wang, Yang Zhang
{"title":"Is There a Confidence Interval for That? A Critical Examination of Null Outcome Reporting in Accounting Research","authors":"William M. Cready, Jiapeng He, Wen-Hsiang Lin, Chengdao Shao, Di Wang, Yang Zhang","doi":"10.2139/ssrn.3131251","DOIUrl":null,"url":null,"abstract":"This study evaluates how accounting researchers analyze and report null outcomes based on an examination of recent accounting research publications. As null outcomes reflect failures to provide compelling evidence against a proposed null hypothesis, in and of themselves they have little inferential value. Nevertheless, we find that articles routinely interpret such outcomes in a highly conclusive manner, using terms such as: did not, is no difference, find no effect, equals, no association, etc. We also find little evidence that articles subject the available evidence to further statistical examinations that might provide relevant insights about the studied phenomenon. The analysis also illustrates the use of confidence intervals as a useful approach for providing insights about the location, inconsequentiality, and associated estimation precision of studied relations in null outcome settings.","PeriodicalId":202880,"journal":{"name":"Research Methods & Methodology in Accounting eJournal","volume":"31 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"35","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research Methods & Methodology in Accounting eJournal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2139/ssrn.3131251","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 35
Abstract
This study evaluates how accounting researchers analyze and report null outcomes based on an examination of recent accounting research publications. As null outcomes reflect failures to provide compelling evidence against a proposed null hypothesis, in and of themselves they have little inferential value. Nevertheless, we find that articles routinely interpret such outcomes in a highly conclusive manner, using terms such as: did not, is no difference, find no effect, equals, no association, etc. We also find little evidence that articles subject the available evidence to further statistical examinations that might provide relevant insights about the studied phenomenon. The analysis also illustrates the use of confidence intervals as a useful approach for providing insights about the location, inconsequentiality, and associated estimation precision of studied relations in null outcome settings.