Paul Amari , George Banks , Leah Bourque , Holly Holladay , Ernest O’Boyle
{"title":"效应大小基准:是时候进行因果复兴了","authors":"Paul Amari , George Banks , Leah Bourque , Holly Holladay , Ernest O’Boyle","doi":"10.1016/j.leaqua.2024.101855","DOIUrl":null,"url":null,"abstract":"<div><div>Effect size benchmarks guide theory, aid in interpreting practical significance, and help gauge scientific progress. However, effect size benchmarks derived from correlations typically violate the definition of an “effect” because they do not capture a singular causal relationship and instead represent an ambiguous amalgamation of additive, multiplicative, and interactive causes. Therefore, correlational benchmarks can be highly misleading to the point of threatening the very livelihood of society at large by misinforming policy and decision-making. To highlight these issues and demonstrate a more productive path forward, we begin by reviewing the four key challenges in creating effect size benchmarks and establishing evidence of causal inference strength. We then illustrate the limitations and opportunities in current practice through a systematic review of the leadership literature that highlights four themes related to causally identified effect sizes. We conclude this work with a blueprint that provides a meaningful redirection of the conversation so that future meta-analytic studies can provide accurate, specific, and unconfounded effect size benchmarks to achieve a more robust and cumulative science.</div></div>","PeriodicalId":48434,"journal":{"name":"Leadership Quarterly","volume":"36 1","pages":"Article 101855"},"PeriodicalIF":9.1000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Effect size benchmarks: Time for a causal renaissance\",\"authors\":\"Paul Amari , George Banks , Leah Bourque , Holly Holladay , Ernest O’Boyle\",\"doi\":\"10.1016/j.leaqua.2024.101855\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Effect size benchmarks guide theory, aid in interpreting practical significance, and help gauge scientific progress. However, effect size benchmarks derived from correlations typically violate the definition of an “effect” because they do not capture a singular causal relationship and instead represent an ambiguous amalgamation of additive, multiplicative, and interactive causes. Therefore, correlational benchmarks can be highly misleading to the point of threatening the very livelihood of society at large by misinforming policy and decision-making. To highlight these issues and demonstrate a more productive path forward, we begin by reviewing the four key challenges in creating effect size benchmarks and establishing evidence of causal inference strength. We then illustrate the limitations and opportunities in current practice through a systematic review of the leadership literature that highlights four themes related to causally identified effect sizes. We conclude this work with a blueprint that provides a meaningful redirection of the conversation so that future meta-analytic studies can provide accurate, specific, and unconfounded effect size benchmarks to achieve a more robust and cumulative science.</div></div>\",\"PeriodicalId\":48434,\"journal\":{\"name\":\"Leadership Quarterly\",\"volume\":\"36 1\",\"pages\":\"Article 101855\"},\"PeriodicalIF\":9.1000,\"publicationDate\":\"2025-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Leadership Quarterly\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1048984324000845\",\"RegionNum\":1,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MANAGEMENT\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Leadership Quarterly","FirstCategoryId":"91","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1048984324000845","RegionNum":1,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MANAGEMENT","Score":null,"Total":0}
Effect size benchmarks: Time for a causal renaissance
Effect size benchmarks guide theory, aid in interpreting practical significance, and help gauge scientific progress. However, effect size benchmarks derived from correlations typically violate the definition of an “effect” because they do not capture a singular causal relationship and instead represent an ambiguous amalgamation of additive, multiplicative, and interactive causes. Therefore, correlational benchmarks can be highly misleading to the point of threatening the very livelihood of society at large by misinforming policy and decision-making. To highlight these issues and demonstrate a more productive path forward, we begin by reviewing the four key challenges in creating effect size benchmarks and establishing evidence of causal inference strength. We then illustrate the limitations and opportunities in current practice through a systematic review of the leadership literature that highlights four themes related to causally identified effect sizes. We conclude this work with a blueprint that provides a meaningful redirection of the conversation so that future meta-analytic studies can provide accurate, specific, and unconfounded effect size benchmarks to achieve a more robust and cumulative science.
期刊介绍:
The Leadership Quarterly is a social-science journal dedicated to advancing our understanding of leadership as a phenomenon, how to study it, as well as its practical implications.
Leadership Quarterly seeks contributions from various disciplinary perspectives, including psychology broadly defined (i.e., industrial-organizational, social, evolutionary, biological, differential), management (i.e., organizational behavior, strategy, organizational theory), political science, sociology, economics (i.e., personnel, behavioral, labor), anthropology, history, and methodology.Equally desirable are contributions from multidisciplinary perspectives.