{"title":"Nmax以及对恢复样本量规划过程的谨慎性、完整性和实用性的追求。","authors":"Gregory R Hancock,Yi Feng","doi":"10.1037/met0000776","DOIUrl":null,"url":null,"abstract":"In a time when the alarms of research replicability are sounding louder than ever, mapping out studies with statistical and inferential integrity is of paramount importance. Indeed, funding agencies almost always require grant applicants to present compelling a priori power analyses to justify proposed sample sizes, as a critical part of the information considered collectively to ensure a sound investment. Unfortunately, even researchers' most sincere attempts at sample size planning are fraught with the fundamental challenge of setting numerical values not just for the focal parameters for which statistical tests are planned, but for each of the model's other, more peripheral or contextual parameters as well. As we plainly demonstrate, regarding the latter parameters, even in very simple models, any slight deviation in well-intentioned numerical guesses can undermine power for the assessment of the more focal parameters that are of key theoretical interest. Toward remedying this all-too-common but seemingly underestimated problem in power analysis, we adopt a hope-for-the-best-but-plan-for-the-worst mindset and present new methods that attempt to (a) restore appropriate conservatism and robustness, and in turn credibility, to the sample size planning process, and (b) greatly simplify that process. Derivations and suggestions for practice are presented using the framework of measured variable path analysis models as they subsume many of the types of models (e.g., multiple linear regression, analysis of variance) for which sample size planning is of interest. (PsycInfo Database Record (c) 2025 APA, all rights reserved).","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":"5 1","pages":""},"PeriodicalIF":7.8000,"publicationDate":"2025-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"nmax and the quest to restore caution, integrity, and practicality to the sample size planning process.\",\"authors\":\"Gregory R Hancock,Yi Feng\",\"doi\":\"10.1037/met0000776\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In a time when the alarms of research replicability are sounding louder than ever, mapping out studies with statistical and inferential integrity is of paramount importance. Indeed, funding agencies almost always require grant applicants to present compelling a priori power analyses to justify proposed sample sizes, as a critical part of the information considered collectively to ensure a sound investment. Unfortunately, even researchers' most sincere attempts at sample size planning are fraught with the fundamental challenge of setting numerical values not just for the focal parameters for which statistical tests are planned, but for each of the model's other, more peripheral or contextual parameters as well. As we plainly demonstrate, regarding the latter parameters, even in very simple models, any slight deviation in well-intentioned numerical guesses can undermine power for the assessment of the more focal parameters that are of key theoretical interest. Toward remedying this all-too-common but seemingly underestimated problem in power analysis, we adopt a hope-for-the-best-but-plan-for-the-worst mindset and present new methods that attempt to (a) restore appropriate conservatism and robustness, and in turn credibility, to the sample size planning process, and (b) greatly simplify that process. Derivations and suggestions for practice are presented using the framework of measured variable path analysis models as they subsume many of the types of models (e.g., multiple linear regression, analysis of variance) for which sample size planning is of interest. (PsycInfo Database Record (c) 2025 APA, all rights reserved).\",\"PeriodicalId\":20782,\"journal\":{\"name\":\"Psychological methods\",\"volume\":\"5 1\",\"pages\":\"\"},\"PeriodicalIF\":7.8000,\"publicationDate\":\"2025-08-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Psychological methods\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1037/met0000776\",\"RegionNum\":1,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHOLOGY, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychological methods","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/met0000776","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
摘要
在一个研究可复制性的警报比以往任何时候都响亮的时代,绘制具有统计和推理完整性的研究是至关重要的。事实上,资助机构几乎总是要求赠款申请人提出令人信服的先验能力分析,以证明拟议的样本量是合理的,这是集体考虑的信息的关键部分,以确保合理的投资。不幸的是,即使是研究人员在样本量规划方面最真诚的尝试也充满了基本的挑战,即不仅要为计划进行统计测试的重点参数设置数值,还要为模型的其他更外围或背景参数设置数值。正如我们清楚地表明的那样,对于后一种参数,即使在非常简单的模型中,善意的数值猜测的任何轻微偏差都可能破坏对具有关键理论兴趣的更重要参数的评估能力。为了纠正这个在功率分析中太常见但似乎被低估的问题,我们采用了一种抱最好的希望但做最坏的计划的心态,并提出了新的方法,试图(a)恢复适当的保守性和稳健性,以及反过来的可信度,以样本量计划过程,并且(b)大大简化该过程。使用测量变量路径分析模型的框架提出了推导和实践建议,因为它们包含了许多类型的模型(例如,多元线性回归,方差分析),其中样本量规划是感兴趣的。(PsycInfo Database Record (c) 2025 APA,版权所有)。
nmax and the quest to restore caution, integrity, and practicality to the sample size planning process.
In a time when the alarms of research replicability are sounding louder than ever, mapping out studies with statistical and inferential integrity is of paramount importance. Indeed, funding agencies almost always require grant applicants to present compelling a priori power analyses to justify proposed sample sizes, as a critical part of the information considered collectively to ensure a sound investment. Unfortunately, even researchers' most sincere attempts at sample size planning are fraught with the fundamental challenge of setting numerical values not just for the focal parameters for which statistical tests are planned, but for each of the model's other, more peripheral or contextual parameters as well. As we plainly demonstrate, regarding the latter parameters, even in very simple models, any slight deviation in well-intentioned numerical guesses can undermine power for the assessment of the more focal parameters that are of key theoretical interest. Toward remedying this all-too-common but seemingly underestimated problem in power analysis, we adopt a hope-for-the-best-but-plan-for-the-worst mindset and present new methods that attempt to (a) restore appropriate conservatism and robustness, and in turn credibility, to the sample size planning process, and (b) greatly simplify that process. Derivations and suggestions for practice are presented using the framework of measured variable path analysis models as they subsume many of the types of models (e.g., multiple linear regression, analysis of variance) for which sample size planning is of interest. (PsycInfo Database Record (c) 2025 APA, all rights reserved).
期刊介绍:
Psychological Methods is devoted to the development and dissemination of methods for collecting, analyzing, understanding, and interpreting psychological data. Its purpose is the dissemination of innovations in research design, measurement, methodology, and quantitative and qualitative analysis to the psychological community; its further purpose is to promote effective communication about related substantive and methodological issues. The audience is expected to be diverse and to include those who develop new procedures, those who are responsible for undergraduate and graduate training in design, measurement, and statistics, as well as those who employ those procedures in research.