{"title":"The permutation test: a simple way to test hypotheses.","authors":"Xiaofeng Steven Liu","doi":"10.7748/nr.2024.e1920","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Quantitative researchers can use permutation tests to conduct null hypothesis significance testing without resorting to complicated distribution theory. A permutation test can reach conclusions in hypothesis testing that are the same as those of better-known tests such as the t-test but is much easier to understand and implement.</p><p><strong>Aim: </strong>To introduce and explain permutation tests using two real examples of independent and dependent t-tests and their corresponding permutation tests.</p><p><strong>Discussion: </strong>This article traces the history of permutation tests, explains the possible reason for their absence in textbooks and offers a simple example of their implementation. It provides simple code written in the R programming language to generate the null distributions and P -values for the permutation tests.</p><p><strong>Conclusion: </strong>Permutation tests do not require the strict model assumptions of t -tests and can be robust alternatives.</p><p><strong>Implications for practice: </strong>Permutation tests are a useful addition to practitioners' research repertoire for testing hypotheses.</p>","PeriodicalId":1,"journal":{"name":"Accounts of Chemical Research","volume":null,"pages":null},"PeriodicalIF":16.4000,"publicationDate":"2024-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Accounts of Chemical Research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.7748/nr.2024.e1920","RegionNum":1,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/30 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Quantitative researchers can use permutation tests to conduct null hypothesis significance testing without resorting to complicated distribution theory. A permutation test can reach conclusions in hypothesis testing that are the same as those of better-known tests such as the t-test but is much easier to understand and implement.
Aim: To introduce and explain permutation tests using two real examples of independent and dependent t-tests and their corresponding permutation tests.
Discussion: This article traces the history of permutation tests, explains the possible reason for their absence in textbooks and offers a simple example of their implementation. It provides simple code written in the R programming language to generate the null distributions and P -values for the permutation tests.
Conclusion: Permutation tests do not require the strict model assumptions of t -tests and can be robust alternatives.
Implications for practice: Permutation tests are a useful addition to practitioners' research repertoire for testing hypotheses.
背景:定量研究人员可以使用置换检验来进行零假设的显著性检验,而无需借助复杂的分布理论。目的:通过两个独立和从属 t 检验及其相应的置换检验的实际例子,介绍和解释置换检验:本文追溯了置换检验的历史,解释了教科书中缺乏置换检验的可能原因,并提供了一个实现置换检验的简单示例。文章提供了用 R 编程语言编写的简单代码,用于生成置换检验的空分布和 P 值:结论:置换检验不需要 t 检验的严格模型假设,可以作为稳健的替代方法:对实践的启示:置换检验是实践者检验假设的研究手段的有益补充。
期刊介绍:
Accounts of Chemical Research presents short, concise and critical articles offering easy-to-read overviews of basic research and applications in all areas of chemistry and biochemistry. These short reviews focus on research from the author’s own laboratory and are designed to teach the reader about a research project. In addition, Accounts of Chemical Research publishes commentaries that give an informed opinion on a current research problem. Special Issues online are devoted to a single topic of unusual activity and significance.
Accounts of Chemical Research replaces the traditional article abstract with an article "Conspectus." These entries synopsize the research affording the reader a closer look at the content and significance of an article. Through this provision of a more detailed description of the article contents, the Conspectus enhances the article's discoverability by search engines and the exposure for the research.