{"title":"Sample size justification in feasibility studies: moving beyond published guidance.","authors":"Robert Montgomery","doi":"10.1186/s40814-025-01675-9","DOIUrl":null,"url":null,"abstract":"<p><p>Pilot and feasibility studies are crucial for determining whether follow-up trials should be conducted. To be effective, these studies need to be properly designed and have large enough samples to make correct decisions about proceeding to a future trial at a high rate. However, there is significantly less clarity about best practices concerning sample size justifications compared to larger randomized controlled trials which are usually justified by power analyses. This has led to many feasibility studies justifying sample sizes based on pragmatic reasons (e.g., the ability to complete) or on published guidance and various rules of thumb. We argue that feasibility studies should be designed for, or at least report relevant operating characteristics, specifically, the probability of determining a future trial will be feasible when it is and the probability of determining a trial will be feasible when it is not and that sample size justifications should be based on these operating characteristics whenever possible. If relevant operating characteristics for a study are not reported, it is difficult to know whether the evidence from these trials can be used to claim a future trial would be feasible. In this paper, we review common methods for determining samples sizes in feasibility studies, report a narrative review of recently published feasibility studies and use two case-studies to highlight core issues we believe exist in the current design and reporting of these studies. Finally, we provide some suggestions that we believe will enhance the sample size justifications and overall effectiveness of these important trials.</p>","PeriodicalId":20176,"journal":{"name":"Pilot and Feasibility Studies","volume":"11 1","pages":"88"},"PeriodicalIF":1.5000,"publicationDate":"2025-06-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12186404/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pilot and Feasibility Studies","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1186/s40814-025-01675-9","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MEDICINE, RESEARCH & EXPERIMENTAL","Score":null,"Total":0}
引用次数: 0
Abstract
Pilot and feasibility studies are crucial for determining whether follow-up trials should be conducted. To be effective, these studies need to be properly designed and have large enough samples to make correct decisions about proceeding to a future trial at a high rate. However, there is significantly less clarity about best practices concerning sample size justifications compared to larger randomized controlled trials which are usually justified by power analyses. This has led to many feasibility studies justifying sample sizes based on pragmatic reasons (e.g., the ability to complete) or on published guidance and various rules of thumb. We argue that feasibility studies should be designed for, or at least report relevant operating characteristics, specifically, the probability of determining a future trial will be feasible when it is and the probability of determining a trial will be feasible when it is not and that sample size justifications should be based on these operating characteristics whenever possible. If relevant operating characteristics for a study are not reported, it is difficult to know whether the evidence from these trials can be used to claim a future trial would be feasible. In this paper, we review common methods for determining samples sizes in feasibility studies, report a narrative review of recently published feasibility studies and use two case-studies to highlight core issues we believe exist in the current design and reporting of these studies. Finally, we provide some suggestions that we believe will enhance the sample size justifications and overall effectiveness of these important trials.
期刊介绍:
Pilot and Feasibility Studies encompasses all aspects of the design, conduct and reporting of pilot and feasibility studies in biomedicine. The journal publishes research articles that are intended to directly influence future clinical trials or large scale observational studies, as well as protocols, commentaries and methodology articles. The journal also ensures that the results of all well-conducted, peer-reviewed, pilot and feasibility studies are published, regardless of outcome or significance of findings. Pilot and feasibility studies are increasingly conducted prior to a full randomized controlled trial. However, these studies often lack clear objectives, many remain unpublished, and there is confusion over the meanings of the words “pilot” and “feasibility”. Pilot and Feasibility Studies provides a forum for discussion around this key aspect of the scientific process, and seeks to ensure that these studies are published, so as to complete the publication thread for clinical research.