Fiscal StudiesPub Date : 2025-09-24DOI: 10.1111/1475-5890.70007
Monica Costa Dias, Marcos Vera-Hernández
{"title":"A symposium on power in experiments – new practical insights and tools: preface","authors":"Monica Costa Dias, Marcos Vera-Hernández","doi":"10.1111/1475-5890.70007","DOIUrl":"https://doi.org/10.1111/1475-5890.70007","url":null,"abstract":"<p>The use of randomised control trials (RCTs) has become widespread in economics and other social sciences, and is likely to grow further as new digital tools and increasingly rich data facilitate the design and implementation of experiments. When rigorously designed and implemented, they have the potential to offer the most reliable empirical evidence on the causal impact of an intervention. But for that potential to be realised, RCTs need to be sufficiently powered to detect a meaningful effect, or to say confidently that the effect is negligible. This symposium offers practical insights for researchers on designing more powerful experiments and computing the required sample size, accompanied by tools that researchers can use in designing their own RCTs.</p><p>The first paper, by David McKenzie, discusses how to improve power at each stage of an RCT – design, implementation and analysis. While increasing sample size is the default option, McKenzie offers guidance on many other options available to researchers and why they work. The second paper, by Brendon McConnell and Marcos Vera-Hernández, dives into detailed aspects of implementing sample size calculations for different randomisation designs, and offers the formulae, tools and computer code necessary to implement them in practice. The final paper, by Brandon Hauser and Mauricio Olivares, studies hypothesis testing in randomised experiments, and its consequences for sample size calculations. The paper shows how small deviations from the most standard assumptions invalidate standard randomisation-based inference, and provides useful results and guidance for how to adapt power analysis to ensure that calculations remain valid.</p>","PeriodicalId":51602,"journal":{"name":"Fiscal Studies","volume":"46 3","pages":""},"PeriodicalIF":1.3,"publicationDate":"2025-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/1475-5890.70007","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145122635","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fiscal StudiesPub Date : 2025-09-13DOI: 10.1111/1475-5890.70005
Brendon McConnell, Marcos Vera-Hernández
{"title":"Going beyond simple sample size calculations: a practitioner's guide","authors":"Brendon McConnell, Marcos Vera-Hernández","doi":"10.1111/1475-5890.70005","DOIUrl":"https://doi.org/10.1111/1475-5890.70005","url":null,"abstract":"<p>Basic methods to compute required sample sizes are well understood and supported by widely available software. However, researchers often oversimplify their sample size calculations, overlooking relevant features of their experimental design. This paper compiles and systematises existing methods for sample size calculations for continuous and binary outcomes, both with and without covariates, and for both clustered and non-clustered randomised controlled trials. We present formulae accommodating panel data structures and uneven designs, and provide guidance on optimally allocating sample size between the number of clusters and the number of units per cluster. In addition, we discuss how to adjust calculations for multiple hypothesis testing and how to estimate power in more complex designs using simulation methods.</p>","PeriodicalId":51602,"journal":{"name":"Fiscal Studies","volume":"46 3","pages":"323-348"},"PeriodicalIF":1.3,"publicationDate":"2025-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/1475-5890.70005","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145122627","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fiscal StudiesPub Date : 2025-09-07DOI: 10.1111/1475-5890.70004
Brandon Hauser, Mauricio Olivares
{"title":"A primer on power and sample size calculations for randomisation inference with experimental data","authors":"Brandon Hauser, Mauricio Olivares","doi":"10.1111/1475-5890.70004","DOIUrl":"https://doi.org/10.1111/1475-5890.70004","url":null,"abstract":"<p>This paper revisits the problem of power analysis and sample size calculations in randomised experiments, with a focus on settings where inference on average treatment effects is conducted using randomisation tests. While standard formulas based on the two-sample <span></span><math>\u0000 <semantics>\u0000 <mi>t</mi>\u0000 <annotation>$t$</annotation>\u0000 </semantics></math>-test are widely used in practice, we show that these calculations may yield misleading results when directly applied to randomisation-based inference – unless certain assumptions are met. We demonstrate that differences in potential outcome variances or unequal group sizes can distort the behaviour of the randomisation test, leading to incorrect power and flawed sample size calculations. However, a simple adjustment – studentising the test statistic – restores the validity of the randomisation test in large samples. This adjustment allows researchers to safely apply standard power and sample size formulas, even when using randomisation inference. We extend these results to a range of experimental designs commonly used in applied economics, including stratified randomisation, matched pairs and cluster-randomised trials. Throughout, we provide practical guidance to help researchers ensure that their design-stage calculations remain valid under the inferential methods they plan to use.</p>","PeriodicalId":51602,"journal":{"name":"Fiscal Studies","volume":"46 3","pages":"349-371"},"PeriodicalIF":1.3,"publicationDate":"2025-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145122623","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fiscal StudiesPub Date : 2025-09-01DOI: 10.1111/1475-5890.70003
David McKenzie
{"title":"Designing and analysing powerful experiments: practical tips for applied researchers","authors":"David McKenzie","doi":"10.1111/1475-5890.70003","DOIUrl":"https://doi.org/10.1111/1475-5890.70003","url":null,"abstract":"<p>This paper offers practical advice on how to improve statistical power in randomised experiments through choices and actions researchers can take at the design, implementation and analysis stages. At the design stage, the choice of estimand, choice of treatment, and decisions that affect the residual variance and intra-cluster correlation can all affect power for a given sample size. At the implementation stage, researchers can boost power through increasing compliance with treatment, reducing attrition and improving outcome measurement. At the analysis stage, power can be increased through using different test statistics or estimands, through the choice of control variables, and through incorporating informative priors in a Bayesian analysis. A key message is that it does not make sense to talk of ‘the’ power of an experiment. A study can be well powered for one outcome or estimand but not others, and a fixed sample size can yield very different levels of power depending on researcher decisions.</p>","PeriodicalId":51602,"journal":{"name":"Fiscal Studies","volume":"46 3","pages":"305-322"},"PeriodicalIF":1.3,"publicationDate":"2025-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145122620","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fiscal StudiesPub Date : 2025-07-02DOI: 10.1111/1475-5890.70001
Martín Ardanaz, Evelyne Hübscher, Philip Keefer, Thomas Sattler
{"title":"Policy misperceptions, information, and the demand for redistributive tax reform: experimental evidence from Latin America","authors":"Martín Ardanaz, Evelyne Hübscher, Philip Keefer, Thomas Sattler","doi":"10.1111/1475-5890.70001","DOIUrl":"https://doi.org/10.1111/1475-5890.70001","url":null,"abstract":"<p>Why do individuals fail to support tax reforms that serve their material self-interest? Using an original online survey experiment spanning eight countries and 12,000 respondents across Latin America, one of the most unequal regions in the world, we find evidence for a previously unexplored explanation: misperceptions regarding the current incidence of the taxes to be reformed. Treated respondents who are informed that the value-added tax (VAT) is regressive are significantly more likely to prefer reforms that make it more progressive. Treatment effects are driven by the large fraction of respondents who underestimate the regressivity of the VAT. They are disproportionately right-leaning and more likely to attribute success to individual effort than luck; treatment effects are largest among individuals who hold these views of the world. Many respondents exhibit inconsistent preferences, violating the generalised axiom of revealed preferences; treatment effects are significantly stronger among consistent respondents. These findings expand the potential for information interventions to shift support for fiscal policy reforms protecting the most vulnerable.</p>","PeriodicalId":51602,"journal":{"name":"Fiscal Studies","volume":"46 3","pages":"373-397"},"PeriodicalIF":1.3,"publicationDate":"2025-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145122621","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fiscal StudiesPub Date : 2025-06-19DOI: 10.1111/1475-5890.70000
Joanna Clifton-Sprigg, Eleonora Fichera, Ezgi Kaya, Melanie Jones
{"title":"Fathers taking leave: evaluating the impact of shared parental leave in the United Kingdom","authors":"Joanna Clifton-Sprigg, Eleonora Fichera, Ezgi Kaya, Melanie Jones","doi":"10.1111/1475-5890.70000","DOIUrl":"https://doi.org/10.1111/1475-5890.70000","url":null,"abstract":"<p>We study the effect of the introduction of the UK Shared Parental Leave policy in 2015 on both the uptake and the length of leave taken by fathers. Using data from the UK Household Longitudinal Study and a regression discontinuity in time design, we find no evidence that the reform increased either uptake or length of paternal leave, reinforcing questions about its effectiveness.</p>","PeriodicalId":51602,"journal":{"name":"Fiscal Studies","volume":"46 3","pages":"399-410"},"PeriodicalIF":1.3,"publicationDate":"2025-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/1475-5890.70000","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145122632","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fiscal StudiesPub Date : 2025-04-02DOI: 10.1111/1475-5890.12405
Monica Costa Dias, Emma Tominey, Vivian Zhao
{"title":"A symposium on poverty, the safety net and child development: preface","authors":"Monica Costa Dias, Emma Tominey, Vivian Zhao","doi":"10.1111/1475-5890.12405","DOIUrl":"https://doi.org/10.1111/1475-5890.12405","url":null,"abstract":"<p>Recent rises in the cost of living, combined with increasingly tight public budgets that pressure governments into cutting welfare spending, have renewed attention to the plights of disadvantaged families and the potential long-term consequences of living in poverty during childhood. These concerns are justified by mounting empirical evidence showing that the health, education and future labour market outcomes of children are strongly associated with the financial resources of their parental families. Yet, evidence on the extent to which income or poverty affects child outcomes remains scarce. On the policy side, the consequences of growing up in poverty and the role of the safety net in attenuating long-lasting disadvantage is a matter that attracts huge attention. Many have argued that those policies can be self-financing, by supporting the healthy childhood experiences and the formation of skills that promote successful educational and labour market trajectories.</p><p>In practice, researchers aiming to quantify the causal impact of parental financial resources and of public transfers to families with children face serious challenges. One issue is that variation in financial resources across families is associated with variation in many other family characteristics, including the skills and preferences of parents, making it difficult to disentangle the roles played by different aspects of family life. Moreover, income variation can take many forms, and it is not clear that all carry the same impacts. For instance, some families are permanently more affluent than others, and may plan accordingly for persistently higher levels of investment in children. That certainty and time consistency in investments may be valuable in themselves. In some cases, families may experience transitory changes in income that induce unexpected changes in child investment. The impacts of those shocks for child development may depend on the characteristics of the child, the family and the social or institutional environments. Public transfers to disadvantaged families often come with strings attached such as work requirements for mothers, or may be associated with stigma. All those can interfere with their impacts on children.</p><p>This symposium revises our current understanding of the long-lasting consequences of child poverty, and of the role of the safety net for protecting disadvantaged children in high-income economies. This is an especially good time to take stock of what has been learned so far as public transfers increasingly contribute to keep children out of poverty. Figure 1 illustrates this point for the UK. It plots the recent evolution of child poverty rates in lone-parent and dual-adult parent households using two measures: household disposable income, represented by the solid lines, and household income excluding income from benefits, represented by the dotted lines. It shows that, when benefits are excluded from family income, poverty rates among","PeriodicalId":51602,"journal":{"name":"Fiscal Studies","volume":"46 1","pages":"5-7"},"PeriodicalIF":2.2,"publicationDate":"2025-04-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/1475-5890.12405","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143865712","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fiscal StudiesPub Date : 2025-04-02DOI: 10.1111/1475-5890.12404
Pedro Carneiro, Sarah Cattan, Henrique Neves
{"title":"Theoretical and empirical perspectives on the link between poverty, parenting and children's outcomes","authors":"Pedro Carneiro, Sarah Cattan, Henrique Neves","doi":"10.1111/1475-5890.12404","DOIUrl":"https://doi.org/10.1111/1475-5890.12404","url":null,"abstract":"<p>In this paper we examine different channels through which poverty affects child outcomes, as well as the evidence regarding the magnitude of their impacts. We begin by discussing the family investment model, which highlights the constraints that poverty or lack of income pose on a family's ability to purchase goods or services that contribute to the child's overall development, and the family stress model, which emphasises the emotional toll that experiencing poverty can have on parents and (directly and indirectly) on children. We then devote special attention to a more recent perspective on the family stress model, originating at the intersection of cognitive and developmental psychology and behavioural economics, which posits that another pathway through which poverty-induced stress can affect family well-being is through the effect of poverty on parental cognitive functioning.</p>","PeriodicalId":51602,"journal":{"name":"Fiscal Studies","volume":"46 1","pages":"9-35"},"PeriodicalIF":2.2,"publicationDate":"2025-04-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/1475-5890.12404","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143865713","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fiscal StudiesPub Date : 2025-03-03DOI: 10.1111/1475-5890.12403
Bee Boileau, David Sturrock
{"title":"Who gives and receives substantial inter vivos financial transfers in Britain?","authors":"Bee Boileau, David Sturrock","doi":"10.1111/1475-5890.12403","DOIUrl":"https://doi.org/10.1111/1475-5890.12403","url":null,"abstract":"<p>We document new stylised facts about substantial gifts and loans made in Great Britain. The vast majority of gifts and loans are made from parents to their adult children, and we find substantive differences in receiving by ethnicity, region and gender. Gifts are only weakly related to individuals' economic resources once their parents' socio-economic status is accounted for, but loans are made more frequently to those with lower wealth. Transfers modestly increase inequalities in total inflows (income plus transfers) over early adulthood. Over an eight-year period, cumulative transfers received are worth 0.5 per cent of income for those in the bottom income fifth compared to 2.6 per cent of income for the top fifth. Over half of the value of gifts is given by the wealthiest fifth of individuals and transfers increase inequalities between those with parents of higher and lower socio-economic status. However, transfers decrease relative inequalities in wealth, being largest as a share of wealth for those at the bottom of the wealth distribution.</p>","PeriodicalId":51602,"journal":{"name":"Fiscal Studies","volume":"46 2","pages":"261-280"},"PeriodicalIF":2.2,"publicationDate":"2025-03-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/1475-5890.12403","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144299522","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fiscal StudiesPub Date : 2025-02-20DOI: 10.1111/1475-5890.12402
Felipe Jordán
{"title":"Prompt payment enforcement on framework agreements for public hospitals: evidence from Chile","authors":"Felipe Jordán","doi":"10.1111/1475-5890.12402","DOIUrl":"https://doi.org/10.1111/1475-5890.12402","url":null,"abstract":"<p>Demand aggregation through Framework Agreements (FAs) has emerged as a promising tool to support the efficient expansion of affordable healthcare in developing countries. However, the effectiveness of FAs in achieving lower costs may be hindered if prompt payment is not enforced. This paper estimates the impacts of a reform implemented in Chile in 2014, which introduced a prompt payment enforcement procedure in the FAs that supplied public hospitals. Under this reform, firms were allowed to suspend dispatches until overdue bills were paid. The results from a difference-in-differences estimation indicate that hospitals with greater exposure to the reform, measured by their larger share of late bill payments, reduced their payment delays after 2013 compared with less-exposed hospitals, without compromising health-care quality. The resulting decrease in the average financial cost of FAs led to lower prices, highlighting the importance of prompt payment enforcement for realising savings through FAs.</p>","PeriodicalId":51602,"journal":{"name":"Fiscal Studies","volume":"46 2","pages":"167-183"},"PeriodicalIF":2.2,"publicationDate":"2025-02-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144300355","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}