A Nonparametric Approach for Estimating the Effective Sample Size in Gaussian Approximation of Expected Value of Sample Information.

Abstract

The effective sample size (ESS) measures the informational value of a probability distribution in terms of an equivalent number of study participants. The ESS plays a crucial role in estimating the expected value of sample information (EVSI) through the Gaussian approximation approach. Despite the significance of ESS, except for a limited number of scenarios, existing ESS estimation methods within the Gaussian approximation framework are either computationally expensive or potentially inaccurate. To address these limitations, we propose a novel approach that estimates the ESS using the summary statistics of generated datasets and nonparametric regression methods. The simulation experiments suggest that the proposed method provides accurate ESS estimates at a low computational cost, making it an efficient and practical way to quantify the information contained in the probability distribution of a parameter. Overall, determining the ESS can help analysts understand the uncertainty levels in complex prior distributions in the probability analyses of decision models and perform efficient EVSI calculations.HighlightsEffective sample size (ESS) quantifies the informational value of probability distributions, essential for calculating the expected value of sample information (EVSI) using the Gaussian approximation approach. However, current ESS estimation methods are limited by high computational demands and potential inaccuracies.We propose a novel ESS estimation method that uses summary statistics and nonparametric regression models to efficiently and accurately estimate ESS.The effectiveness and accuracy of our method are validated through simulations, demonstrating significant improvements in computational efficiency and estimation accuracy.