A robust adaptive meta-sample generation method for few-shot time series prediction

Abstract

The research and exploration of time series prediction (TSP) have attracted much attention recently. Researchers can achieve effective TSP based on the deep learning model and a large amount of data. However, when sufficient high-quality data are not available, the performance of prediction models based on deep learning techniques may degrade. Therefore, this paper focuses on few-shot time series prediction (FTSP) and plans to combine meta-learning and generative models to alleviate the problems caused by insufficient training data. When using meta-learning techniques to process FTSP tasks, researchers set the meta-parameter in model-agnostic meta-learning (MAML) as a meta-sample and construct meta-sample generation methods based on advanced generative modeling theory to achieve better uncertainty coding. The existing meta-sample generation methods in FTSP scenes have an inherent limitation: With the increase of the complexity of prediction tasks, samples based on Gaussian distribution may be sensitive to noise and outliers in the meta-learning environment and lack of uncertainty expression, thus affecting the robustness and accuracy of prediction. Therefore, this paper proposes an adaptive sample generation method called JLSG-Diffusion. Based on the Jensen constraint framework and Laplace modeling theory, this method constructs a sample adapter with reasonable adaptive steps and fast convergence for specific tasks. The advantage is to realize fast adaptive convergence of samples to new tasks at lower cost, effectively control the overall generalization error, and improve the robustness and non-Gaussian generalization of sample posterior reasoning. Moreover, the meta sampler of JLSG-Diffusion embeds meta-learning from the implicit probability measure level of Denoising Diffusion Probabilistic Models (DDPM), which makes the meta-sample distribution directly establish a function mapping with the new task and effectively quantifies the uncertainty of spatiotemporal dimension. Experimental results on three real datasets prove the efficiency and effectiveness of JLSG-Diffusion. Compared with the benchmark methods, the prediction model combined with JLSG-Diffusion shows better accuracy.