Reneé Rodrigues Lima, Jerson Leite Alves, Francisco Alves dos Santos, Davi Wanderley Misturini, Joao B. Florindo
{"title":"李雅普诺夫指数通过注意机制增强时间序列预测","authors":"Reneé Rodrigues Lima, Jerson Leite Alves, Francisco Alves dos Santos, Davi Wanderley Misturini, Joao B. Florindo","doi":"10.1016/j.physa.2025.130948","DOIUrl":null,"url":null,"abstract":"<div><div>This paper proposes a novel time series forecasting approach that integrates chaos theory and deep learning. By computing local Lyapunov exponents over a sliding window, we extract the dynamic structure of the time series and inject this information into deep models via a self-attention mechanism. This enriched representation enhances the model’s ability to capture nonlinear and “<em>quasi</em>-chaotic” patterns. We apply our method to three deep learning architectures (N-BEATS, LSTM, and GRU), comparing their standard and chaotic-aware versions across seven datasets—one synthetic and six real-world datasets from finance, energy, traffic, and climate domains. Experimental results show that our approach improves forecasting accuracy by an average of 28.0% over traditional deep learning models and 30.8% compared to state-of-the-art methods, according to MAE, RMSE, and MAPE metrics. These findings highlight the potential of combining Lyapunov-based local dynamics and attention mechanisms for robust and interpretable forecasting, especially in complex time series with nonlinear behaviors.</div></div>","PeriodicalId":20152,"journal":{"name":"Physica A: Statistical Mechanics and its Applications","volume":"678 ","pages":"Article 130948"},"PeriodicalIF":3.1000,"publicationDate":"2025-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Time series forecasting enhanced by Lyapunov exponent via attention mechanism\",\"authors\":\"Reneé Rodrigues Lima, Jerson Leite Alves, Francisco Alves dos Santos, Davi Wanderley Misturini, Joao B. Florindo\",\"doi\":\"10.1016/j.physa.2025.130948\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>This paper proposes a novel time series forecasting approach that integrates chaos theory and deep learning. By computing local Lyapunov exponents over a sliding window, we extract the dynamic structure of the time series and inject this information into deep models via a self-attention mechanism. This enriched representation enhances the model’s ability to capture nonlinear and “<em>quasi</em>-chaotic” patterns. We apply our method to three deep learning architectures (N-BEATS, LSTM, and GRU), comparing their standard and chaotic-aware versions across seven datasets—one synthetic and six real-world datasets from finance, energy, traffic, and climate domains. Experimental results show that our approach improves forecasting accuracy by an average of 28.0% over traditional deep learning models and 30.8% compared to state-of-the-art methods, according to MAE, RMSE, and MAPE metrics. These findings highlight the potential of combining Lyapunov-based local dynamics and attention mechanisms for robust and interpretable forecasting, especially in complex time series with nonlinear behaviors.</div></div>\",\"PeriodicalId\":20152,\"journal\":{\"name\":\"Physica A: Statistical Mechanics and its Applications\",\"volume\":\"678 \",\"pages\":\"Article 130948\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2025-09-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Physica A: Statistical Mechanics and its Applications\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0378437125006004\",\"RegionNum\":3,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"PHYSICS, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physica A: Statistical Mechanics and its Applications","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0378437125006004","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PHYSICS, MULTIDISCIPLINARY","Score":null,"Total":0}
Time series forecasting enhanced by Lyapunov exponent via attention mechanism
This paper proposes a novel time series forecasting approach that integrates chaos theory and deep learning. By computing local Lyapunov exponents over a sliding window, we extract the dynamic structure of the time series and inject this information into deep models via a self-attention mechanism. This enriched representation enhances the model’s ability to capture nonlinear and “quasi-chaotic” patterns. We apply our method to three deep learning architectures (N-BEATS, LSTM, and GRU), comparing their standard and chaotic-aware versions across seven datasets—one synthetic and six real-world datasets from finance, energy, traffic, and climate domains. Experimental results show that our approach improves forecasting accuracy by an average of 28.0% over traditional deep learning models and 30.8% compared to state-of-the-art methods, according to MAE, RMSE, and MAPE metrics. These findings highlight the potential of combining Lyapunov-based local dynamics and attention mechanisms for robust and interpretable forecasting, especially in complex time series with nonlinear behaviors.
期刊介绍:
Physica A: Statistical Mechanics and its Applications
Recognized by the European Physical Society
Physica A publishes research in the field of statistical mechanics and its applications.
Statistical mechanics sets out to explain the behaviour of macroscopic systems by studying the statistical properties of their microscopic constituents.
Applications of the techniques of statistical mechanics are widespread, and include: applications to physical systems such as solids, liquids and gases; applications to chemical and biological systems (colloids, interfaces, complex fluids, polymers and biopolymers, cell physics); and other interdisciplinary applications to for instance biological, economical and sociological systems.