Yehao Wang, Zijian Liu, Yingying Jin, Xiaoliang Wang, Lingyu Xu, Lei Wang, Jie Yu, Wenjuan Dai, Jingxia Gao, Feng Zhang
{"title":"利用注意力增强变压器框架解释南黄海藻华的时空动态。","authors":"Yehao Wang, Zijian Liu, Yingying Jin, Xiaoliang Wang, Lingyu Xu, Lei Wang, Jie Yu, Wenjuan Dai, Jingxia Gao, Feng Zhang","doi":"10.1016/j.envpol.2025.126999","DOIUrl":null,"url":null,"abstract":"<p><p>Harmful algal blooms dominated by Ulva prolifera have posed recurring ecological and economic challenges in the southern Yellow Sea. To better understand and predict the complex spatiotemporal dynamics of these blooms, we developed an enhanced Transformer-based deep learning framework, incorporating multi-head self-attention mechanisms. This model dynamically captures spatial dependencies, providing a comprehensive understanding of bloom dynamics. Utilizing twelve key marine environmental factors, we systematically explored all possible feature combinations to determine the optimal predictive subset. Experimental results demonstrated superior predictive performance of the model (MAE: 0.0213, MSE: 0.0016, R<sup>2</sup>: 0.9923) compared to conventional deep learning models and recent spatiotemporal deep learning models. Training dynamics revealed efficient convergence, especially with comprehensive environmental information. Spatial attention analysis revealed that offshore regions consistently received higher attention, indicating their critical role as informative and generalizable environmental references. Furthermore, exhaustive feature attribution experiments identified an optimal combination of eight environmental factors-including temperature, salinity, current velocity, precipitation, wind direction, dissolved iron, phosphate, and silicate-were found to significantly enhance prediction accuracy. This study highlights the capability of attention-enhanced Transformer models for interpretable and precise ecological forecasting, providing valuable insights for targeted mitigation and management of U. prolifera blooms.</p>","PeriodicalId":311,"journal":{"name":"Environmental Pollution","volume":"384 ","pages":"126999"},"PeriodicalIF":7.3000,"publicationDate":"2025-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Interpreting spatiotemporal dynamics of Ulva prolifera blooms in the southern yellow sea using an attention-enhanced transformer framework.\",\"authors\":\"Yehao Wang, Zijian Liu, Yingying Jin, Xiaoliang Wang, Lingyu Xu, Lei Wang, Jie Yu, Wenjuan Dai, Jingxia Gao, Feng Zhang\",\"doi\":\"10.1016/j.envpol.2025.126999\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Harmful algal blooms dominated by Ulva prolifera have posed recurring ecological and economic challenges in the southern Yellow Sea. To better understand and predict the complex spatiotemporal dynamics of these blooms, we developed an enhanced Transformer-based deep learning framework, incorporating multi-head self-attention mechanisms. This model dynamically captures spatial dependencies, providing a comprehensive understanding of bloom dynamics. Utilizing twelve key marine environmental factors, we systematically explored all possible feature combinations to determine the optimal predictive subset. Experimental results demonstrated superior predictive performance of the model (MAE: 0.0213, MSE: 0.0016, R<sup>2</sup>: 0.9923) compared to conventional deep learning models and recent spatiotemporal deep learning models. Training dynamics revealed efficient convergence, especially with comprehensive environmental information. Spatial attention analysis revealed that offshore regions consistently received higher attention, indicating their critical role as informative and generalizable environmental references. Furthermore, exhaustive feature attribution experiments identified an optimal combination of eight environmental factors-including temperature, salinity, current velocity, precipitation, wind direction, dissolved iron, phosphate, and silicate-were found to significantly enhance prediction accuracy. This study highlights the capability of attention-enhanced Transformer models for interpretable and precise ecological forecasting, providing valuable insights for targeted mitigation and management of U. prolifera blooms.</p>\",\"PeriodicalId\":311,\"journal\":{\"name\":\"Environmental Pollution\",\"volume\":\"384 \",\"pages\":\"126999\"},\"PeriodicalIF\":7.3000,\"publicationDate\":\"2025-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Environmental Pollution\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://doi.org/10.1016/j.envpol.2025.126999\",\"RegionNum\":2,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/8/20 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"ENVIRONMENTAL SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Environmental Pollution","FirstCategoryId":"93","ListUrlMain":"https://doi.org/10.1016/j.envpol.2025.126999","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/8/20 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}
Interpreting spatiotemporal dynamics of Ulva prolifera blooms in the southern yellow sea using an attention-enhanced transformer framework.
Harmful algal blooms dominated by Ulva prolifera have posed recurring ecological and economic challenges in the southern Yellow Sea. To better understand and predict the complex spatiotemporal dynamics of these blooms, we developed an enhanced Transformer-based deep learning framework, incorporating multi-head self-attention mechanisms. This model dynamically captures spatial dependencies, providing a comprehensive understanding of bloom dynamics. Utilizing twelve key marine environmental factors, we systematically explored all possible feature combinations to determine the optimal predictive subset. Experimental results demonstrated superior predictive performance of the model (MAE: 0.0213, MSE: 0.0016, R2: 0.9923) compared to conventional deep learning models and recent spatiotemporal deep learning models. Training dynamics revealed efficient convergence, especially with comprehensive environmental information. Spatial attention analysis revealed that offshore regions consistently received higher attention, indicating their critical role as informative and generalizable environmental references. Furthermore, exhaustive feature attribution experiments identified an optimal combination of eight environmental factors-including temperature, salinity, current velocity, precipitation, wind direction, dissolved iron, phosphate, and silicate-were found to significantly enhance prediction accuracy. This study highlights the capability of attention-enhanced Transformer models for interpretable and precise ecological forecasting, providing valuable insights for targeted mitigation and management of U. prolifera blooms.
期刊介绍:
Environmental Pollution is an international peer-reviewed journal that publishes high-quality research papers and review articles covering all aspects of environmental pollution and its impacts on ecosystems and human health.
Subject areas include, but are not limited to:
• Sources and occurrences of pollutants that are clearly defined and measured in environmental compartments, food and food-related items, and human bodies;
• Interlinks between contaminant exposure and biological, ecological, and human health effects, including those of climate change;
• Contaminants of emerging concerns (including but not limited to antibiotic resistant microorganisms or genes, microplastics/nanoplastics, electronic wastes, light, and noise) and/or their biological, ecological, or human health effects;
• Laboratory and field studies on the remediation/mitigation of environmental pollution via new techniques and with clear links to biological, ecological, or human health effects;
• Modeling of pollution processes, patterns, or trends that is of clear environmental and/or human health interest;
• New techniques that measure and examine environmental occurrences, transport, behavior, and effects of pollutants within the environment or the laboratory, provided that they can be clearly used to address problems within regional or global environmental compartments.