利用注意力增强变压器框架解释南黄海藻华的时空动态。

IF 7.3 2区 环境科学与生态学 Q1 ENVIRONMENTAL SCIENCES
Environmental Pollution Pub Date : 2025-11-01 Epub Date: 2025-08-20 DOI:10.1016/j.envpol.2025.126999
Yehao Wang, Zijian Liu, Yingying Jin, Xiaoliang Wang, Lingyu Xu, Lei Wang, Jie Yu, Wenjuan Dai, Jingxia Gao, Feng Zhang
{"title":"利用注意力增强变压器框架解释南黄海藻华的时空动态。","authors":"Yehao Wang, Zijian Liu, Yingying Jin, Xiaoliang Wang, Lingyu Xu, Lei Wang, Jie Yu, Wenjuan Dai, Jingxia Gao, Feng Zhang","doi":"10.1016/j.envpol.2025.126999","DOIUrl":null,"url":null,"abstract":"<p><p>Harmful algal blooms dominated by Ulva prolifera have posed recurring ecological and economic challenges in the southern Yellow Sea. To better understand and predict the complex spatiotemporal dynamics of these blooms, we developed an enhanced Transformer-based deep learning framework, incorporating multi-head self-attention mechanisms. This model dynamically captures spatial dependencies, providing a comprehensive understanding of bloom dynamics. Utilizing twelve key marine environmental factors, we systematically explored all possible feature combinations to determine the optimal predictive subset. Experimental results demonstrated superior predictive performance of the model (MAE: 0.0213, MSE: 0.0016, R<sup>2</sup>: 0.9923) compared to conventional deep learning models and recent spatiotemporal deep learning models. Training dynamics revealed efficient convergence, especially with comprehensive environmental information. Spatial attention analysis revealed that offshore regions consistently received higher attention, indicating their critical role as informative and generalizable environmental references. Furthermore, exhaustive feature attribution experiments identified an optimal combination of eight environmental factors-including temperature, salinity, current velocity, precipitation, wind direction, dissolved iron, phosphate, and silicate-were found to significantly enhance prediction accuracy. This study highlights the capability of attention-enhanced Transformer models for interpretable and precise ecological forecasting, providing valuable insights for targeted mitigation and management of U. prolifera blooms.</p>","PeriodicalId":311,"journal":{"name":"Environmental Pollution","volume":"384 ","pages":"126999"},"PeriodicalIF":7.3000,"publicationDate":"2025-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Interpreting spatiotemporal dynamics of Ulva prolifera blooms in the southern yellow sea using an attention-enhanced transformer framework.\",\"authors\":\"Yehao Wang, Zijian Liu, Yingying Jin, Xiaoliang Wang, Lingyu Xu, Lei Wang, Jie Yu, Wenjuan Dai, Jingxia Gao, Feng Zhang\",\"doi\":\"10.1016/j.envpol.2025.126999\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Harmful algal blooms dominated by Ulva prolifera have posed recurring ecological and economic challenges in the southern Yellow Sea. To better understand and predict the complex spatiotemporal dynamics of these blooms, we developed an enhanced Transformer-based deep learning framework, incorporating multi-head self-attention mechanisms. This model dynamically captures spatial dependencies, providing a comprehensive understanding of bloom dynamics. Utilizing twelve key marine environmental factors, we systematically explored all possible feature combinations to determine the optimal predictive subset. Experimental results demonstrated superior predictive performance of the model (MAE: 0.0213, MSE: 0.0016, R<sup>2</sup>: 0.9923) compared to conventional deep learning models and recent spatiotemporal deep learning models. Training dynamics revealed efficient convergence, especially with comprehensive environmental information. Spatial attention analysis revealed that offshore regions consistently received higher attention, indicating their critical role as informative and generalizable environmental references. Furthermore, exhaustive feature attribution experiments identified an optimal combination of eight environmental factors-including temperature, salinity, current velocity, precipitation, wind direction, dissolved iron, phosphate, and silicate-were found to significantly enhance prediction accuracy. This study highlights the capability of attention-enhanced Transformer models for interpretable and precise ecological forecasting, providing valuable insights for targeted mitigation and management of U. prolifera blooms.</p>\",\"PeriodicalId\":311,\"journal\":{\"name\":\"Environmental Pollution\",\"volume\":\"384 \",\"pages\":\"126999\"},\"PeriodicalIF\":7.3000,\"publicationDate\":\"2025-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Environmental Pollution\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://doi.org/10.1016/j.envpol.2025.126999\",\"RegionNum\":2,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/8/20 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"ENVIRONMENTAL SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Environmental Pollution","FirstCategoryId":"93","ListUrlMain":"https://doi.org/10.1016/j.envpol.2025.126999","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/8/20 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}
引用次数: 0

摘要

以藻华为主的有害藻华在黄海南部造成了反复出现的生态和经济挑战。为了更好地理解和预测这些花的复杂时空动态,我们开发了一个增强的基于transformer的深度学习框架,其中包含多头自注意机制。这个模型动态地捕捉空间依赖关系,提供了对bloom动态的全面理解。利用12个关键的海洋环境因子,我们系统地探索了所有可能的特征组合,以确定最佳的预测子集。实验结果表明,该模型的预测性能优于传统的深度学习模型和近期的时空深度学习模型(MAE: 0.0213, MSE: 0.0016, R2: 0.9923)。训练动态显示出有效的收敛性,特别是在综合环境信息的情况下。空间注意力分析显示,近海区域一直受到较高的关注,表明其作为信息和可推广的环境参考的关键作用。此外,详尽的特征归因实验确定了8个环境因素的最佳组合,包括温度、盐度、流速、降水、风向、溶解铁、磷酸盐和硅酸盐,这些因素显著提高了预测精度。这项研究强调了注意力增强的Transformer模型在可解释和精确的生态预测方面的能力,为有针对性地缓解和管理多殖藻华提供了有价值的见解。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Interpreting spatiotemporal dynamics of Ulva prolifera blooms in the southern yellow sea using an attention-enhanced transformer framework.

Harmful algal blooms dominated by Ulva prolifera have posed recurring ecological and economic challenges in the southern Yellow Sea. To better understand and predict the complex spatiotemporal dynamics of these blooms, we developed an enhanced Transformer-based deep learning framework, incorporating multi-head self-attention mechanisms. This model dynamically captures spatial dependencies, providing a comprehensive understanding of bloom dynamics. Utilizing twelve key marine environmental factors, we systematically explored all possible feature combinations to determine the optimal predictive subset. Experimental results demonstrated superior predictive performance of the model (MAE: 0.0213, MSE: 0.0016, R2: 0.9923) compared to conventional deep learning models and recent spatiotemporal deep learning models. Training dynamics revealed efficient convergence, especially with comprehensive environmental information. Spatial attention analysis revealed that offshore regions consistently received higher attention, indicating their critical role as informative and generalizable environmental references. Furthermore, exhaustive feature attribution experiments identified an optimal combination of eight environmental factors-including temperature, salinity, current velocity, precipitation, wind direction, dissolved iron, phosphate, and silicate-were found to significantly enhance prediction accuracy. This study highlights the capability of attention-enhanced Transformer models for interpretable and precise ecological forecasting, providing valuable insights for targeted mitigation and management of U. prolifera blooms.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Environmental Pollution
Environmental Pollution 环境科学-环境科学
CiteScore
16.00
自引率
6.70%
发文量
2082
审稿时长
2.9 months
期刊介绍: Environmental Pollution is an international peer-reviewed journal that publishes high-quality research papers and review articles covering all aspects of environmental pollution and its impacts on ecosystems and human health. Subject areas include, but are not limited to: • Sources and occurrences of pollutants that are clearly defined and measured in environmental compartments, food and food-related items, and human bodies; • Interlinks between contaminant exposure and biological, ecological, and human health effects, including those of climate change; • Contaminants of emerging concerns (including but not limited to antibiotic resistant microorganisms or genes, microplastics/nanoplastics, electronic wastes, light, and noise) and/or their biological, ecological, or human health effects; • Laboratory and field studies on the remediation/mitigation of environmental pollution via new techniques and with clear links to biological, ecological, or human health effects; • Modeling of pollution processes, patterns, or trends that is of clear environmental and/or human health interest; • New techniques that measure and examine environmental occurrences, transport, behavior, and effects of pollutants within the environment or the laboratory, provided that they can be clearly used to address problems within regional or global environmental compartments.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信