Jiacheng Liu, Xiao Liu, Xueji Wang, Zi Heng Lim, Hong Liu, Yubo Zhao, Weixing Yu, Tao Yu, Bingliang Hu
{"title":"基于UV-Vis-SWNIR光谱转换器的复杂地表水中COD的快速检测","authors":"Jiacheng Liu, Xiao Liu, Xueji Wang, Zi Heng Lim, Hong Liu, Yubo Zhao, Weixing Yu, Tao Yu, Bingliang Hu","doi":"10.1021/acs.est.4c14209","DOIUrl":null,"url":null,"abstract":"Water, as a finite and vital resource, necessitates water quality monitoring to ensure its sustainable use. A key aspect of this process is the accurate measurement of critical parameters such as chemical oxygen demand (COD). However, current spectroscopic methods struggle with accurately and consistently measuring COD in large-scale, complex water environments due to an insufficient understanding of water spectra and limited generalizability. To address these limitations, we introduce the physicochemical-informed spectral Transformer (PIST) model, combined with ultraviolet–visible-shortwave-near-infrared (UV–vis-SWNIR) spectroscopy for water quality sensing. To the best of our knowledge, this is the first approach to combine Transformer with spectroscopy for water quality sensing. PIST integrates a physicochemical-informed block to incorporate existing physical and chemical information into the spectral encoding for domain adaptation, along with a feature embedding block for comprehensive spectral features extraction. We validated PIST using an actual surface water spectral data set with extensive geographic coverage including the Yangtze River and Poyang Lake. PIST demonstrated notable performance in COD sensing within complex water environments, achieving an impressive <i>R</i><sup>2</sup> value of 0.9008 and reducing root mean squared error (RMSE) by 45.20% and 29.38% compared to benchmark models such as support vector regression (SVR) and convolutional neural network (CNN). These results emphasize PIST’s accuracy and generalizability, marking a significant advancement in multidisciplinary approaches that combine spectroscopy with deep learning for rapid water quality sensing.","PeriodicalId":36,"journal":{"name":"环境科学与技术","volume":"2 1","pages":""},"PeriodicalIF":11.3000,"publicationDate":"2025-03-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Rapid COD Sensing in Complex Surface Water Using Physicochemical-Informed Spectral Transformer with UV–Vis-SWNIR Spectroscopy\",\"authors\":\"Jiacheng Liu, Xiao Liu, Xueji Wang, Zi Heng Lim, Hong Liu, Yubo Zhao, Weixing Yu, Tao Yu, Bingliang Hu\",\"doi\":\"10.1021/acs.est.4c14209\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Water, as a finite and vital resource, necessitates water quality monitoring to ensure its sustainable use. A key aspect of this process is the accurate measurement of critical parameters such as chemical oxygen demand (COD). However, current spectroscopic methods struggle with accurately and consistently measuring COD in large-scale, complex water environments due to an insufficient understanding of water spectra and limited generalizability. To address these limitations, we introduce the physicochemical-informed spectral Transformer (PIST) model, combined with ultraviolet–visible-shortwave-near-infrared (UV–vis-SWNIR) spectroscopy for water quality sensing. To the best of our knowledge, this is the first approach to combine Transformer with spectroscopy for water quality sensing. PIST integrates a physicochemical-informed block to incorporate existing physical and chemical information into the spectral encoding for domain adaptation, along with a feature embedding block for comprehensive spectral features extraction. We validated PIST using an actual surface water spectral data set with extensive geographic coverage including the Yangtze River and Poyang Lake. PIST demonstrated notable performance in COD sensing within complex water environments, achieving an impressive <i>R</i><sup>2</sup> value of 0.9008 and reducing root mean squared error (RMSE) by 45.20% and 29.38% compared to benchmark models such as support vector regression (SVR) and convolutional neural network (CNN). These results emphasize PIST’s accuracy and generalizability, marking a significant advancement in multidisciplinary approaches that combine spectroscopy with deep learning for rapid water quality sensing.\",\"PeriodicalId\":36,\"journal\":{\"name\":\"环境科学与技术\",\"volume\":\"2 1\",\"pages\":\"\"},\"PeriodicalIF\":11.3000,\"publicationDate\":\"2025-03-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"环境科学与技术\",\"FirstCategoryId\":\"1\",\"ListUrlMain\":\"https://doi.org/10.1021/acs.est.4c14209\",\"RegionNum\":1,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ENVIRONMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"环境科学与技术","FirstCategoryId":"1","ListUrlMain":"https://doi.org/10.1021/acs.est.4c14209","RegionNum":1,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ENVIRONMENTAL","Score":null,"Total":0}
Rapid COD Sensing in Complex Surface Water Using Physicochemical-Informed Spectral Transformer with UV–Vis-SWNIR Spectroscopy
Water, as a finite and vital resource, necessitates water quality monitoring to ensure its sustainable use. A key aspect of this process is the accurate measurement of critical parameters such as chemical oxygen demand (COD). However, current spectroscopic methods struggle with accurately and consistently measuring COD in large-scale, complex water environments due to an insufficient understanding of water spectra and limited generalizability. To address these limitations, we introduce the physicochemical-informed spectral Transformer (PIST) model, combined with ultraviolet–visible-shortwave-near-infrared (UV–vis-SWNIR) spectroscopy for water quality sensing. To the best of our knowledge, this is the first approach to combine Transformer with spectroscopy for water quality sensing. PIST integrates a physicochemical-informed block to incorporate existing physical and chemical information into the spectral encoding for domain adaptation, along with a feature embedding block for comprehensive spectral features extraction. We validated PIST using an actual surface water spectral data set with extensive geographic coverage including the Yangtze River and Poyang Lake. PIST demonstrated notable performance in COD sensing within complex water environments, achieving an impressive R2 value of 0.9008 and reducing root mean squared error (RMSE) by 45.20% and 29.38% compared to benchmark models such as support vector regression (SVR) and convolutional neural network (CNN). These results emphasize PIST’s accuracy and generalizability, marking a significant advancement in multidisciplinary approaches that combine spectroscopy with deep learning for rapid water quality sensing.
期刊介绍:
Environmental Science & Technology (ES&T) is a co-sponsored academic and technical magazine by the Hubei Provincial Environmental Protection Bureau and the Hubei Provincial Academy of Environmental Sciences.
Environmental Science & Technology (ES&T) holds the status of Chinese core journals, scientific papers source journals of China, Chinese Science Citation Database source journals, and Chinese Academic Journal Comprehensive Evaluation Database source journals. This publication focuses on the academic field of environmental protection, featuring articles related to environmental protection and technical advancements.