Xiangchao Fu , Geng Leng , Zeyuan Zhang , Jingyun Huang , Wenbo Xu , Zhenwei Xie , Yuewu Wang
{"title":"通过可见光-近红外光谱加强土壤氮素测量:将土壤粒径分布与长短期记忆模型相结合","authors":"Xiangchao Fu , Geng Leng , Zeyuan Zhang , Jingyun Huang , Wenbo Xu , Zhenwei Xie , Yuewu Wang","doi":"10.1016/j.saa.2024.125317","DOIUrl":null,"url":null,"abstract":"<div><div>Good quality of soil nitrogen data, which is essential for the advancement of both enhanced agricultural management and ecological environment, traditionally depends on labor intensive chemical procedures. Visible near-infrared (Vis-NIR) spectroscopy, acknowledged for its efficiency, environmental compatibility and rapidity, merges as a promising alternative. However, the effectiveness of Vis-NIR measurement models are significantly compromised by soil particle size distribution (PSD), presenting a substantial challenge in improving the measurement accuracy and reliability. Here an innovative deep learning methodology that integrates PSD with Vis-NIR spectroscopy was proposed for the measurement of nitrogen content in soil samples. By leveraging the LUCAS dataset, different strategies for integrating PSD with Vis-NIR spectral data in deep learning models were explored, revealing that our proposed InSGraL framework, which incorporated mixed features of PSD and spectra as LSTM inputs achieves superior performance. Compared to models utilizing solely Vis-NIR data, InSGraL exhibits a 39.47 % reduction in RMSE and a 42.55 % decrease in MAE, and demonstrates robust performance across various land cover types, achieving an R<sup>2</sup> of 0.94 on grassland samples. Moreover, Shapley Additive exPlanations (SHAP) analysis revealed that incorporating PSD modifies the spectral input importance distribution, effectively mitigating spectral interference from particle size while highlighting critical wavelengths previously obscured. This study provides an innovative modeling strategy to mitigate the influence of PSD by integrating it within deep learning framework using Vis-NIR, contributing a deeper understanding of the relationship between PSD and Vis-NIR spectra for the measurement of nitrogen content and offering an effective means to attain soil nitrogen data.</div></div>","PeriodicalId":433,"journal":{"name":"Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy","volume":"327 ","pages":"Article 125317"},"PeriodicalIF":4.3000,"publicationDate":"2024-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Enhancing soil nitrogen measurement via visible-near infrared spectroscopy: Integrating soil particle size distribution with long short-term memory models\",\"authors\":\"Xiangchao Fu , Geng Leng , Zeyuan Zhang , Jingyun Huang , Wenbo Xu , Zhenwei Xie , Yuewu Wang\",\"doi\":\"10.1016/j.saa.2024.125317\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Good quality of soil nitrogen data, which is essential for the advancement of both enhanced agricultural management and ecological environment, traditionally depends on labor intensive chemical procedures. Visible near-infrared (Vis-NIR) spectroscopy, acknowledged for its efficiency, environmental compatibility and rapidity, merges as a promising alternative. However, the effectiveness of Vis-NIR measurement models are significantly compromised by soil particle size distribution (PSD), presenting a substantial challenge in improving the measurement accuracy and reliability. Here an innovative deep learning methodology that integrates PSD with Vis-NIR spectroscopy was proposed for the measurement of nitrogen content in soil samples. By leveraging the LUCAS dataset, different strategies for integrating PSD with Vis-NIR spectral data in deep learning models were explored, revealing that our proposed InSGraL framework, which incorporated mixed features of PSD and spectra as LSTM inputs achieves superior performance. Compared to models utilizing solely Vis-NIR data, InSGraL exhibits a 39.47 % reduction in RMSE and a 42.55 % decrease in MAE, and demonstrates robust performance across various land cover types, achieving an R<sup>2</sup> of 0.94 on grassland samples. Moreover, Shapley Additive exPlanations (SHAP) analysis revealed that incorporating PSD modifies the spectral input importance distribution, effectively mitigating spectral interference from particle size while highlighting critical wavelengths previously obscured. This study provides an innovative modeling strategy to mitigate the influence of PSD by integrating it within deep learning framework using Vis-NIR, contributing a deeper understanding of the relationship between PSD and Vis-NIR spectra for the measurement of nitrogen content and offering an effective means to attain soil nitrogen data.</div></div>\",\"PeriodicalId\":433,\"journal\":{\"name\":\"Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy\",\"volume\":\"327 \",\"pages\":\"Article 125317\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-10-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy\",\"FirstCategoryId\":\"92\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1386142524014835\",\"RegionNum\":2,\"RegionCategory\":\"化学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"SPECTROSCOPY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy","FirstCategoryId":"92","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1386142524014835","RegionNum":2,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"SPECTROSCOPY","Score":null,"Total":0}
Enhancing soil nitrogen measurement via visible-near infrared spectroscopy: Integrating soil particle size distribution with long short-term memory models
Good quality of soil nitrogen data, which is essential for the advancement of both enhanced agricultural management and ecological environment, traditionally depends on labor intensive chemical procedures. Visible near-infrared (Vis-NIR) spectroscopy, acknowledged for its efficiency, environmental compatibility and rapidity, merges as a promising alternative. However, the effectiveness of Vis-NIR measurement models are significantly compromised by soil particle size distribution (PSD), presenting a substantial challenge in improving the measurement accuracy and reliability. Here an innovative deep learning methodology that integrates PSD with Vis-NIR spectroscopy was proposed for the measurement of nitrogen content in soil samples. By leveraging the LUCAS dataset, different strategies for integrating PSD with Vis-NIR spectral data in deep learning models were explored, revealing that our proposed InSGraL framework, which incorporated mixed features of PSD and spectra as LSTM inputs achieves superior performance. Compared to models utilizing solely Vis-NIR data, InSGraL exhibits a 39.47 % reduction in RMSE and a 42.55 % decrease in MAE, and demonstrates robust performance across various land cover types, achieving an R2 of 0.94 on grassland samples. Moreover, Shapley Additive exPlanations (SHAP) analysis revealed that incorporating PSD modifies the spectral input importance distribution, effectively mitigating spectral interference from particle size while highlighting critical wavelengths previously obscured. This study provides an innovative modeling strategy to mitigate the influence of PSD by integrating it within deep learning framework using Vis-NIR, contributing a deeper understanding of the relationship between PSD and Vis-NIR spectra for the measurement of nitrogen content and offering an effective means to attain soil nitrogen data.
期刊介绍:
Spectrochimica Acta, Part A: Molecular and Biomolecular Spectroscopy (SAA) is an interdisciplinary journal which spans from basic to applied aspects of optical spectroscopy in chemistry, medicine, biology, and materials science.
The journal publishes original scientific papers that feature high-quality spectroscopic data and analysis. From the broad range of optical spectroscopies, the emphasis is on electronic, vibrational or rotational spectra of molecules, rather than on spectroscopy based on magnetic moments.
Criteria for publication in SAA are novelty, uniqueness, and outstanding quality. Routine applications of spectroscopic techniques and computational methods are not appropriate.
Topics of particular interest of Spectrochimica Acta Part A include, but are not limited to:
Spectroscopy and dynamics of bioanalytical, biomedical, environmental, and atmospheric sciences,
Novel experimental techniques or instrumentation for molecular spectroscopy,
Novel theoretical and computational methods,
Novel applications in photochemistry and photobiology,
Novel interpretational approaches as well as advances in data analysis based on electronic or vibrational spectroscopy.