Meihua Yang , Songchao Chen , Yongsheng Hong , Zhi Zhang , Zhou Shi , Xiaomin Zhao
{"title":"修改后的外部参数正交化,去掉 PC2,有效消除了光谱上的湿度效应","authors":"Meihua Yang , Songchao Chen , Yongsheng Hong , Zhi Zhang , Zhou Shi , Xiaomin Zhao","doi":"10.1016/j.geoderma.2024.117051","DOIUrl":null,"url":null,"abstract":"<div><div>In situ visible–near infrared spectroscopy holds great potential in providing information supporting field applications, decision making and management in soil science, especially combined with the information present in the archived soil spectra. However, soil moisture can drastically affect the reflectance curve and reduce prediction accuracy. The external parameter orthogonalization (EPO) can remove the moisture effect but the effect of elimination is urgently needed to be improved. Herein, firstly, we implemented EPO on 50 bootstrapped calibration datasets, which generated from the local soil spectra library, with 255 combinations of PC<sub>1</sub> to PC<sub>8</sub>, resulting in a total of 50*255 models in PLSR and cubist, respectively. Secondly, we calculated the mean prediction results from these 255 combinations and selected the top 10 validation performance results. Thirdly, we performed correlation analysis on SOM with each segment induced by singular value decomposition on the difference of laboratory and in situ spectra to determine which PC should be removed in the modified EPO. Results revealed that top 10 prediction results with principles without PC<sub>2</sub> and the moisture effect was mainly in PC<sub>1</sub>, and PC<sub>2</sub> with significant correlation with SOM were removed from the EPO procedure. EPO with removing PC<sub>2</sub> (namely Modified EPO) improved the correlation of SOM with some optional bands that directly and indirectly were associated with SOM to improve the SOM prediction accuracy. Modified EPO improved the accuracy in predicting SOM with increased R<sup>2</sup> (9 %–44 % and 7 %–17 %) and root mean square error (1 %–9 % and 63 %–68 %) in the PLSR and Cubist model, respectively. Our study highlights the advantage of modified EPO in improving the elimination efficiency of water in spectra, and of PC analysis biplots in approximating the removed PCs.</div></div>","PeriodicalId":12511,"journal":{"name":"Geoderma","volume":null,"pages":null},"PeriodicalIF":5.6000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The modified external parameter orthogonalization with removed PC2 to remove effectively the moisture effect on the spectra\",\"authors\":\"Meihua Yang , Songchao Chen , Yongsheng Hong , Zhi Zhang , Zhou Shi , Xiaomin Zhao\",\"doi\":\"10.1016/j.geoderma.2024.117051\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>In situ visible–near infrared spectroscopy holds great potential in providing information supporting field applications, decision making and management in soil science, especially combined with the information present in the archived soil spectra. However, soil moisture can drastically affect the reflectance curve and reduce prediction accuracy. The external parameter orthogonalization (EPO) can remove the moisture effect but the effect of elimination is urgently needed to be improved. Herein, firstly, we implemented EPO on 50 bootstrapped calibration datasets, which generated from the local soil spectra library, with 255 combinations of PC<sub>1</sub> to PC<sub>8</sub>, resulting in a total of 50*255 models in PLSR and cubist, respectively. Secondly, we calculated the mean prediction results from these 255 combinations and selected the top 10 validation performance results. Thirdly, we performed correlation analysis on SOM with each segment induced by singular value decomposition on the difference of laboratory and in situ spectra to determine which PC should be removed in the modified EPO. Results revealed that top 10 prediction results with principles without PC<sub>2</sub> and the moisture effect was mainly in PC<sub>1</sub>, and PC<sub>2</sub> with significant correlation with SOM were removed from the EPO procedure. EPO with removing PC<sub>2</sub> (namely Modified EPO) improved the correlation of SOM with some optional bands that directly and indirectly were associated with SOM to improve the SOM prediction accuracy. Modified EPO improved the accuracy in predicting SOM with increased R<sup>2</sup> (9 %–44 % and 7 %–17 %) and root mean square error (1 %–9 % and 63 %–68 %) in the PLSR and Cubist model, respectively. Our study highlights the advantage of modified EPO in improving the elimination efficiency of water in spectra, and of PC analysis biplots in approximating the removed PCs.</div></div>\",\"PeriodicalId\":12511,\"journal\":{\"name\":\"Geoderma\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.6000,\"publicationDate\":\"2024-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Geoderma\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0016706124002805\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"SOIL SCIENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Geoderma","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0016706124002805","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"SOIL SCIENCE","Score":null,"Total":0}
引用次数: 0
摘要
原位可见近红外光谱仪在为土壤科学的实地应用、决策和管理提供信息支持方面具有巨大潜力,尤其是与存档土壤光谱中的信息相结合。然而,土壤湿度会严重影响反射率曲线,降低预测精度。外部参数正交化(EPO)可以消除水分效应,但消除效果亟待提高。在本文中,首先,我们对本地土壤光谱库生成的 50 个自举校准数据集实施了 EPO,其中有 255 种 PC1 至 PC8 的组合,在 PLSR 和 cubist 中分别得到了 50*255 个模型。其次,我们计算了这 255 种组合的平均预测结果,并选出了验证性能最高的 10 个结果。第三,我们对 SOM 与实验室光谱和原位光谱差值的奇异值分解诱导的每个分段进行了相关性分析,以确定在修改后的 EPO 中应删除哪些 PC。结果表明,有 PC2 的前 10 个预测结果原则上不含 PC2,而水分效应主要体现在 PC1 中,在 EPO 程序中删除了与 SOM 有显著相关性的 PC2。去掉 PC2 的 EPO(即修正 EPO)改善了 SOM 与一些直接或间接与 SOM 相关的可选带的相关性,从而提高了 SOM 的预测精度。修正 EPO 提高了预测 SOM 的准确性,在 PLSR 和 Cubist 模型中分别提高了 R2(9%-44% 和 7%-17%)和均方根误差(1%-9% 和 63%-68%)。我们的研究凸显了改良 EPO 在提高消除光谱中水分的效率方面的优势,以及 PC 分析双图在近似去除的 PC 方面的优势。
The modified external parameter orthogonalization with removed PC2 to remove effectively the moisture effect on the spectra
In situ visible–near infrared spectroscopy holds great potential in providing information supporting field applications, decision making and management in soil science, especially combined with the information present in the archived soil spectra. However, soil moisture can drastically affect the reflectance curve and reduce prediction accuracy. The external parameter orthogonalization (EPO) can remove the moisture effect but the effect of elimination is urgently needed to be improved. Herein, firstly, we implemented EPO on 50 bootstrapped calibration datasets, which generated from the local soil spectra library, with 255 combinations of PC1 to PC8, resulting in a total of 50*255 models in PLSR and cubist, respectively. Secondly, we calculated the mean prediction results from these 255 combinations and selected the top 10 validation performance results. Thirdly, we performed correlation analysis on SOM with each segment induced by singular value decomposition on the difference of laboratory and in situ spectra to determine which PC should be removed in the modified EPO. Results revealed that top 10 prediction results with principles without PC2 and the moisture effect was mainly in PC1, and PC2 with significant correlation with SOM were removed from the EPO procedure. EPO with removing PC2 (namely Modified EPO) improved the correlation of SOM with some optional bands that directly and indirectly were associated with SOM to improve the SOM prediction accuracy. Modified EPO improved the accuracy in predicting SOM with increased R2 (9 %–44 % and 7 %–17 %) and root mean square error (1 %–9 % and 63 %–68 %) in the PLSR and Cubist model, respectively. Our study highlights the advantage of modified EPO in improving the elimination efficiency of water in spectra, and of PC analysis biplots in approximating the removed PCs.
期刊介绍:
Geoderma - the global journal of soil science - welcomes authors, readers and soil research from all parts of the world, encourages worldwide soil studies, and embraces all aspects of soil science and its associated pedagogy. The journal particularly welcomes interdisciplinary work focusing on dynamic soil processes and functions across space and time.