Digital Restoration of Separations Data

IF 2.8 3区 工程技术 Q2 CHEMISTRY, ANALYTICAL
M. Farooq Wahab, Troy T. Handlovic
{"title":"Digital Restoration of Separations Data","authors":"M. Farooq Wahab,&nbsp;Troy T. Handlovic","doi":"10.1002/jssc.70139","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>In experimental separations, the acquired signal can have four common but unwanted elements: (i) high-frequency noise, (ii) drift, (iii) occasional periodic and pink noise, and (iv) a mixture of components traveling with close velocities. Additionally, separation scientists observe partially resolved peaks in chromatographic or capillary electrophoresis detector output. A protocol for digitally recovering the “true data” is provided with clear-cut details and open-access codes for formulating denoising, baseline correction, and peak resolution problems as linear or nonlinear optimizations. The smoother of Bohlmann–Whittaker denoises and preserves the total area of the signal. Fourier transform methods to detect and remove periodic noise are also proposed for erratic periodic noise problems. A peak width preserving filter, called the bilateral filter, is also given. This procedure is followed by two reliable baseline correction algorithms based on asymmetric reweighted least squares or curvature-based weights to deal with low-frequency signal variations. Once low- and high-frequency noise components are removed, a convenient peak mode location method is introduced, relying upon numerically stable second derivative calculation from Savitzky–Golay (SG) filter. Peak locations, area, height, and higher statistical moments can be derived from iterative curve fitting. The protocol shows two peak models that can model left or right skewed peaks. The new peak models are (i) a numerically stable version of the bi-directional exponentially modified Gaussian (EMG), suitable for a wide variety of real chromatograms, and (ii) the twice generalized normal model with third- and fourth-moment parameters built into it. The nonlinear least squares regression approach uses the trust-region reflective optimization method. The algorithm converges to a solution even with multiple peaks and approximate guesses of peak parameters. The protocol can be generalized to fit more than 200 peak functions in separation sciences available in literature by minor adaptations of the provided codes in the MATLAB environment.</p>\n </div>","PeriodicalId":17098,"journal":{"name":"Journal of separation science","volume":"48 5","pages":""},"PeriodicalIF":2.8000,"publicationDate":"2025-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of separation science","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/jssc.70139","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CHEMISTRY, ANALYTICAL","Score":null,"Total":0}
引用次数: 0

Abstract

In experimental separations, the acquired signal can have four common but unwanted elements: (i) high-frequency noise, (ii) drift, (iii) occasional periodic and pink noise, and (iv) a mixture of components traveling with close velocities. Additionally, separation scientists observe partially resolved peaks in chromatographic or capillary electrophoresis detector output. A protocol for digitally recovering the “true data” is provided with clear-cut details and open-access codes for formulating denoising, baseline correction, and peak resolution problems as linear or nonlinear optimizations. The smoother of Bohlmann–Whittaker denoises and preserves the total area of the signal. Fourier transform methods to detect and remove periodic noise are also proposed for erratic periodic noise problems. A peak width preserving filter, called the bilateral filter, is also given. This procedure is followed by two reliable baseline correction algorithms based on asymmetric reweighted least squares or curvature-based weights to deal with low-frequency signal variations. Once low- and high-frequency noise components are removed, a convenient peak mode location method is introduced, relying upon numerically stable second derivative calculation from Savitzky–Golay (SG) filter. Peak locations, area, height, and higher statistical moments can be derived from iterative curve fitting. The protocol shows two peak models that can model left or right skewed peaks. The new peak models are (i) a numerically stable version of the bi-directional exponentially modified Gaussian (EMG), suitable for a wide variety of real chromatograms, and (ii) the twice generalized normal model with third- and fourth-moment parameters built into it. The nonlinear least squares regression approach uses the trust-region reflective optimization method. The algorithm converges to a solution even with multiple peaks and approximate guesses of peak parameters. The protocol can be generalized to fit more than 200 peak functions in separation sciences available in literature by minor adaptations of the provided codes in the MATLAB environment.

分离数据的数字恢复
在实验分离中,获得的信号可能有四种常见但不需要的元素:(i)高频噪声,(ii)漂移,(iii)偶尔的周期性和粉红噪声,以及(iv)以接近速度行进的成分的混合物。此外,分离科学家在色谱或毛细管电泳检测器输出中观察到部分分解的峰。数字恢复“真实数据”的协议提供了明确的细节和开放访问代码,用于制定去噪,基线校正和峰值分辨率问题作为线性或非线性优化。波尔曼-惠特克平滑法对信号进行了去噪,并保留了信号的总面积。针对不规则周期噪声问题,提出了傅里叶变换检测和去除周期噪声的方法。给出了一种峰宽保持滤波器,称为双边滤波器。在此过程之后,基于非对称加权最小二乘或曲率加权的两种可靠的基线校正算法来处理低频信号变化。在去除低频和高频噪声后,引入了一种方便的峰值模式定位方法,该方法依赖于Savitzky-Golay (SG)滤波器的数值稳定二阶导数计算。峰的位置,面积,高度和更高的统计矩可以从迭代曲线拟合得到。该协议显示了两个峰值模型,可以模拟左斜峰或右斜峰。新的峰模型是(i)双向指数修正高斯(EMG)的数值稳定版本,适用于各种实际色谱图,以及(ii)二次广义正态模型,其中内置了第三和第四矩参数。非线性最小二乘回归方法采用了信任域反射优化方法。该算法收敛于具有多个峰值和峰值参数近似猜测的解。通过在MATLAB环境中对所提供的代码进行少量调整,该协议可以推广到适合文献中分离科学中200多个峰值函数。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of separation science
Journal of separation science 化学-分析化学
CiteScore
6.30
自引率
16.10%
发文量
408
审稿时长
1.8 months
期刊介绍: The Journal of Separation Science (JSS) is the most comprehensive source in separation science, since it covers all areas of chromatographic and electrophoretic separation methods in theory and practice, both in the analytical and in the preparative mode, solid phase extraction, sample preparation, and related techniques. Manuscripts on methodological or instrumental developments, including detection aspects, in particular mass spectrometry, as well as on innovative applications will also be published. Manuscripts on hyphenation, automation, and miniaturization are particularly welcome. Pre- and post-separation facets of a total analysis may be covered as well as the underlying logic of the development or application of a method.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信