Preprocessing Matters: Visualizing the Effect of Spectral Preprocessing on Principal Component Analysis

IF 3 3区 教育学 Q2 CHEMISTRY, MULTIDISCIPLINARY
Journal of Chemical Education Pub Date : 2026-10-13 Epub Date: 2026-08-31 DOI:10.1021/acs.jchemed.6c00722
María Fernanda Hernández Rodríguez, Natan Cristian Pedroso Pereira, Endler Marcel Borges
{"title":"Preprocessing Matters: Visualizing the Effect of Spectral Preprocessing on Principal Component Analysis","authors":"María Fernanda Hernández Rodríguez,&nbsp;Natan Cristian Pedroso Pereira,&nbsp;Endler Marcel Borges","doi":"10.1021/acs.jchemed.6c00722","DOIUrl":null,"url":null,"abstract":"<p>Principal component analysis (PCA) is widely used in\r\nchemistry\r\nfor the exploratory analysis of multivariate data sets; however, many\r\nlearners have difficulty understanding how spectral preprocessing\r\ninfluences PCA interpretation. This activity was developed to illustrate\r\nthe effects of preprocessing on spectral profiles and PCA score plots\r\nusing guided computational activities implemented in R. During four\r\n50 min class periods, participants compared PCA models generated from\r\nraw spectra, Savitzky–Golay (SG) smoothing, first- and second-derivative\r\npreprocessing, Standard Normal Variate (SNV) normalization, and combinations\r\nof these preprocessing methods (<span><span></span><span>Anal. Chem.</span>\r\n<span>1964</span>, <span>36</span>, <span>1627</span>.</span>). Guided questions emphasized how\r\npreprocessing modifies spectral appearance, sample clustering, intergroup\r\ndistances, and the proportion of variance explained by the principal\r\ncomponents. An assessment using an independent Raman spectroscopy\r\ndata set evaluated the transfer of these concepts to previously unseen\r\ndata. Comparison of the different preprocessing strategies demonstrated\r\nthat smoothing and derivative preprocessing improved spectral discrimination\r\nby reducing baseline variation and emphasizing chemically relevant\r\nfeatures, whereas SNV normalization minimized intensity differences\r\namong spectra. The activities also demonstrated that preprocessing\r\nsubstantially alters the variance structure of spectral data sets,\r\nleading to changes in cluster separation and PCA interpretation. By\r\ndirectly relating spectral transformations to multivariate results,\r\nthis activity provides an accessible instructional activity for teaching\r\nspectral preprocessing and principal component analysis in analytical\r\nchemistry, spectroscopy, and chemometrics courses.</p>","PeriodicalId":43,"journal":{"name":"Journal of Chemical Education","volume":"103 10","pages":"6135–6145"},"PeriodicalIF":3.0000,"publicationDate":"2026-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Chemical Education","FirstCategoryId":"92","ListUrlMain":"https://pubs.acs.org/doi/10.1021/acs.jchemed.6c00722","RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/8/31 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

Principal component analysis (PCA) is widely used in chemistry for the exploratory analysis of multivariate data sets; however, many learners have difficulty understanding how spectral preprocessing influences PCA interpretation. This activity was developed to illustrate the effects of preprocessing on spectral profiles and PCA score plots using guided computational activities implemented in R. During four 50 min class periods, participants compared PCA models generated from raw spectra, Savitzky–Golay (SG) smoothing, first- and second-derivative preprocessing, Standard Normal Variate (SNV) normalization, and combinations of these preprocessing methods (Anal. Chem. 1964, 36, 1627.). Guided questions emphasized how preprocessing modifies spectral appearance, sample clustering, intergroup distances, and the proportion of variance explained by the principal components. An assessment using an independent Raman spectroscopy data set evaluated the transfer of these concepts to previously unseen data. Comparison of the different preprocessing strategies demonstrated that smoothing and derivative preprocessing improved spectral discrimination by reducing baseline variation and emphasizing chemically relevant features, whereas SNV normalization minimized intensity differences among spectra. The activities also demonstrated that preprocessing substantially alters the variance structure of spectral data sets, leading to changes in cluster separation and PCA interpretation. By directly relating spectral transformations to multivariate results, this activity provides an accessible instructional activity for teaching spectral preprocessing and principal component analysis in analytical chemistry, spectroscopy, and chemometrics courses.

预处理事项:可视化光谱预处理对主成分分析的影响
主成分分析(PCA)在化学领域广泛应用于多变量数据集的探索性分析;然而,许多学习者很难理解光谱预处理如何影响PCA解释。该活动是为了说明预处理对光谱剖面和PCA评分图的影响,使用了r中实施的指导计算活动。在450分钟的课堂上,参与者比较了由原始光谱、Savitzky-Golay (SG)平滑、一阶和二阶导数预处理、标准正态变量(SNV)归一化以及这些预处理方法的组合生成的PCA模型。化学。1964,36,1627.)。指导性问题强调了预处理如何修改光谱外观、样本聚类、组间距离以及由主成分解释的方差比例。使用独立拉曼光谱数据集的评估评估了这些概念到以前未见数据的转移。不同预处理策略的比较表明,平滑预处理和导数预处理通过减少基线变化和强调化学相关特征来改善光谱识别,而SNV归一化则最小化光谱之间的强度差异。这些活动还表明,预处理实质上改变了光谱数据集的方差结构,导致聚类分离和主成分分析解释的变化。通过将光谱变换与多变量结果直接联系起来,本活动为分析化学、光谱学和化学计量学课程中的光谱预处理和主成分分析提供了一个易于理解的教学活动。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Chemical Education
Journal of Chemical Education 化学-化学综合
CiteScore
5.60
自引率
50.00%
发文量
465
审稿时长
6.5 months
期刊介绍: The Journal of Chemical Education is the official journal of the Division of Chemical Education of the American Chemical Society, co-published with the American Chemical Society Publications Division. Launched in 1924, the Journal of Chemical Education is the world’s premier chemical education journal. The Journal publishes peer-reviewed articles and related information as a resource to those in the field of chemical education and to those institutions that serve them. JCE typically addresses chemical content, activities, laboratory experiments, instructional methods, and pedagogies. The Journal serves as a means of communication among people across the world who are interested in the teaching and learning of chemistry. This includes instructors of chemistry from middle school through graduate school, professional staff who support these teaching activities, as well as some scientists in commerce, industry, and government.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书