{"title":"Preprocessing Matters: Visualizing the Effect of Spectral Preprocessing on Principal Component Analysis","authors":"María Fernanda Hernández Rodríguez, Natan Cristian Pedroso Pereira, Endler Marcel Borges","doi":"10.1021/acs.jchemed.6c00722","DOIUrl":null,"url":null,"abstract":"<p>Principal component analysis (PCA) is widely used in\r\nchemistry\r\nfor the exploratory analysis of multivariate data sets; however, many\r\nlearners have difficulty understanding how spectral preprocessing\r\ninfluences PCA interpretation. This activity was developed to illustrate\r\nthe effects of preprocessing on spectral profiles and PCA score plots\r\nusing guided computational activities implemented in R. During four\r\n50 min class periods, participants compared PCA models generated from\r\nraw spectra, Savitzky–Golay (SG) smoothing, first- and second-derivative\r\npreprocessing, Standard Normal Variate (SNV) normalization, and combinations\r\nof these preprocessing methods (<span><span></span><span>Anal. Chem.</span>\r\n<span>1964</span>, <span>36</span>, <span>1627</span>.</span>). Guided questions emphasized how\r\npreprocessing modifies spectral appearance, sample clustering, intergroup\r\ndistances, and the proportion of variance explained by the principal\r\ncomponents. An assessment using an independent Raman spectroscopy\r\ndata set evaluated the transfer of these concepts to previously unseen\r\ndata. Comparison of the different preprocessing strategies demonstrated\r\nthat smoothing and derivative preprocessing improved spectral discrimination\r\nby reducing baseline variation and emphasizing chemically relevant\r\nfeatures, whereas SNV normalization minimized intensity differences\r\namong spectra. The activities also demonstrated that preprocessing\r\nsubstantially alters the variance structure of spectral data sets,\r\nleading to changes in cluster separation and PCA interpretation. By\r\ndirectly relating spectral transformations to multivariate results,\r\nthis activity provides an accessible instructional activity for teaching\r\nspectral preprocessing and principal component analysis in analytical\r\nchemistry, spectroscopy, and chemometrics courses.</p>","PeriodicalId":43,"journal":{"name":"Journal of Chemical Education","volume":"103 10","pages":"6135–6145"},"PeriodicalIF":3.0000,"publicationDate":"2026-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Chemical Education","FirstCategoryId":"92","ListUrlMain":"https://pubs.acs.org/doi/10.1021/acs.jchemed.6c00722","RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/8/31 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
Principal component analysis (PCA) is widely used in
chemistry
for the exploratory analysis of multivariate data sets; however, many
learners have difficulty understanding how spectral preprocessing
influences PCA interpretation. This activity was developed to illustrate
the effects of preprocessing on spectral profiles and PCA score plots
using guided computational activities implemented in R. During four
50 min class periods, participants compared PCA models generated from
raw spectra, Savitzky–Golay (SG) smoothing, first- and second-derivative
preprocessing, Standard Normal Variate (SNV) normalization, and combinations
of these preprocessing methods (Anal. Chem.1964, 36, 1627.). Guided questions emphasized how
preprocessing modifies spectral appearance, sample clustering, intergroup
distances, and the proportion of variance explained by the principal
components. An assessment using an independent Raman spectroscopy
data set evaluated the transfer of these concepts to previously unseen
data. Comparison of the different preprocessing strategies demonstrated
that smoothing and derivative preprocessing improved spectral discrimination
by reducing baseline variation and emphasizing chemically relevant
features, whereas SNV normalization minimized intensity differences
among spectra. The activities also demonstrated that preprocessing
substantially alters the variance structure of spectral data sets,
leading to changes in cluster separation and PCA interpretation. By
directly relating spectral transformations to multivariate results,
this activity provides an accessible instructional activity for teaching
spectral preprocessing and principal component analysis in analytical
chemistry, spectroscopy, and chemometrics courses.
期刊介绍:
The Journal of Chemical Education is the official journal of the Division of Chemical Education of the American Chemical Society, co-published with the American Chemical Society Publications Division. Launched in 1924, the Journal of Chemical Education is the world’s premier chemical education journal. The Journal publishes peer-reviewed articles and related information as a resource to those in the field of chemical education and to those institutions that serve them. JCE typically addresses chemical content, activities, laboratory experiments, instructional methods, and pedagogies. The Journal serves as a means of communication among people across the world who are interested in the teaching and learning of chemistry. This includes instructors of chemistry from middle school through graduate school, professional staff who support these teaching activities, as well as some scientists in commerce, industry, and government.