Longitudinal Study of Students’ Study Approaches in Organic Chemistry Classes: Using Structural Equation Modeling (SEM) to Detect a Response Shift in Data from the OCH-Adjusted M-ASSIST Instrument

IF 2.5 3区 教育学 Q2 CHEMISTRY, MULTIDISCIPLINARY
Helena C. Malinakova*, 
{"title":"Longitudinal Study of Students’ Study Approaches in Organic Chemistry Classes: Using Structural Equation Modeling (SEM) to Detect a Response Shift in Data from the OCH-Adjusted M-ASSIST Instrument","authors":"Helena C. Malinakova*,&nbsp;","doi":"10.1021/acs.jchemed.4c0063110.1021/acs.jchemed.4c00631","DOIUrl":null,"url":null,"abstract":"<p >Organic chemistry presents a significant obstacle for students seeking entry into health-related professions. Students’ ability to develop effective study approaches is an important predictor of success in the course. Herein, we report an investigation utilizing an OCH-adjusted M-ASSIST instrument to assess possible changes in students’ study approaches in the Organic Chemistry I course. Surveys for this study were completed in October and December of the first semester of the Organic Chemistry I course at the University of Kansas and afforded 84 individually paired responses. Furthermore, students’ attitudes toward utilizing supplementary study tools (Study Cards and Concept Maps) were interrogated by a four-question survey administered on the same dates. Confirmatory Factor Analysis (CFA) of the responses to the OCH-adjusted M-ASSIST instrument revealed a notable difference in a few individual factor loadings between the models for the October and December data as well as an increase in a negative covariance between the Deep and Surface learning factors. Analysis of these changes between the models for the October and December data utilizing the chi-square difference (χ<sub>DIF</sub><sup>2</sup>) test for pairs of nested SEM (structural equation modeling) models including the assessment of statistical power, yielded two significant conclusions. First, a statistically significant negative correlation between Deep and Surface learning develops only after the October sampling date and is present only in the models for the December data. Second, a response shift (reprioritization, which means a change in factor loadings) was detected in student responses to the OCH-adjusted M-ASSIST instrument and involves a single item (a question from the “relating ideas” subsection of the instrument) loading on the Deep learning factor. However, the average learning scores (both Deep and Surface) in this longitudinal did not change across the study time frame. Responses to questions regarding the use of Study Cards and Concept Maps revealed that a significant decrease in students’ ability to apply these study tools toward meaningful learning occurred by the end of the semester. The greatest effect size was noted for students’ assessment of their use of Concept Maps, potentially indicating challenges they experience when processing material of increasing complexity. Our results suggest that an important reevaluation, or self-reassessment in students’ study approaches, is taking place in the second half of the Organic Chemistry I course demonstrating that the same group of students changes their interpretation of a single item on the instrument. Conceivably the students perceive the process of “relating ideas” differently or with a changed emphasis toward the end of the semester (reprioritization). Furthermore, students develop a more defined study approach that either gravitates more strongly toward the Deep learning or toward the Surface learning approaches, rather than a mixture of both. These insights have both fundamental significance for the understanding of the learning process and practical implications for the designs of teaching methodologies.</p>","PeriodicalId":43,"journal":{"name":"Journal of Chemical Education","volume":"102 1","pages":"15–26 15–26"},"PeriodicalIF":2.5000,"publicationDate":"2024-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Chemical Education","FirstCategoryId":"92","ListUrlMain":"https://pubs.acs.org/doi/10.1021/acs.jchemed.4c00631","RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

Organic chemistry presents a significant obstacle for students seeking entry into health-related professions. Students’ ability to develop effective study approaches is an important predictor of success in the course. Herein, we report an investigation utilizing an OCH-adjusted M-ASSIST instrument to assess possible changes in students’ study approaches in the Organic Chemistry I course. Surveys for this study were completed in October and December of the first semester of the Organic Chemistry I course at the University of Kansas and afforded 84 individually paired responses. Furthermore, students’ attitudes toward utilizing supplementary study tools (Study Cards and Concept Maps) were interrogated by a four-question survey administered on the same dates. Confirmatory Factor Analysis (CFA) of the responses to the OCH-adjusted M-ASSIST instrument revealed a notable difference in a few individual factor loadings between the models for the October and December data as well as an increase in a negative covariance between the Deep and Surface learning factors. Analysis of these changes between the models for the October and December data utilizing the chi-square difference (χDIF2) test for pairs of nested SEM (structural equation modeling) models including the assessment of statistical power, yielded two significant conclusions. First, a statistically significant negative correlation between Deep and Surface learning develops only after the October sampling date and is present only in the models for the December data. Second, a response shift (reprioritization, which means a change in factor loadings) was detected in student responses to the OCH-adjusted M-ASSIST instrument and involves a single item (a question from the “relating ideas” subsection of the instrument) loading on the Deep learning factor. However, the average learning scores (both Deep and Surface) in this longitudinal did not change across the study time frame. Responses to questions regarding the use of Study Cards and Concept Maps revealed that a significant decrease in students’ ability to apply these study tools toward meaningful learning occurred by the end of the semester. The greatest effect size was noted for students’ assessment of their use of Concept Maps, potentially indicating challenges they experience when processing material of increasing complexity. Our results suggest that an important reevaluation, or self-reassessment in students’ study approaches, is taking place in the second half of the Organic Chemistry I course demonstrating that the same group of students changes their interpretation of a single item on the instrument. Conceivably the students perceive the process of “relating ideas” differently or with a changed emphasis toward the end of the semester (reprioritization). Furthermore, students develop a more defined study approach that either gravitates more strongly toward the Deep learning or toward the Surface learning approaches, rather than a mixture of both. These insights have both fundamental significance for the understanding of the learning process and practical implications for the designs of teaching methodologies.

Abstract Image

求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Chemical Education
Journal of Chemical Education 化学-化学综合
CiteScore
5.60
自引率
50.00%
发文量
465
审稿时长
6.5 months
期刊介绍: The Journal of Chemical Education is the official journal of the Division of Chemical Education of the American Chemical Society, co-published with the American Chemical Society Publications Division. Launched in 1924, the Journal of Chemical Education is the world’s premier chemical education journal. The Journal publishes peer-reviewed articles and related information as a resource to those in the field of chemical education and to those institutions that serve them. JCE typically addresses chemical content, activities, laboratory experiments, instructional methods, and pedagogies. The Journal serves as a means of communication among people across the world who are interested in the teaching and learning of chemistry. This includes instructors of chemistry from middle school through graduate school, professional staff who support these teaching activities, as well as some scientists in commerce, industry, and government.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信