Examining the Validity of History-of-Science-Based Evolution Concept Assessment and Exploring Conceptual Progressions by Contexts

Abstract

Previous studies have investigated the similarity between the development of evolutionary explanations and students’ conceptual developments on evolution. However, the validity and reliability of the assessment method reflecting the similarity have not been quantitatively examined yet. In addition, no study has examined the conceptual progressions of evolution concept based on contexts although literature has addressed the contextual difference of evolutionary explanation in the history of science. This study examined the validity and reliability of history-of-science-based evolution concept assessment using ordered multiple choice (OMC) methods and Rasch analysis and explored conceptual progression by three contexts (e.g., human, animal, and plant). The evolution concept assessment developed by Ha (2007) was used to examine 1711 elementary, middle, and high school students, and pre- and in-service science teachers’ (biology majors and non-majors) evolution concepts. Internal consistency reliability and item response fitness of the OMC method that provide 0- to 4-point scores to creationism, teleology, intentionality, use/disuse, and natural selection respectively met the benchmark based on the Cronbach alpha and MNSQ indices of Rasch analysis. The level of elementary and middle school students’ evolution concepts were located between intentionality and use/disuse while the level of high school and non-biology science teachers’ evolution concepts were located between use/disuse and natural selection. The conceptual progressions of evolution concepts were differentiated according to three contexts. This study provided the quantitative evidence for the similarity between the development of evolutionary explanations and students’ conceptual developments on evolution and suggest new analysis methods (i.e., OMC) of evolution concept assessment.