Korean Society for Educational Evaluation最新文献_第2页

Analysis of news articles on the Customized Assessment of Educational Achievement using text analysis 用文本分析法分析教育成就定制化评价的新闻文章

Korean Society for Educational Evaluation Pub Date : 2023-03-30 DOI: 10.31158/jeev.2023.36.1.167

Hye Rim Noh, H. Yi

{"title":"Analysis of news articles on the Customized Assessment of Educational Achievement using text analysis","authors":"Hye Rim Noh, H. Yi","doi":"10.31158/jeev.2023.36.1.167","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.1.167","url":null,"abstract":"The purpose of this study is to analyze the perception of stakeholders and the public on the Customized Assessment of Educational Achievement (CAEA) proposed to ensure the basic level of academic performance of students in South Korea. For this purpose, news articles and online comments were collected from major newspapers and broadcasting stations using web-crawling method. The LDA topic modeling and semantic network analysis were carried out for the news articles, while keyword frequency analysis were carried out for the news articles and comments. Seven topics were extracted from the LDA analysis: (1) conflicting responses from superintendents for expansion of the CAEA, (2) conflicts between the Office of Education and teacher organizations over participation in the CAEA, (3) implementation of the comprehensive plan to ensure that every student meets the basic level of academic standards, (4) expansion of the CAEA for improving academic performance by conservative superintendents, (5) expansion of CAEA’s target grades, (6) the 2021 National Level Academic Achievement Assessment result, and (7) implementation of the CAEA and private education. In addition, the need for the national or state-level customized assessment and concerns about polarization in education associated with mandatory administration were found in the analysis of comments on news articles. Finally, based on the perceptions of stakeholders and the public explored through this study, implications for the educationally-sound applications of the CAEA were discussed.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131390291","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Testing Longitudinal Measurement Invariance of a Career Maturity Scale Through an Item Parameter Drift Analysis 用项目参数漂移分析检验职业成熟度量表的纵向测量不变性

Korean Society for Educational Evaluation Pub Date : 2023-03-30 DOI: 10.31158/jeev.2023.36.1.31

Subeen Lee, Chanho Park

{"title":"Testing Longitudinal Measurement Invariance of a Career Maturity Scale Through an Item Parameter Drift Analysis","authors":"Subeen Lee, Chanho Park","doi":"10.31158/jeev.2023.36.1.31","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.1.31","url":null,"abstract":"The purpose of this study is to examine longitudinal measurement invariance of a career maturity scale for middle school students through an item parameter drift (IPD) analysis. Data obtained from the middle school panel participating in the Daegu Education Longitudinal Study (DELS) for 3 years were analyzed. Career maturity was measured with polytomous items, and IPD items were detected for the first and the second grade and for the second and the third grade using the likelihood ratio test based on the graded response model. As a result of the IPD analysis, it was found that IPD was detected for 3 items (items 1, 2, and 10) between the first and the second grade and for 4 items (items 1, 2, 6, and 8) between the second and the third grade. Among them, items 1 and 2, which were consecutively flagged as IPD, are self-understanding questions, and the average score of self-understanding items gradually decreased although the step parameters of those items became smaller. As a result, it was found that the IPD items caused a large decrease in the average item scores of career maturity. This suggests that if the IPD items are used without testing longitudinal measurement invariance, the difference may look larger than what it actually is.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130294511","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Relationship between learner-centered classes and academic achievement of high school students: Focusing on the longitudinal mediating effect of school happiness 以学习者为中心的课堂与高中生学业成绩的关系:基于学校幸福感的纵向中介效应

Korean Society for Educational Evaluation Pub Date : 2022-12-31 DOI: 10.31158/jeev.2022.35.4.609

Yun-Jeong Shin, Hyo-Jong Won

{"title":"Relationship between learner-centered classes and academic achievement of high school students: Focusing on the longitudinal mediating effect of school happiness","authors":"Yun-Jeong Shin, Hyo-Jong Won","doi":"10.31158/jeev.2022.35.4.609","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.4.609","url":null,"abstract":"In order to analyze the longitudinal effect of learner-centered classes of general high school students on academic achievement through school happiness, this study conducted a univariate and multivariate latent growth model analysis using data of 1,833 general high school students in the 4th and 6th years of the BELS. First, looking at the development trajectory of each research variable, it was confirmed that the average and rate of change of all variables were statistically significant, and there was a difference between individuals in changes according to grades, and students with high initial values were likely to have a relatively high rate of change. However, as the grade went up, learner-centered classes and school happiness decreased, but there was a difference in academic achievement. Next, as a result of verifying the influence of each path of the multivariate latent growth model, statistically significant influence of all paths was confirmed, but there was a difference in static and negative influence. Finally, as a result of analyzing the longitudinal mediating effect of school happiness in the relationship between learner-centered class and academic achievement, statistically significant partial mediating effect was verified in each path of initial value and rate of change. In particular, the initial value of learner-centered classes was found to have a statistically significant negative effect on the initial value of academic achievement, but statistically significant static mediating paths were analyzed when school happiness was used as a parameter.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131265078","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A Comparison of three Propensity Score Methods’ Average Treatment Effect on the Treat by Simulation 三种倾向评分法对模拟治疗的平均治疗效果比较

Korean Society for Educational Evaluation Pub Date : 2022-12-31 DOI: 10.31158/jeev.2022.35.4.555

Jiyoung Mun, Hyunchul Kim

引用次数: 0

The Precision of Ability Estimates and Item Pool Utilization Depending on Degrees of Correlations among Subsections and Item Selection Criteria in Computerized Adaptive Testing 计算机化自适应测试中能力估计精度和题库利用率依赖于子部分和题库选择标准的相关度

Korean Society for Educational Evaluation Pub Date : 2022-12-31 DOI: 10.31158/jeev.2022.35.4.633

Youmin Hong, Guemin Lee

{"title":"The Precision of Ability Estimates and Item Pool Utilization Depending on Degrees of Correlations among Subsections and Item Selection Criteria in Computerized Adaptive Testing","authors":"Youmin Hong, Guemin Lee","doi":"10.31158/jeev.2022.35.4.633","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.4.633","url":null,"abstract":"The purpose of this study was to investigate the effects of degrees of correlations among subsections and item selection criteria on the precision of ability estimates and item pool utilization in computerized adaptive testing (CAT). Based on the results of this simulation study, the following conclusions can be made. First, the precision of ability estimates would be decreased when the correlations among subsections was relatively low. Second, when implementing an a-stratified item selection method (AST), the effects of degrees of correlations among subsections on the precision of ability estimates increased, compared to the maximum fisher information item selection method (MFI). Third, when the test length was relatively long, the effects of degrees of correlations among subsections on the precision of ability estimates decreased. Forth, MFI with content-balancing increased the precision of ability estimates, especially in the case of low correlations among subsections. The item pool utilization seemed not to be considerably affected by the correlations among subsections, implementing a-stratification item selection method and/or item exposure strategy, the item pool utilization increased.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116757319","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The Relationship Between Academic Achievement and Affective Attitudes in Math and Science Based on TIMSS Results 基于TIMSS结果的数学和科学学业成绩与情感态度的关系

Korean Society for Educational Evaluation Pub Date : 2022-12-31 DOI: 10.31158/jeev.2022.35.4.763

Kyung-Nyun Kim, Minhee Seo, Bitna Lee

{"title":"The Relationship Between Academic Achievement and Affective Attitudes in Math and Science Based on TIMSS Results","authors":"Kyung-Nyun Kim, Minhee Seo, Bitna Lee","doi":"10.31158/jeev.2022.35.4.763","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.4.763","url":null,"abstract":"For the past 20 years, Korea has shown a very low level of affective attitude in math and science despite high academic achievement scores in international academic achievement evaluations such as PISA or TIMSS. To identify patterns of affective attitudes in math and science, we compared the relationship between affective attitudes and academic achievement through comparisons of high-performing countries. Also, we conducted latent profile analysis on affective attitudes in math and science and investigated the relationship between latent profile and academic achievement. We used cohort data for 4th and 8th graders to compare changes across grades. The results are as follows. First, affective attitudes and academic achievement were positively correlated in all countries, but high-performing countries had very low affective attitudes. Second, according to the results of the latent profile on affective attitudes in math and science, the 4th graders were derived on the basis of positive attitudes, whereas the 8th graders were derived on the basis of negative attitudes. Third, students who belonged to a group with high affective attitudes showed high academic achievement for all graders in Korea. Lastly, educational implications for improving affective attitudes in math and science were proposed.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130253003","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

An Analysis of the Cumulative Effect of AttendingGyeonggi-do Innovation School on College Entrance 进入京畿道创新学校对大学入学的累积效应分析

Korean Society for Educational Evaluation Pub Date : 2022-12-31 DOI: 10.31158/jeev.2022.35.4.719

Hyun-jung Im

{"title":"An Analysis of the Cumulative Effect of AttendingGyeonggi-do Innovation School on College Entrance","authors":"Hyun-jung Im","doi":"10.31158/jeev.2022.35.4.719","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.4.719","url":null,"abstract":"The purpose of this study is to verify the effect of attending Gyeonggi-do innovation school on college entrance and academic achievement. In particular, the analysis is conducted using the inverse probability of treatment weighting of propensity score to empirically verify the longitudinal effect of the innovation school attendance experience and whether additional effects occur through the linkage of innovation education. As a result of the analysis, the experience of attending an innovation high school has a positive effect on college entrance, the probability of entering a four-year university, while the difference between general middle school graduates and innovation middle school graduates on college entrance is not significant. The interaction between innovation middle school and innovation high school on the location of the university and the university ranking is significant, indicating that the linkage of innovation education is advantageous for college entrance. On the other hand, there is no difference in CSAT scores between general school graduates and innovation school graduates. These results show that Gyeonggi-do innovation high school has a positive effect on college entrance of its students. In particular, it is confirmed that the positive effect is amplified when both middle and high schools are in innovative education. Also among innovation high school graduates, those from general middle schools shows disadvantageous college entrance results while those from innovation middle schools shows favorable results. This result shows the necessity of linking innovative education from middle school level to high school level.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128625620","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Text-mining Analyses of Undergraduates’ Essays on Global Perspectives by Performance Levels in Korea 韩国大学生全球视野论文的文本挖掘分析

Korean Society for Educational Evaluation Pub Date : 2022-12-31 DOI: 10.31158/jeev.2022.35.4.687

E. Ham, Ye-Lim Yu

{"title":"Text-mining Analyses of Undergraduates’ Essays on Global Perspectives by Performance Levels in Korea","authors":"E. Ham, Ye-Lim Yu","doi":"10.31158/jeev.2022.35.4.687","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.4.687","url":null,"abstract":"This study aims to illustrate how text-mining can be employed to identify key qualities of student performance on essays according to different performance levels. A total of 111 undergraduates’ essays on ‘climate change and transnational cooperation’ were classified into the upper, middle, and lower levels based on scores. The main findings from keyword frequency and network analyses are as follows. First, the contents of frequently used words were different across the performance levels. In the upper-level answers, the frequency of keywords used to analyze conflicts of interest between countries and to suggest cross-border responses using technology was high. In contrast, in the lower-level answers, everyday words often appeared to describe the need to respond to climate crisis. Second, in the upper-level answers, the weighted degree of centrality was similar across keywords, and the connections between keywords were stronger. While in the lower-level answers, the opposites were observed. Third, bigram network analysis was effective at all levels in identifying the structure of detailed discussions of essays. The usefulness and future directions of using text mining to analyze the qualitative difference in the subjects’ performance in essay assessment were discussed.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"46 6","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121010324","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Fitting the GLMM tree to educational data: focusing on differential effects of afterschool program and private tutoring participation 对教育数据的GLMM树拟合:关注课外计划和私人辅导参与的差异效应

Korean Society for Educational Evaluation Pub Date : 2022-12-31 DOI: 10.31158/jeev.2022.35.4.577

Hyun-jeong Park, Dayeon Lee, Hyeon-ji Kwon

{"title":"Fitting the GLMM tree to educational data: focusing on differential effects of afterschool program and private tutoring participation","authors":"Hyun-jeong Park, Dayeon Lee, Hyeon-ji Kwon","doi":"10.31158/jeev.2022.35.4.577","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.4.577","url":null,"abstract":"This study aims to introduce the GLMM tree and show its usefulness in educational research. The GLMM tree model is an extension of MOB to be applied to multilevel data, which detects subgroups with differential effects to estimate the fixed-effect in each subgroup and the random effect by the cluster to which each observation belongs. In this study, we identified the differential effects by detecting subgroups of afterschool programs and private tutoring participation in mathematics achievement of second grade high school students. Using the GLMM trees, students were divided into 16 and 15 subgroups respectively according to the participation of afterschool programs and the private tutoring. Also, cognitive and affective variables such as pre-mathematics achievement, interest in mathematics were selected as nodes. For both treatments, it was confirmed that the fixed-effect was estimated differently for each subgroup. Based on the results, we compared the differential effects of participation in afterschool programs and private tutoring and factors selected as nodes of models, and discussed the potential of the GLMM tree model in educational research.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"56 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116758892","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A case study of latent growth curve analysis on creativity of Korean adolescent using SEMtree 运用SEMtree分析韩国青少年创造力的潜在成长曲线

Korean Society for Educational Evaluation Pub Date : 2022-12-31 DOI: 10.31158/jeev.2022.35.4.787

Hyekyung Jung, Yongsang Lee, Insuk Kim

引用次数: 0