Gyo'yug pyeong'ga yeon'gu最新文献

筛选
英文 中文
Stakeholder Involvement in Program Evaluation 利益相关者参与项目评估
Gyo'yug pyeong'ga yeon'gu Pub Date : 2023-09-30 DOI: 10.31158/jeev.2023.36.3.343
Wonsuk Lee
{"title":"Stakeholder Involvement in Program Evaluation","authors":"Wonsuk Lee","doi":"10.31158/jeev.2023.36.3.343","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.3.343","url":null,"abstract":"As the critics of traditional program evaluation centered on quantitative research methods in the 60s and 70s in the U.S. were raised, stakeholder involvement was widely recognized as a solution in the program evaluation field in the 2000s. However, issues such as which stakeholders are involved and the depth of stakeholder involvement have been raised. Especially, in the case of Korea, there seems to be a lack of discussion on the needs and procedures of stakeholder involvement. This article investigated the meaning and necessity of stakeholder involvement in program evaluation along with its background. Also, general ways that can be used by evaluators who want to apply stakeholder involvement in the actual evaluation were presented. In addition, implications of stakeholder involvement to current program evaluations in Korea were derived.","PeriodicalId":487976,"journal":{"name":"Gyo'yug pyeong'ga yeon'gu","volume":"48 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135039198","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Testing Factorial Invariance of Zero-inflated Measures Using a Two-part Factor Model 用两部分因子模型检验零膨胀测度的因子不变性
Gyo'yug pyeong'ga yeon'gu Pub Date : 2023-09-30 DOI: 10.31158/jeev.2023.36.3.445
Mirim Kim
{"title":"Testing Factorial Invariance of Zero-inflated Measures Using a Two-part Factor Model","authors":"Mirim Kim","doi":"10.31158/jeev.2023.36.3.445","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.3.445","url":null,"abstract":"Multi-group confirmatory factor analysis (MGCFA) is a common tool for testing factorial invariance within structural eqaution modeling (SEM) framework; however, a two-part factor model might be more appropriate for zero-inflated measures due to the severe non-normality of the data. Nevertheless, testing the factorial invariance of zero-inflated variables using the two-part factor model is uncommon. To fill that gap in the literature, the current study demonstrated the use of two-part factor model for testing factorial invariance of highly zero-inflated measures and compared the result to the MGCFA’s. The two models led to different factorial invariance results on the zero-inflated measures. The two-part factor model supported full scalar invariance of the continuous-part model whereas the MGCFA concluded only partial metric invariance. Thus, applying a different factor model brought different conclusions about factorial invariance when the measures were zero-inflated.","PeriodicalId":487976,"journal":{"name":"Gyo'yug pyeong'ga yeon'gu","volume":"170 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135039409","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Investigating the Performance of Fit Indices for Testing Longitudinal Measurement Invariance in Latent Transition Analysis: A Monte Carlo Simulation Study 潜在过渡分析中纵向测量不变性的拟合指标性能研究:蒙特卡罗模拟研究
Gyo'yug pyeong'ga yeon'gu Pub Date : 2023-09-30 DOI: 10.31158/jeev.2023.36.3.581
Jaeuk Kim, Wonsook Sohn
{"title":"Investigating the Performance of Fit Indices for Testing Longitudinal Measurement Invariance in Latent Transition Analysis: A Monte Carlo Simulation Study","authors":"Jaeuk Kim, Wonsook Sohn","doi":"10.31158/jeev.2023.36.3.581","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.3.581","url":null,"abstract":"In latent transition analysis (LTA), the assumption of longitudinal measurement invariance (LMI) carries significant advantages, such as simplifying interpretation of transition probabilities, aiding model identification, and reducing bias in parameter estimation. Despite it’s importance, there’s a notable lack of practical methodologies for LMI testing in LTA models. This study aims to address this gap by investigating and comparing the performance of four commonly used fit indices such as AIC, BIC, SABIC, and LRT-for structural LMI tests in LTA under various conditions. This will provide empirical guidelines for researchers conducting LMI tests in the context of LTA. To this end, a simulation study was designed and conducted using the Monte Carlo method. In total, 560 conditions were manipulated, and data were generated from 500 iterations for each condition. Mplus 8.3 and the R package ‘MplusAutomation’ were used for data generation and model analysis, while the Python libraries ‘pandas’ and ‘pdfminer’ were used for preprocessing the results. The results are as follows. First, all model fit indices demonstrated favorable performance when the LMI was satisfied completely or partially. Second, the performance of the fit indices was weaker when the LMI was not met, due to the small sample size and the subtle degrees of LMI violation to be detected. Third, the AIC showed stable performance in detecting LMI violations across all conditions, followed by LRT, SABIC, and BIC. Finally, the practical implication of the results were discussed.","PeriodicalId":487976,"journal":{"name":"Gyo'yug pyeong'ga yeon'gu","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135039082","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Optimal sample size analysis for LDA topic modeling using news articles about high school credit system 基于高中学分制新闻文章的LDA主题建模最优样本量分析
Gyo'yug pyeong'ga yeon'gu Pub Date : 2023-09-30 DOI: 10.31158/jeev.2023.36.3.365
Eunjeong Jeon, Youn-Jeng Choi
{"title":"Optimal sample size analysis for LDA topic modeling using news articles about high school credit system","authors":"Eunjeong Jeon, Youn-Jeng Choi","doi":"10.31158/jeev.2023.36.3.365","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.3.365","url":null,"abstract":"This study aimed to determine the number of documents suitable for LDA topic modeling analysis. Sample data was created from 7,115 news articles covering the high school credit system until 2022, following the announcement of the introduction of the high school credit system. Four different methods were employed for analysis. First, a total of 120 pieces of sample data, comprising 6 types with 20 pieces, were created, and the analyzed topics and concordance were examined for all documents. Second, through the AUC of the ROC curve, the discriminative power of all documents and the analysis of the same topic variables based on the number of documents were investigated. Third, the total document topics and the frequency of the same topic were analyzed in relation to the number of documents. Fourth, after analyzing the topics within the entire document, sample data reflecting the document ratio and weight by topic were created and compared based on the number of documents. The findings of this study indicate that a minimum of approximately 700 documents is required for robust LDA topic modeling analysis. Moreever, the analysis suggests that collecting over 2,000 documents provides sufficient data for reliable results.","PeriodicalId":487976,"journal":{"name":"Gyo'yug pyeong'ga yeon'gu","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135039554","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Analysis of Research Trends in The Journal of Educational Evaluation using Topic Modeling 用主题模型分析《教育评价》杂志的研究趋势
Gyo'yug pyeong'ga yeon'gu Pub Date : 2023-09-30 DOI: 10.31158/jeev.2023.36.3.553
Ye-Lim Yu, Ji-Eun Kim
{"title":"Analysis of Research Trends in The Journal of Educational Evaluation using Topic Modeling","authors":"Ye-Lim Yu, Ji-Eun Kim","doi":"10.31158/jeev.2023.36.3.553","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.3.553","url":null,"abstract":"This study aims to explore research trends in educational measurement and evaluation by applying text-mining and analyzing the abstract of 969 articles published in the Journal of Educational Evaluation from 1993 to 2022, published by the Korean Society for Educational Evaluation. The main findings from keyword frequency analysis and topic modeling analysis based on LDA algorithm are as follows. First, keywords such as ‘student,’ ‘question,’ ‘test,’ ‘model,’ ‘evaluation,’ ‘estimation,’ ‘academic achievement,’ and ‘ability’ were generally mentioned as necessary in abstracts from the journal, and the main keywords changed over time. Second, a total of 12 topics appeared, including ‘the Item Response Theory model’, ‘development and validation of measurement tools’, ‘analysis of the factors influencing academic achievement’, ‘program evaluation and performance assessment’ and so on. Third, the ratio of the 12 topics that represent research trends changed with time. Especially, the topics of ‘analysis of factors influencing academic achievement’, ‘the Item Response Theory model’, and ‘teacher evaluation and student assessment’ had an increasing trend. In contrast, the topics of ‘computer-based evaluation’, ‘college entrance exam’, and ‘program evaluation and performance assessment’ had a decreasing trend. Lastly, the traits of research trends in the South Korean educational measurement and evaluation shown in the Journal of Education Evaluation were analyzed and future development and improvement tasks were discussed.","PeriodicalId":487976,"journal":{"name":"Gyo'yug pyeong'ga yeon'gu","volume":"76 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135039826","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Developement and the Validation of Korean Language Subject Competency 韩国语学科能力的发展与验证
Gyo'yug pyeong'ga yeon'gu Pub Date : 2023-09-30 DOI: 10.31158/jeev.2023.36.3.405
Hyejin Jung
{"title":"The Developement and the Validation of Korean Language Subject Competency","authors":"Hyejin Jung","doi":"10.31158/jeev.2023.36.3.405","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.3.405","url":null,"abstract":"This study analyzed and developed a tool to measure the concepts and sub-factors of Korean language subject competency, as presented in the revised 2015 curriculum. To do so, previous studies were reviewed comprehensively, and preliminary items were developed based on the achievement standards presented in the curriculum and validated for content validity. Using the revised preliminary items (a total of 117 items), a pilot test was conducted with 162 middle school students in Seoul, and construct validity was verified through exploratory factor analysis. Based on the results, a total of 82 items were selected for the actual test, which was conducted with 507 middle school students. Confirmatory factor analysis using structural equation modeling was conducted, resulting in the completion of the final measurement tool (a total of 71 items). The completed measurement tool consists of critical and creative thinking competencies (analysis, inference, creativity), data and information utilization competencies (task comprehension, data analysis and utilization, task solving and evaluation), communication competencies (understanding, expression, delivery, media communication capability), social and interpersonal relationship competencies (cooperation, respect, community understanding), cultural enjoyment competencies (cultural understanding, cultural acceptance, cultural creation), and self-reflection and development competencies (self-inspection, self-reflection, self-leadership). The tool demonstrated good validity and reliability.","PeriodicalId":487976,"journal":{"name":"Gyo'yug pyeong'ga yeon'gu","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135039195","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring the Predictive Variables on Adolescents Career Maturity Development Based on Mixed Effect Random Forest: Interpretation using SHAP 基于混合效应随机森林的青少年职业成熟度发展预测变量探索:基于SHAP的解释
Gyo'yug pyeong'ga yeon'gu Pub Date : 2023-09-30 DOI: 10.31158/jeev.2023.36.3.473
Yeheun Baek, Hyewon Chung
{"title":"Exploring the Predictive Variables on Adolescents Career Maturity Development Based on Mixed Effect Random Forest: Interpretation using SHAP","authors":"Yeheun Baek, Hyewon Chung","doi":"10.31158/jeev.2023.36.3.473","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.3.473","url":null,"abstract":"The purpose of this study is to explore predictive variables of career maturity during middle and high school. To do this, the mixed effects random forest that considers the hierarchical data structure of longitudinal data was applied to GEPS(gyeonggi education panel study) data from the 4th to 9th wave (7th-12th grades). To derive the major predictive variables which are more stable, the analysis through multiple imputation was repeated five times to identify the top 20 variables with a high SHAP (shapley additive expansion) importance index. As a result, 17 major predictive variables were derived by using SHAP value: ‘self-understanding as a learner’, ‘proactive initiative’, sub factors of self-directed learning ability, friend relationships, teacher relationships, and ‘career search during vacation’ were selected as key variables that predict development of career maturity. In addition, variables related to relationships between parent-child such as ‘parent parenting behavior’ and ‘attachment’, as well as students affective attitudes such as ‘self-esteem’, ‘self-efficacy’, and ‘learning motivation’ were selected as key predictive variables, too. The relationship between major predictive variables and career maturity was examined through the SHAP dependence plot, and educational implications for career development of adolescents were discussed.","PeriodicalId":487976,"journal":{"name":"Gyo'yug pyeong'ga yeon'gu","volume":"45 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135039200","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effects of College Students’ Achievement Goals and Academic Engagement on their Self-Assessment Practice: Exploring Gender Differences 大学生成就目标和学业投入对自我评价实践的影响:性别差异的探索
Gyo'yug pyeong'ga yeon'gu Pub Date : 2023-09-30 DOI: 10.31158/jeev.2023.36.3.499
Hyunjong Noh, Wonsook Sohn
{"title":"Effects of College Students’ Achievement Goals and Academic Engagement on their Self-Assessment Practice: Exploring Gender Differences","authors":"Hyunjong Noh, Wonsook Sohn","doi":"10.31158/jeev.2023.36.3.499","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.3.499","url":null,"abstract":"The student self-assessment is considered as a formative assessment process in which students reflect on and judge the quality of their learning and appropriately modify it, and it is also a representative strategy for assessment as learning(AAL). The purpose of this study is to identify the effects of achievement goals and academic engagement on college students' self-assessment practice and explore their gender differences. For this purpose, the data of 317 college students were analyzed, and the results are as follows. First, it was found that the learner's mastery goal had the most positive effects on student self-assessment practice by mediating cognitive or agentic engagement. Second, the higher the cognitive or agentic engagement, the higher the tendency to perform self-assessment by self-monitoring external resources(SEFM). Relatively, the higher the cognitive engagement, the more frequently the use of internal resources(SIF), while the higher the agentic engagement, the higher the tendency to obtain information by asking questions to others such as professors, parents and friends(SEFI). Third, in the internal process of self-assessment, SEFM, SEFI, and SIF, which are feedback-seeking behaviors, showed statistically significant direct effects on self-reflection. Fourth, multigroup structural model analysis confirmed gender differences in detailed pathways. Finally, through the results of the study, the necessity of preparing a plan for cultivating self-assessment literacy in an efficient and adaptive way for each learner was discussed.","PeriodicalId":487976,"journal":{"name":"Gyo'yug pyeong'ga yeon'gu","volume":"141 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135040097","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparison of the Methods for Estimating the Relationship between Latent Class and Continuous Outcome Variable in Growth Mixture Models 生长混合模型中潜在类别与连续结果变量关系估计方法的比较
Gyo'yug pyeong'ga yeon'gu Pub Date : 2023-09-30 DOI: 10.31158/jeev.2023.36.3.523
Noh-Won Park, Sunbok Lee
{"title":"Comparison of the Methods for Estimating the Relationship between Latent Class and Continuous Outcome Variable in Growth Mixture Models","authors":"Noh-Won Park, Sunbok Lee","doi":"10.31158/jeev.2023.36.3.523","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.3.523","url":null,"abstract":"This study aims to provide researchers with guidelines on the appropriate estimation method to estimate the relationship between latent class and outcome variables in growth mixture models through Monte Carlo simulation. To this end, this study briefly introduces 1) the one-step method, 2) the PC method, 3) the Lanza method, 4) the traditional three-step method, 5) the new three-step method, and 6) the BCH method to estimate the relationship between latent class and outcome variables in growth mixture models, and compares the six estimation methods based on four performance criteria: relative bias, variance, power, and type I error through Monte Carlo simulation. The results of this study showed that the Lanza and BCH methods were superior across a range of conditions, with the Lanza and BCH methods being superior when the effect size was small and the Lanza method being superior when the effect size was large. Based on these findings, the significance, limitations, and follow-up studies were discussed.","PeriodicalId":487976,"journal":{"name":"Gyo'yug pyeong'ga yeon'gu","volume":"2014 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135039414","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书