Korean Society for Educational Evaluation最新文献

Exploring the Patterns of Professional Adaptation and Influential Factors of Novice Secondary Teachers 初任中学教师专业适应模式及影响因素探讨

Korean Society for Educational Evaluation Pub Date : 2023-06-30 DOI: 10.31158/jeev.2023.36.2.315

S. Jung, Unkyung No, Yeon-kyoung Woo

{"title":"Exploring the Patterns of Professional Adaptation and Influential Factors of Novice Secondary Teachers","authors":"S. Jung, Unkyung No, Yeon-kyoung Woo","doi":"10.31158/jeev.2023.36.2.315","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.2.315","url":null,"abstract":"This study was conducted to classify novice middle and high school teachers into subgroups based on their adaptation, and to verify individual and school-related factors influencing group classification. To this end, the study was conducted on 611 teachers with less than 5 years of teaching experience in middle and high schools using data from the 1st year of the Seoul Educational Longitudinal Study of Teacher. The results of the latent profile analysis, using functional aspects (curriculum, guidance and counseling, career guidance, classroom management, academic administration) and psychological aspects (passion/morale, burnout) as indicators, are as follows. The adaptation of new secondary school teachers was divided into 4 groups (‘High’ (9.1%), ‘High-Middle’ (28.1%), ‘Middle’ (42.0%), ‘Low’ (20.8%)) depending on the level of the indicators. As for the individual factors influencing the classification of new teachers’ professional adaptation, it was found that motivation for choosing the teaching profession (intrinsic motivation, altruistic motivation, and extrinsic motivation), sense of belonging, and non-regular teaching experience were significant. Among the school factors, the principal’s visionary leadership showed significance. Based on the results of this study, educational implications for the professional adaptation of novice teachers were proposed.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"128 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116320414","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

IRT Linking and Standard Errors of Linking Coefficients Under the Reparameterized Nominal Response Model 重参数化名义响应模型下的IRT连接及连接系数的标准误差

Korean Society for Educational Evaluation Pub Date : 2023-06-30 DOI: 10.31158/jeev.2023.36.2.255

S. Kim

{"title":"IRT Linking and Standard Errors of Linking Coefficients Under the Reparameterized Nominal Response Model","authors":"S. Kim","doi":"10.31158/jeev.2023.36.2.255","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.2.255","url":null,"abstract":"Under item response theory (IRT), common-item linking methods are used to develop a common ability scale between two test forms administered to examinee groups from different populations. The nominal response (NR) model, proposed first by Bock, was reparameterized by Thissen and his colleagues. This paper presents three types of IRT linking methods, the direct least squares (DLS), mean/least squares (MLS), and item category response function (ICRF) methods, for the reparameterized NR model and investigates their performance through computer simulations. The presentation assumes that the highest response categories are specified for all linking items. This paper also presents analytic formulas for computing the asymptotic standard errors (SEs) of linking coefficient estimates for the three methods. Important findings were obtained from a simulation study. Overall, the ICRF method outperformed the DLS and MLS methods in linking accuracy, and the DLS and MLS methods performed almost equally. The linking coefficients for the DLS and MLS methods should be estimated using item parameter estimates only for the highest response categories whereas those for the ICRF method should be estimated by the criterion function that is defined using all ICRFs across linking items. The analytic formulas for the asymptotic SEs worked properly for the three linking methods, and the SEs were, approximately, inversely proportional to the square root of the sample size.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125945122","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Application of growth model applying GAMM and PGM 应用GAMM和PGM的生长模型的应用

Korean Society for Educational Evaluation Pub Date : 2023-06-30 DOI: 10.31158/jeev.2023.36.2.229

H. Park, J. Ryoo

{"title":"Application of growth model applying GAMM and PGM","authors":"H. Park, J. Ryoo","doi":"10.31158/jeev.2023.36.2.229","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.2.229","url":null,"abstract":"Exploring a growth model in a longitudinal study is as important as verifying the effectiveness of variables related to growth. In this study, in identifying the growth model, the analysis was conducted using the generalized additive mixed model (GAMM) and the piecewise growth model (PGM) in longitudinal study. For empirical data, GAMM and PGM were used for identifying changes in students' academic achievement in mathematics through the Korean Education Longitudinal Study (KELS-2013) data. As a result, the exponent of the growth model function optimized in GAMM was calculated as 2.98, confirming that the growth model was most suitable for a cubic function. In addition, as a result of verifying the random effect by applying GAMM, a growth of 198.73 points was confirmed in the first year, the starting point of the survey, and it was confirmed that female students showed 2.97 points higher growth than male students in terms of growth in students' math achievement. On the other hand, as a result of applying PGM, the turning point appeared at 2.54, and it was confirmed that the greatest change was shown at the time of school grade change from elementary school to middle school. Such results as in this study show different approaches through GAMM and PGM to explore data-based growth models, and these results can be greatly expanded to analyze growth models such as data-based machine learning methods.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"132 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133540722","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Applying machine learning-based models to prevent University student dropouts 应用基于机器学习的模型来防止大学生辍学

Korean Society for Educational Evaluation Pub Date : 2023-06-30 DOI: 10.31158/jeev.2023.36.2.289

Jiyoung Mun, Meounggun Jo

引用次数: 0

Investigation of Influencing Factors on Elementary School Teachers’ Efficacy Using Random Forest 基于随机森林的小学教师效能感影响因素调查

Korean Society for Educational Evaluation Pub Date : 2023-03-30 DOI: 10.31158/jeev.2023.36.1.111

In-Hee Choi, Meereem Kim

{"title":"Investigation of Influencing Factors on Elementary School Teachers’ Efficacy Using Random Forest","authors":"In-Hee Choi, Meereem Kim","doi":"10.31158/jeev.2023.36.1.111","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.1.111","url":null,"abstract":"The purpose of this study is to identify the influencing factors on teacher efficacy using「Korean Teacher Longitudinal Study-Elementary School Teacher」data from a more comprehensive perspective by analyzing all available items, which is the strength of the random forest technique. The data from 2,794 elementary school teachers were used, and teacher efficacy, which is the response variable of this study, was divided into three sub-domains (instruction/assessment efficacy, student guidance/class management efficacy, and future education efficacy). A random forest regression was conducted for each sub-domain. The main results of this study are as follows. First, the influencing factor with the highest importance index in all teacher efficacy was job satisfaction. Second, among the top 25 factors (approximately 10% of the total explanatory variables), 15 items, which account for 60%, were commonly found to be major influencing factors in all teacher efficacy. Third, among the top 25 factors, there were 4 to 7 major influencing factors unique to each teacher efficacy, and these factors appeared to represent the unique characteristics of each teacher efficacy. Fourth, the variables that appeared to be mainly related to teacher efficacy were all individual teacher-level factors, and school-level factors did not appear. In this study, it was able to examine the relationship between individual teacher efficacy and influencing factors by dividing teacher efficacy into three sub-domains (instruction/assessment efficacy, student guidance/class management efficacy, and future education efficacy) due to the strength of data. Also, this study examined the relationship between teachers’ practical teaching/learning activities and teacher efficacy, which was difficult to examine in previous studies.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"99 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127164909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The effect of the construction of mixed anchor items on the test equating in mixed-format tests 在混合格式测试中，混合锚项目的结构对测试等价性的影响

Korean Society for Educational Evaluation Pub Date : 2023-03-30 DOI: 10.31158/jeev.2023.36.1.199

Sora Lee, Kyongah Sang, Tai-sun Jeong, Jun Sik Sim

{"title":"The effect of the construction of mixed anchor items on the test equating in mixed-format tests","authors":"Sora Lee, Kyongah Sang, Tai-sun Jeong, Jun Sik Sim","doi":"10.31158/jeev.2023.36.1.199","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.1.199","url":null,"abstract":"With the introduction of innovative items in the computer-based NAEA, the item format became diversified, and the current method of selecting anchor items from multiple-choice (MC) items became burdensome for test developers. The purpose of this study is to examine whether a mixed-format anchor items including both MC and constructed-response (CR) items could hold the stability of equating in the NAEA, and give desirable direction to expand the range of anchor items and to make test construct flexible. A simulation study was conducted based on a common-item non-equivalent group design with the test conditions of the Korean subject in the NAEA. The treatment conditions include (1) a type of anchor item set (a single MC or a mixed), (2) a composition type of mixed anchor item (MC:CR = 1:1, 3:2, or 3:4), (3) a length of mixed anchor items within a test (25%, 22%, or 19%), and (4) the presence of multidimensionality according to the item format were assumed. The main result is that there was no significant difference in the equating error between the single MC and the mixed anchor item condition. Specifically the equating error of the single MC was smaller than that of the mixed-format cases where the ratios between MC and CR were 1:1 and 3:2. In the 3:4-ratio mixed condition, the equating error was smaller than that of the single MC condition. A length of mixed anchor items within a test showed somewhat mixed results, probably because there was not much variation between the conditions in the composition ratio, about 20% in test. When there was multidimensionality according to the item format in the test, the equating error increased significantly with mixed anchor items compared to that of unidimensional test condition. In sum, about 20% of the mixed anchor items with slightly higher CR ratio was found to be suitable in the unidimensional test and caution was called for in using mixed anchor items in multidimensional test.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128625875","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Exploring predictors affecting quality control in higher education using AHP and Random forest 运用层次分析法和随机森林法探讨影响高等教育质量控制的预测因素

Korean Society for Educational Evaluation Pub Date : 2023-03-30 DOI: 10.31158/jeev.2023.36.1.53

S. Kim, Yoonjeong Lee

{"title":"Exploring predictors affecting quality control in higher education using AHP and Random forest","authors":"S. Kim, Yoonjeong Lee","doi":"10.31158/jeev.2023.36.1.53","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.1.53","url":null,"abstract":"The purpose of this study is to explore predictive factors that affect quality control in higher education using random forest and AHP based on Higher Education Information Disclosure discosure data. Three research questions were investigated: 1) What is AHP model derived from the analysis of previous studies and literature review? 2) What is relative weight of each variable calculated through AHP? 3) What is a predictive model of quality management in Higher Education derived through random forest? To answer these questions, this study conducted literature review, AHP survey, and random forest analyses. The results of this study showed that the input AHP model constructed 5 factors, 31 indicators and the output AHP model constructed 2 factors, 11 indicators. Secondly, the AHP analysis indicated that the most important input variables were ‘educational restitution rate’, ‘cost of education per student’, and ‘retention rate of full-time faculty’. and the output variables with the highest global importance were ‘employment rate’ and ‘recruitment rate’. Finally, the results of random forest based on the AHP results showed that all target variables, excluding ‘employment rates’, were influenced by the ‘amount of governments financial program’, ‘educational restitution rate’, and ‘cost of education per student’. ‘Employment rate’ was related to ‘percentage of industry full-time faculty’, ‘filed training curriculum’, and ‘percentage of full-time faculty’.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"423 2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121347753","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Exploring Differential Item Functioning in PISA 2015 Science Test with the Rasch-tree 用Rasch-tree探索PISA 2015科学测试中的差异项目功能

Korean Society for Educational Evaluation Pub Date : 2023-03-30 DOI: 10.31158/jeev.2023.36.1.83

Yoonsun Jang, Juyeon Lee

引用次数: 0

Validation of the Social and Emotional Competencies Questionnaire for Secondary School Students 中学生社交与情绪能力问卷的验证

Korean Society for Educational Evaluation Pub Date : 2023-03-30 DOI: 10.31158/jeev.2023.36.1.1

Soojin Kim, Eunju Jung, Mikyung Kim, Myoung Hwa Kim, Jong-Wook Park

{"title":"Validation of the Social and Emotional Competencies Questionnaire for Secondary School Students","authors":"Soojin Kim, Eunju Jung, Mikyung Kim, Myoung Hwa Kim, Jong-Wook Park","doi":"10.31158/jeev.2023.36.1.1","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.1.1","url":null,"abstract":"In this study, we wanted to conceptualize social and emotional competencies for secondary school students and develop tools for measuring social and emotional competencies. This reflects the need to develop social and emotional competencies along with cognitive achievement. Based on the various literature, three social competency constructs (community consciousness, collaboration, conflict resolution) and two emotional competency constructs (stress coping, resilience) were selected as social and emotional competency constructs, and scenario-based self-reporting questions were developed. Based on the developed items, the questionnaire was conducted to the middle and high school students and the goodness of the items was verified. A total of 36 items, including 21 items of social competence and 15 items of emotional competence, were confirmed as the final scenario-based self-reporting scale items. Based on the results of the study, the limitations of the study were put forward and a follow-up study was proposed. For the further study, the national level Social-Emotional index has to be developed to measure the students’ grouwth as a whole.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"176 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123196692","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Challenges in Establishing Causal Validity of Studies on Influencing Factors in Education 建立教育影响因素研究因果效度的挑战

Korean Society for Educational Evaluation Pub Date : 2023-03-30 DOI: 10.31158/jeev.2023.36.1.141

Yongnam Kim, Sangyun Lee, Naram Gwak

{"title":"Challenges in Establishing Causal Validity of Studies on Influencing Factors in Education","authors":"Yongnam Kim, Sangyun Lee, Naram Gwak","doi":"10.31158/jeev.2023.36.1.141","DOIUrl":"https://doi.org/10.31158/jeev.2023.36.1.141","url":null,"abstract":"One of the popular approaches to educational research is to investigate multiple influencing factors on an outcome of interest. Researchers ask, “Why do students drop out of school?” or “Why did the math score decrease?,” and try to find potential factors that lead to such consequences. The findings are then used to develop an appropriate policy to intervene to facilitate a desirable outcome or to inhibit an undesirable one. This approach belongs to a type of question referred to as “causes of effects,” which is contrasted to “effects of causes.” Interestingly, many causal inference researchers believe that the former is much more difficult to answer than the latter. However, the theoretical basis for such a belief has not been well discussed in the Korean educational research field despite the popularity of the approach. Using causal graphs, this article explains why the causal interpretation of the findings from many studies on influencing factors cannot be established with certainty. In fact, multiple regression coefficients from a single equation could have different interpretations, such as one as a direct effect and the other as a confounded noncausal association. It is emphasized that with the lack of knowledge of true data-generating process, it is almost impossible to correctly interpret statistical findings in terms of causal validity. The article concludes with a discussion of the importance of causal inference for educational research.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"111 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128280468","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0