{"title":"Latent Profile Patterns of Affective Attitudes in Math and Science and Their Influential Factors for Elementary and Middle School Students in TIMSS 2019","authors":"Minhee Seo, Kyunghee Kim, Bitna Lee","doi":"10.31158/jeev.2022.35.2.247","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.2.247","url":null,"abstract":"According to the results of the international academic achievement assessment and previous studies, it is continuously reported that Korean students have high cognitive achievement but very low affective achievement. The purpose of this study is to explore the characteristics of the affective attitudes in math and science and to provide the implications for the improvement of students’ affective attitudes. To this end, multilevel latent profile analysis based on the 3-step method was used. We explored the latent profiles of the affective attitudes in math and science and their influential factors. We used data from 3,886 elementary school students(151 schools) and 3,857 middle school students(168 schools) who participated in TIMSS 2019. The results are as follows. First, for 4th graders, five latent profiles such as ‘negative(3.7%)’, ‘moderate(61.3%)’, ‘math positive(9.8%)’, ‘science positive(17.4%)’, and ‘very positive(7.8%)’ groups were derived. On the other hand, for 8th graders, the negative characteristics of each subject appeared(math negative(5.5.%), science negative(6.2%), moderate(72.2%), positive(11.3%), very positive(4.3%)). Second, in both grades, it was found that ‘sense of school belonging’, ‘instructional clarity’, and ‘solving math problems on your own’ were more related to the positive groups rather than the other groups. Third, for 4th graders, regional scale had an effect on the group classification. Lastly, educational implications for improving the affective attitude in math and science were proposed. \u0000","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126535852","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Comparison of Item Selection Methods Using Response Times in Computerized Adaptive Testing","authors":"Yunxing Kang, Guemin Lee","doi":"10.31158/jeev.2022.35.2.273","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.2.273","url":null,"abstract":"This study aimed to investigate the performance of item selection methods using response times (RT) in terms of the correlations between ability and test speededness and test lengths for computerized adaptive testing with fixed test time. MI, which does not use RT information, seems to estimate the ability parameters more accurately under a lenient time limit and a zero correlation between ability and test speededness condition. However, for MIT, which incorporates RT information in estimation and item selection procedures, the accuracy of ability estimates can be improved compared to MI and MITS as the correlation between ability and test speededness increases and the test length decreases. When item exposure control was applied, the measurement precision would be decreased. Compared to MI, MIT yielded a higher proportion of the number of items for a given test length. With relaxed limits in testing time, the effects of item exposure control on test efficiency would be decreased. Item selection with item exposure control can enhance item pool usage. After applying item exposure control, no significant differences could be expected in the item pool usage.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128861691","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Fitting SEMtree and SEMforest into longitudinal data of ECLS-K:2011","authors":"Yeong Jin Jo, Hye Rim Noh, J. Ryoo","doi":"10.31158/jeev.2022.35.2.299","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.2.299","url":null,"abstract":"<jats:p />","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124411842","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A case study of estimating a causal effect using machine learning with Bayesian Additive Regression Trees","authors":"Hyekyung Jung","doi":"10.31158/jeev.2022.35.2.355","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.2.355","url":null,"abstract":"The study aims to introduce a causal inference method using machine learning to general education researchers, and in particular, focus on the theory and practice of Bayesian Additive Regression Trees algorithm. To analyze the empirical data, public data from the Korean Children and Youth Panel Survey 2018 were used. For an illustrative purpose, this study estimated the causal effect of participation in activities related to self (personality) development on students’ life satisfaction and self-esteem and discussed the feasibility of the BART method in educational impact studies. The applicability of the BART-based machine learning causal inference technique in the field of education was discussed in comparison with model-based propensity score and causal effect estimation. Finally future research topics and limitations of the study were addressed.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131451881","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Exploring Variables Explaining Middle School Students’ Academic Achievement Using Mixed-effect Random Forest: Based on NAEA Results","authors":"Hyewon Chung, Arum Kim, Yeheun Baek","doi":"10.31158/jeev.2022.35.1.107","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.1.107","url":null,"abstract":"","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"113 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115547812","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Exploring the applicability of multistage testing in NAEA","authors":"Junga Han, K. T. Han, Minhee Seo","doi":"10.31158/jeev.2022.35.1.49","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.1.49","url":null,"abstract":"","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128365813","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Intergrated Interpretation of Network Analysis and Topic Modeling in Text-mining - Focusing on College Competency-based Education -","authors":"Seo-jin Lee, Kyung-Seok Min","doi":"10.31158/jeev.2022.35.1.165","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.1.165","url":null,"abstract":"","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128560358","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Impacts of DIF on Ability Estimation in CAT","authors":"Min-Ja Seo","doi":"10.31158/jeev.2022.35.1.1","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.1.1","url":null,"abstract":"","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133496993","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Exploring the patterns and degrees of extreme response styles of TIMSS 2019 data using the IRTree model","authors":"Yeong Jin Jo, H. Yi","doi":"10.31158/jeev.2022.35.1.189","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.1.189","url":null,"abstract":"","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124342416","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Wording Effects in Psychological Longitudinal Measurement: An Exploration of Change and Stability","authors":"Jae-uk Kim, Wonsook Sohn","doi":"10.31158/jeev.2022.35.1.137","DOIUrl":"https://doi.org/10.31158/jeev.2022.35.1.137","url":null,"abstract":"","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116662516","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}