{"title":"Analysis of students’ perceptions on the Freedom of Learning - Independent Campus (MBKM) program at Chemistry study program of Ma Chung University","authors":"Y. Yuniati, Lilis Lestari Wilujeng","doi":"10.21831/pep.v27i1.52961","DOIUrl":"https://doi.org/10.21831/pep.v27i1.52961","url":null,"abstract":"Considering that Indonesian education has gone through such a long journey from 1922 to 2022 now, it is necessary to have an educational program that is able to meet the demands of workers' needs in this era of globalization. In the end, the Directorate General of Higher Education, Research, and Technology designed an education policy system in the realm of higher education, namely \"Freedom of Learning - Independent Campus\", as an accurate strategy for optimizing academics in today's Indonesia. In this study, a survey was aimed at 40 undergraduate students of the Chemistry Study Program at Ma Chung University. Data analysis were made by quantitative approach of the nine questions succcessfully answered by students who filled out questionnaires in the online multiple choice questionnaire with a dependency test by nonparametric statistical methods. As a result, the majority of students of the Chemistry Study Program were quite enthusiastic about this new educational policy, although it was necessary to optimize all internal strategies of the study program curriculum, so that it could be in accordance with the activities designed in the \"Freedom of Learning - Independent Campus\" Program.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"23 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74784727","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Developing an instrument for measuring views on Muhammadiyah ideology","authors":"J. Subando, Muh Samsuri, Edy Muslimin","doi":"10.21831/pep.v27i1.62333","DOIUrl":"https://doi.org/10.21831/pep.v27i1.62333","url":null,"abstract":"This research aims at developing an instrument for measuring views on Muhammadiyah ideology that is valid and reliable. This study adapted Borg and Gall’s development model through initial research, planning, initial product development, limited testing, product revision, expanded testing, and product revision. The steps started with initial research to obtain the ideology construct of books related to Muhammadiyah. The ideology construct obtained was used as the basis to arrange instrument items which were then validated by five experts in the fields of measurement, Muhammadiyah ideology, practitioners, and Muhammadiyah cadres by filling the sheet of variable appropriateness with indicators and indicators appropriateness with the statements. The results of the experts’ validation were analyzed with the Aiken formula. The validated instrument was then tested limitedly in the Muhammadiyah regional leadership in Karanganyar, Sragen, and Boyolali, by involving 253 respondents. The result of the test was analyzed using factor analysis and SEM using the Lisrel program. The result of the research shows that the instrument for measuring the views on Muhammadiyah ideology consists of 26 items comprised of seven aspects of Muhammadiyah ideology measurement, including tauhid (two items), living in a social group (three items), Allah’s law (three items), Islamic doctrine (five items), the prophet’s ittiba’ (four items), organization (three items), and Muhammadiyah goals (six items). The instrument fulfills the validity criteria since it has a loading factor between 0.3-0.85(0.3) and CR 0.92 (0.7). The instrument is reliable since Cronbach’s Alpha is 0.8690.7. Since it is valid and reliable, then it is suitable to be used to measure the views on Muhammadiyah ideology in Indonesia.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"42 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77737810","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An analysis of interaction patterns in students’ research essay guidance to build six main parameters of the Indonesian National Qualification Framework: Covid-19 pandemic period","authors":"U. Rosidin, M. Setyarini, Widyastuti Widyastuti","doi":"10.21831/pep.v27i1.52867","DOIUrl":"https://doi.org/10.21831/pep.v27i1.52867","url":null,"abstract":"This study aims to reveal the interaction patterns and inhibiting factors for the final project guidance in the Mathematics and Natural Sciences Education Department, Universitas Lampung, to develop the six main parameters of the Indonesian National Qualifications Framework (INQF). The study employed a mixed method involving 67 students who composed the final project for the 2021/2022 academic year selected from 314 final project students using the cluster random sampling technique. The data in this study were primary and secondary data obtained by questionnaires, interviews, and documents, analyzed qualitatively, quantitatively, and descriptively. The closed-response questionnaire was used regarding the interaction pattern, the INQF parameters achievement, and perceptions of the achievement of students' core competencies. An open-response questionnaire regarding the inhibiting factors for the final project guidance was used to provide the qualitative data. Descriptive analysis was conducted to determine the profile and interaction pattern of the final project guidance, while the qualitative analysis using Miles and Huberman model was to reveal the inhibiting factors of the final project. The results show that: (1) the dominant interaction pattern that occurred was an associative pattern originating from the factors of suggestion, identification, and sympathy; (2) the INQF parameter with the best score is the science parameter with an average parameter achievement of 9.97 from the lowest score 3.00 until the highest score 12.38; and (3) the perception of achieving the highest core competency of students is the aspect of soft skills, both personal and interpersonal, with the highest average perception of achieving core competency being 59.71 out of 80.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"39 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76592262","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Instrument and evaluation of students’ involvement in learning Mathematics in 21-century skills at senior high schools of Riau province","authors":"D. Andrian, L. Effendi","doi":"10.21831/pep.v27i1.58176","DOIUrl":"https://doi.org/10.21831/pep.v27i1.58176","url":null,"abstract":"Student engagement is the most crucial factor in learning activities because it is the main factor in improving student learning outcomes in class. This study aims to develop instruments and evaluate student involvement in learning mathematics to achieve maximum learning outcomes at school. The population in this study was all high school students in Riau Province. The sample is 150 high school students selected by multiple-stage random sampling based on high, medium, and low student achievement levels. Data analysis in this study was carried out four times: (1) data analysis based on the results of expert assessment of the instrument with the Aiken formula; (2) small-scale validity data analysis with first-order CFA; (3) large-scale data analysis with second-order CFA analysis; (4) descriptive analysis to see the categorization of student learning engagement in Riau Province whether in very good, good, not good and very not good. The analysis using the Aiken formula shows that 24 out of 27 items developed are valid. The first-order CFA analysis shows that the 24 items distributed are valid. The second-order analysis shows that the construct validity of the learning involvement variable is valid and reliable. The analysis of learning involvement results shows that students' involvement in learning mathematics is in the not-good category. The Riau provincial government needs to maximize student learning engagement which can be done by regulating students' effective study hours at school and home. Collaboration between parents and schools must be improved so parents can control student learning outside of school.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"53 1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77310739","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
E. Istiyono, W. S. B. Dwandaru, Made Rai Shanti Ayub, D. Saepuzaman, Rizki Zakwandi, Anisyah Rachman, Eri Yusron, P. H. Santoso
{"title":"A study of the readiness of post-pandemic computer-based four-tier diagnostic test (CBFTDT): A review of economic level, school grades, and device accessibility","authors":"E. Istiyono, W. S. B. Dwandaru, Made Rai Shanti Ayub, D. Saepuzaman, Rizki Zakwandi, Anisyah Rachman, Eri Yusron, P. H. Santoso","doi":"10.21831/pep.v27i1.56005","DOIUrl":"https://doi.org/10.21831/pep.v27i1.56005","url":null,"abstract":"Student readiness for using computer-based assessment was affected by economic level, school grade, and device accessibility. This study analyzed student readiness using a computer-based assessment, the four-tier diagnostic test (CBFTDT). The data in this study were students' responses to a questionnaire consisting of 16 statements about three aspects: mental access, skill access, and usage. The questionnaire consists of 16 statements with three aspects: items, media, and effectivity. The questionnaire was proved valid by experts and its estimated reliability score was 0.99. This study proved that the Student is still not ready to use the computer-based assessment, with an average readiness of 60%. In addition, there is no effect of economic level, school grade, and device accessibility on the readiness for using the computer-based assessment. Hence, the treatment of all stockholders is needed to prepare students to use the computer-based assessment.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"24 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84757760","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The effectiveness of item parceling to increase the model fit: A case study of PAPs","authors":"Anindita Dwi Hapsari, Wahyu Widhiarso","doi":"10.21831/pep.v27i1.49012","DOIUrl":"https://doi.org/10.21831/pep.v27i1.49012","url":null,"abstract":"The impact of item parceling to improve model fit indexes in confirmatory factor analysis has been on debate amongst psychometricians. In this study, the effectiveness of item parceling was examined using Tes Potensi Akademik Pascasarjana (PAPS) or Postgraduate Academic Potential Test in Universitas Gadjah Mada. Item parceling approach, second-order approach, and item-based approach of confirmatory factor analysis (CFA) were used for examination. Data were collected from a sample of 1374 postgraduate candidates in 2017. The result found that model fit indices such as the chi-squared test, comparative fit index, Tucker-Lewis index, and standardized root mean square residual were improved in the item parceling approach when compared to item based approach. Interestingly, the root mean square error of approximation were deteriorating in the item parceling approach. The finding of this study suggested that model dimensionality and sample size should be carefully considered when using the item parceling approach.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"46 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87817669","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Dewi Nurulhasni, Eka Ayu Nurbaiti, Rosa Safirotun Nabila, J. Jumadi
{"title":"Developing and implementing an instrument for assessing critical thinking and visual representations in learning Physics materials of Optical Instruments","authors":"Dewi Nurulhasni, Eka Ayu Nurbaiti, Rosa Safirotun Nabila, J. Jumadi","doi":"10.21831/pep.v27i1.53550","DOIUrl":"https://doi.org/10.21831/pep.v27i1.53550","url":null,"abstract":"This study aims to develop an assessment instrument to measure students' critical thinking and visual representation abilities in optical instrument material. This research and development (RD) employed the ADDIE (Analysis, Design, Development, Implementation, and Evaluation) instructional model. This research develops a test instrument that has more specific stages so the ADDIE development stage is integrated with the development stage of the test instrument developed by Mardapi. The subjects in this study are grade XI students of State Madrasah Aliyah (MAN) 4 Bantul. This study produced a test instrument for measuring students' critical thinking and visual representation abilities, with high validity,and analyzed using Aiken's V. The items for assessing critical thinking and visual representation abilities were analyzed using the QUEST program with the following findings. (1) The analysis results of instrument validation using Aiken's V obtained an average Aiken's Value above 0.4 with high validity and moderate validity criteria so all items are valid. (2) The pre-test analysis on item estimates obtained MNSQ Infit in the range 0.77-1.30 and the value of outfit t ≤ 2 and in the MNSQ Infit case estimates in the range 0.77-1.30, so overall, the items matched to Rasch models. (3) Post-test analysis on item estimates obtained MNSQ Infit in the range 0.77-1.30 and outfit t value ≤ 2 and in case estimates MNSQ Infit in the range 0.77-1.30 so, overall, items are in accordance with Rasch models. (4) The reliability of the pre-test items is 0.92 while the reliability of the post-test items is 0.76. (5) The difficulty level of the items in the pre-test results shows that Question 10 is the most difficult while number 3 is the easiest, and in the post-test results, Question 8 is the most difficult while Question 6 is the easiest.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"10 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90198629","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A meta-analysis of the relationship between self-assessment and Mathematics learning achievement","authors":"Fransidha Sidhara Hadi, Janu Arlinwibowo, Gupita Nadindra Fatima","doi":"10.21831/pep.v27i1.60617","DOIUrl":"https://doi.org/10.21831/pep.v27i1.60617","url":null,"abstract":"This study uses a meta-analysis model to describe the relationship between self-assessment and achievement in learning mathematics. This meta-analysis covers articles published from 2011 to 2022 and is restricted to studies published in English. Indexed articles by Google Scholar were chosen. The data must meet these criteria: quantitative research, containing correlational research on the relationship between self-assessment and mathematics learning achievement (including correlation values and sample size). Through the data screening process with predetermined criteria, 12 research results were obtained, containing 43 studies to be analyzed. This meta-analysis uses a random effect model due to the heterogeneous data distribution. A publication bias test was carried out with the Fail-safe N model to ensure the quality of the data. The result of the analysis showed that the data distribution was heterogeneous, according to the I2 test, so selecting the random effect model was the right decision. Regarding publication bias, an accurate Fail-safe N test shows that the data are free from publication bias. Thus, the analysis uses a suitable model, and the results of the analysis can be trusted. The total effect size indicates a significant positive correlation (r = 0.295) between self-assessment and students' mathematics achievement. Therefore, the higher the self-assessment index, the higher one's mathematics learning achievement.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"54 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136301263","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Item quality analysis using the Rasch model to measure critical thinking ability in the material of the human digestive system of Biology subject in high school","authors":"Wanda Agus Prasetya, Anggi Tias Pratama","doi":"10.21831/pep.v27i1.58873","DOIUrl":"https://doi.org/10.21831/pep.v27i1.58873","url":null,"abstract":"This study aims to determine the quality of the Biology instrument items on the digestive system material with the Rasch model for analyzing critical thinking skills. The research employed a quantitative descriptive method involving 63 students of senior high schools in Yogyakarta. The data were collected using a critical thinking skills description test and processed using the Rasch model with the Winstep 5.0.3.4 program. The study shows that the overall validity is acceptable. The item validity did not require improvement in items 14, 3, 8, 13, 12, 1, 4, 10, 6, 2, 7, 11, 15, and 9, and required improvement or replaced of item 5 because it did not fit. The analysis result using Cronbach's alpha shows that the overall reliability is very good, and the item reliability is good. Rating scale analysis using partial credit ratings and probability curves shows that respondents need help understanding the five-point Likert scale. The analysis of the item difficulty based on Logit and Wright maps shows that the most difficult item to work on is item 14. Items with moderate categories are items 13, 12, 1, 4, 10, 6, 2, 5, and 7. Items easy to work on are items 11, 15, and 9. The bias results show item 14 gender-biased. The results of the interaction between the item and the person through the ICC plot image show that all items are on the curve of the outfit confidence space and follow the Rasch modeling.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"196 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73114745","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Measuring students' generic skills through national assessment","authors":"Toha Makhshun, Bassam Abul A'la, Kusaeri Kusaeri","doi":"10.21831/pep.v27i1.52205","DOIUrl":"https://doi.org/10.21831/pep.v27i1.52205","url":null,"abstract":"This study aims to measure the generic skills (GS) of Madrasah Aliyah (MA) students in Indonesia. Respondents who participated in this study were madrasah students scattered in East Java and Central Java as representatives of MAs in Indonesia. The method used in this research is a survey distributed via Google Form. Three dimensions are mentioned in the research instrument for measuring GS: religious moderation, critical and creative thinking skills, and interpersonal skills. Using SPPS version 16 software, a descriptive analysis was employed as the data analysis technique. The results of this study showed that the GS of students with religious moderation indicators obtained the highest average of 54.03% on the Likert scale 4. Critical and creative thinking skills indicators obtained the highest average results, 67.99%, on the Likert scale 4. The indicator of interpersonal skill obtained the highest average of 55.88% on the Likert 4 scale. Hence, it is expected of educational institutions to implement policies to enhance the GS of MA students, particularly in creating a more student-oriented learning model, also known as student-centered learning.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"95 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75108857","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}