{"title":"An evaluation of the effectiveness of the English Upgrading program for TOEFL in an Indonesian university using the CIPP model","authors":"Labibatussolihah Labibatussolihah, N. Adriani","doi":"10.21831/pep.v26i2.48728","DOIUrl":"https://doi.org/10.21831/pep.v26i2.48728","url":null,"abstract":"Human resources capacity building is a vital part of institutional development, especially in the educational field, such as the university. As an academic language, English skills are highly needed among lecturers to improve the quality of institutions in general. What is the effectiveness of an English preparation course for lecturers in an Indonesian university during the pandemic time? Using Stufflebeam’s CIPP model, this study aims to measure the quality and make recommendations on what should be improved or changed from such activity. There were 25 participants, two tutors, and one program coordinator involved as an informant. An online questionnaire was administered, as well as an in-depth interview with the tutors, coordinator, and selected participants. The results show that (1) the context is suitable to the condition, resources, and needs of the institution as well as participants. (2) In the Input section, the curriculum and variations in learning methods need to be further developed. (3) In the process section, the obstacles faced were the lecturer’s workload, which should be adjusted during the course to make them focus on the program. (4) In the product section, a high level of satisfaction was found among the participants, with an overall positive review of its merit. There is still room for improvement. One of them is to follow up on participants’ progress after the program is ended. An evaluation sheet or survey should be administered after the program is finished to assess the quality of the tutors and participants’ satisfaction with the training.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"70 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86255942","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Muh. Farozin, B. Astuti, S. Sanyata, Dwitias Titi, Ela Nurmalasari, N. Sutanti
{"title":"Rasch model for the need assessment instrument of academic guidance and counseling program in junior high school","authors":"Muh. Farozin, B. Astuti, S. Sanyata, Dwitias Titi, Ela Nurmalasari, N. Sutanti","doi":"10.21831/pep.v26i2.51816","DOIUrl":"https://doi.org/10.21831/pep.v26i2.51816","url":null,"abstract":"Developing an instrument for the need for academic guidance and counseling topics is a strategic step to support the needs assessment carried out by guidance and counseling teachers and counselors in schools. The development of this instrument had been carried out by Arfalah using exploratory factor analysis. This study aims to analyze the instrument using the Rasch model. The research procedure began with collecting data from two integrated online needs assessments of academic guidance and counseling instruments. The content validity test involved six experts, and the field test involved 111 students from three junior high schools in Yogyakarta. Data were analyzed using Winsteps version 3.73 according to Fisher’s five criteria for a good instrument. The content validity test showed Aiken’s coefficient of 0.71, considered in the high category. Meanwhile, the results of the Rasch test showed the item response model. The analysis also indicated high reliability on both instruments above 0.90 and Cronbach’s alpha value of 0.98. Five items were decided to be maintained based on the misfit test explored. The accuracy and focus of the instruments in revealing the need for academic guidance and counseling topics for high school students indicated a number above 40% and a fairly good level of instrument contamination, which was below 10%.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"59 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87054028","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
E. Ernawati, Fatkul Yudhistira Manik, Ratna Dwi Trisnawati, Emiliana Emiliana, Sri Yuliawati
{"title":"Understanding and quality of minimum competency assessment (AKM) questions made by Integrated Science teachers in junior high schools","authors":"E. Ernawati, Fatkul Yudhistira Manik, Ratna Dwi Trisnawati, Emiliana Emiliana, Sri Yuliawati","doi":"10.21831/pep.v26i2.48670","DOIUrl":"https://doi.org/10.21831/pep.v26i2.48670","url":null,"abstract":"The main problem with implementing the minimum competency assessment (Asesmen Kompetensi Minimum or AKM) is the teacher's lack of understanding of AKM. The assessment questions made by the teacher are still limited to testing memory. The level of variation and difficulty of the questions presented is also still low (LOTS), contrary to the government's expectation to improve the quality of learning outcomes which are oriented toward students' higher-order thinking stages (HOTS). This research employed a mixed method. An overview of the teacher's understanding was obtained through questionnaires and interviews, while the description of the quality of the AKM of Integrated Science items made by the teacher was analyzed using the item quality rubric based on Bloom's taxonomy. The data source was obtained from 25 Integrated Science teachers for class VIII of junior high school in Bekasi City. The data were collected through three stages. The first stage employed the Google Form survey to see the demographic map of informants and teachers' initial understanding of AKM. In the second stage, five informants were selected from the results of the survey, representing the data source's characteristics. Then, in the third stage, literature analysis was done to develop rubric criteria for assessing the quality of AKM items. This rubric was used by the research team to assess the quality of AKM items made by an Integrated Science teacher at a junior high school in Bekasi City. Questions that meet the criteria for good questions were collected and entered into the AKM question bank.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"8 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89401742","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Eko Wahyunanto Prihono, H. Retnawati, Fitria Lapele, Wisnu Budi Waluyo
{"title":"The quality of Indonesian teachers in the digital era: A meta-analysis","authors":"Eko Wahyunanto Prihono, H. Retnawati, Fitria Lapele, Wisnu Budi Waluyo","doi":"10.21831/pep.v26i2.52318","DOIUrl":"https://doi.org/10.21831/pep.v26i2.52318","url":null,"abstract":"The objective of the study is to determine the influence of determinant factors on teacher quality in Indonesia in the digital era in kindergarten, elementary, junior high, and high school units. It was a quantitative research with a correlation meta-analysis approach. The data was secondary data collected from various research results in Indonesia on the scholar.google.com page. The results of the study were published from 2012 to 2022. Data analysis used JASP software to estimate aggregates, draw plot Forrest, and publication bias. The aggregates were estimated through correlation scores with fixed effect models. The results showed that the funnel plot 104 study had a sample size that varied with the asymmetric distribution. Therefore, the results of the study were free from potential publication bias. It was reinforced by the forest plot display using the Trim and Fill method as well as the summary effect display results. Thus, the level of information validity based on the fixed-effect model of factors that affect the quality of teachers in the digital era in Indonesia was valid.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"13 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72393188","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Evaluation of the implementation of the Teaching Campus program in elementary school: A phenomenological approach","authors":"F. Indriani, Holisah Holisah","doi":"10.21831/pep.v26i2.46834","DOIUrl":"https://doi.org/10.21831/pep.v26i2.46834","url":null,"abstract":"This study aims to evaluate the implementation of the teaching campus program using an evaluation model from Stufflebeam consisting of Context, Input, Process, and Product (CIPP). The research used a qualitative method with a phenomenological approach. Data were collected by interview, observation, and documentation techniques. The data validity was done by triangulation of styles and sources. Miles and Huberman's techniques were used in data analysis: data collection, data reduction, data presentation, and conclusion. The informants include principals, teachers, students, and students as implementers of the Teaching Campus program. The results show that the implementation of the teaching campus program in elementary schools has been carried out properly in the aspects of CIPP and has a positive impact on the quality of education, especially on the program targets, namely numeracy, literacy, technology, and administration. The program's success is inseparable from various supports such as competent human resources (students and supervisors), the openness of the head of the local education office, and the cooperative school. The inhibiting factors include a lack of socialization about the program in the school, so there is a misunderstanding in giving assignments to students. On the other hand, the Teaching Campus program often accounts for errors, so the reporting of activities is not smooth, and students are often late filling out the log book because they are busy with lectures. The organizers can consider the results of this study to improve the quality of the implementation of the teaching campus program to run optimally.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"41 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72597271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Evaluation of Teacher Professional Training (TPT) program in the position of full online learning","authors":"Ummu Salamah, E. Istiyono","doi":"10.21831/pep.v26i2.43978","DOIUrl":"https://doi.org/10.21831/pep.v26i2.43978","url":null,"abstract":"The purpose of this study is to evaluate the Teacher Professional Training program (TPT) in first force Makassar State University (UNM) in a science study program in fully online learning. This research is an evaluation research with the CIPP model from Stufflebeam. The data were collected using a questionnaire-based survey method with descriptive statistical analysis. The instrument was distributed via google form to TPT students in positions. The conclusions of the research results are as follows: (1) The context aspect shows that the TPT program helps develop teacher professionalism (2) The input aspect shows that the Educational Personnel Education Institute organizers have good quality in implementing the TPT program (3) The process aspect shows that there is a relevance between the knowledge test material and the performance test on the educational competence and professionalism of teachers. (4) The product aspect shows that the TPT program affects changes in teacher teaching methods even though it is carried out entirely online.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"94 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88123114","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kamid Kamid, D. A. Kurniawan*, Adriyan Ardi Rahman
{"title":"A comparative study: Students' process skills and students' analytical thinking with learning models","authors":"Kamid Kamid, D. A. Kurniawan*, Adriyan Ardi Rahman","doi":"10.21831/pep.v26i2.53326","DOIUrl":"https://doi.org/10.21831/pep.v26i2.53326","url":null,"abstract":"The purpose of this study was to find out a comparison of students' process skills with students' analytical thinking with the learning model at Batang Hari Middle School on student perceptions to determine the relationship of learning models to students' analytical thinking skills in Mathematics and to find out the relationship between learning models and process skills. The method used in this study is a quantitative method with a comparative type. The results of the description test can be concluded that one SMP in Batang Hari is superior to the others. Based on the results of the t-test, it can be concluded that there is a comparison between the thinking and processing skills of students using the STAD learning model. The correlation test results show a relationship between the learning model and the process skills and analytical thinking of Batang Hari Junior High School students.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"44 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72979917","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multiple Intelligence-based basketball performance assessment in high school","authors":"N. Huda, Yustinus Sukarmin, D. Dimyati","doi":"10.21831/pep.v26i2.54981","DOIUrl":"https://doi.org/10.21831/pep.v26i2.54981","url":null,"abstract":"This study aims to develop performance assessment instruments in the MI (Multiple Intelligences) based basketball game by: (1) proving the validity of the content of the instrument, (2) proving the validity of the instrument construct, (3) conducting a model fit analysis and item fit with IRT (Item Response Theory), and (4) analyzing the effectiveness of the developed instrument product. Methods in developing assessment models using IDDIE (analysis, design, development, implementation, and evaluation). The research subjects used were 1053 students in five schools in five districts in Yogyakarta Province. The development of a scoring model resulted in (1) the validity of the contents of the five raters using the V-Aiken method yielding a value of 0.92; (2) the validity of the performance instrument construct shows 28 aspects of the warning with a loading factor of 0.3; (3) the fit model for this instrument matches the ability of the learner between -4.817 to 2.24; (4) the effectiveness of the product showed a high value, i.e., 38% of users felt \"very satisfied,\" 56% of users felt \"satisfied,\" and 6% of users felt \"dissatisfied.\"","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"13 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78409257","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Does the policy regarding the role of the national examination in determining graduation affect student achievement?","authors":"R. Rasmuin","doi":"10.21831/pep.v26i2.54422","DOIUrl":"https://doi.org/10.21831/pep.v26i2.54422","url":null,"abstract":"From 2004 to 2018, the national examination (NE) has undergone three policy changes regarding its role in determining graduation. The NE score was decided to be the sole determining factor for student graduation in the period 2004 to 2010, with the school examination score being the determinant of student graduation from 2011 to 2015 and no longer a determinant of student graduation from 2016 to 2018 period. This study aimed to analyze the pattern of influence of the NE policy as a determinant of graduation on student achievement at junior, senior, and vocational high schools. This study used data on student achievement for 15 years in the subjects tested on the NE obtained from the Research and Development Center of the Indonesian Ministry of National Education. Data analysis was done descriptively by estimating students' mean achievement on the NE and then analyzing the mean trend. By analyzing the trend of student scores' mean on the subjects tested on the NE at the junior high school, senior high school, and vocational high school levels, the mean tends to increase in the period 2004 to 2010, tends to be less stable and decrease in the period 2011 to 2015, and tends to decline again when the NE score is no longer used as a determinant of graduation in the period 2016 to 2018. These results indicate that the policy on using NE scores in determining graduation influences student achievement in junior high school, senior high school, and vocational high school levels.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"7 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83514883","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fredrik Abia Kande, Jollyanes P. Ledo, June Jacob, A. D. Rupidara, Eltina Maromon
{"title":"The implementation of education in GMIT elementary schools in Timor: A study of CIPP model evaluation","authors":"Fredrik Abia Kande, Jollyanes P. Ledo, June Jacob, A. D. Rupidara, Eltina Maromon","doi":"10.21831/pep.v26i2.53958","DOIUrl":"https://doi.org/10.21831/pep.v26i2.53958","url":null,"abstract":"Artikel ini bertujuan untuk mengevaluasi kualitas penyelenggaraan pendidikan pada SD GMIT di daratan Timor. Metode yang digunakan adalah metode evaluasi dengan model evaluasi CIPP model, Stufflebeam, at. al. Sampel penelitian yakni Kepala SD GMIT di daratan Timor sebanyak 173 orang. Pengumpulan data dilakukan dengan menggunakan angket. Hasil yang diperoleh yakni, kualitas penyelenggaraan pendidikan pada SD GMIT adalah dalam ketegori cukup, mencakup aspek konteks dalam kategori cukup, aspek input dalam kategori cukup, aspek proses dalam kategori baik, dan aspek output dalam kategori baik. Faktor yang pendukung yakni perhatian dari pemerintah, gereja, dan Yapenkris dengan bobot yang bervariasi, adanya komitmen dari para guru yang memahami tugasnya sebagai bagian dari pelayanan. Faktor penghambat berkaitan dengan masih minimnya peran Yapenkris dan jemaat-jemaat GMIT, minimnya kesejahteraan para guru, dan ketiadaan model tata kelola sekolah-sekolah yang bernaung di bawah GMIT. ","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"229 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78445533","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}