Jurnal Pengukuran Psikologi dan Pendidikan Indonesia最新文献

{"title":"Rasch Analysis of The Indonesian Version of Individual Work Performance Questionnaire (IWPQ)","authors":"Weepy Grace Dwiliesanti, Ananta Yudiarso","doi":"10.15408/jp3i.v11i2.24157","DOIUrl":"https://doi.org/10.15408/jp3i.v11i2.24157","url":null,"abstract":"The Individual Work Performance Questionnaire was developed by Koopmans et al. (2013). This questionnaire was based on the construct of individual work performance which consists of task performance, contextual performance, and counterproductive work behavior. Widyastuti & Hidayat (2018) adapted the IWPQ into Bahasa Indonesia. The mentioned research used the classical test theory (CTT) approach to validate the instrument. Therefore, the findings were only applicable to the study’s sample, as validity and reliability could not be legitimately generalized to other study settings. In comparison, the development of the original IWPQ used Rasch analysis to examine its measurement properties. Rasch analysis is a modern psychometric approach based on item response theory (IRT), which has several advantages over the CTT. This study aimed to validate the psychometric properties of the Indonesian Version of IWPQ using the Rasch model. The psychometric properties discussed in this study include instrument reliability, person and item reliability, unidimensionality, rating scale functioning, and bias detection (Differential Item Functioning). The 213 participants in this research survey were Indonesian citizens aged 18-46 years old (mean = 30.64, SD = 8.55) and were actively working for at least three months at their current job. The result showed that the assumption of the unidimensionality of each sub-scale of IWPQ was fulfilled. The 5-Likert rating scales of this instrument had adequate functionality. The person reliability for all sub-scales ranged from .58 - .80. Meanwhile, the item reliability ranged from .90 - .97. The separations were considered high with a value ranging from 3.04 – 5.77. All items in this instrument functioned well to measure individual work performance except for one item in sub-scale Contextual Performance. This specific item should be revised to achieve a more accurate measurement of the construct. There was one item that was considered biased toward gender in sub-scale Contextual Performance. Also, there was one item that was considered biased toward tenure in sub-scale Counterproductive Work Behavior. These findings had implications for using the Indonesian Version of IWPQ to assess employees’ individual work performance and recommendations for future research.","PeriodicalId":34093,"journal":{"name":"Jurnal Pengukuran Psikologi dan Pendidikan Indonesia","volume":"10 17","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72397333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Psychometric Characteristics of the Culture Fair Intelligence Test Scale 2","authors":"Novina Sabila Zahra, W. Widyastuti, Ahmad Ridfah","doi":"10.15408/jp3i.v11i2.25947","DOIUrl":"https://doi.org/10.15408/jp3i.v11i2.25947","url":null,"abstract":"This study aims to investigate the psychometric characteristics of the CFIT-scale-2, including investigation of difficulty level, discrimination, distractor effectiveness, DIF (Differential item functioning), IRT (Item Response Theory) 2PL model, validity, and reliability. Respondents were 507 students with 245 (48%) females and 262 (52%) males, with ages ranged from 8-13 years (M= 10.88; SD = 1.35). The classical test theory (CTT) analysis showed that the item difficulty level on the CFIT-scale-2 had varying item difficulty levels, from easy to difficult. However, the test arrangement was not structured according to the suggested difficulty level from easy to medium to difficult. The discrimination of items was poor because 28 items were not included in the very good category (p > .40). In addition, 47 (25%) of the 184 distractors are ineffective. CFIT-scale-2 did not contain DIF (Adj.p > .05), and IRT analysis showed that the CFIT-scale-2 was not structured according to the difficulty pattern from easy, medium, and difficult. The CFIT-scale-2 based on IRT analysis contained 44 items or 96% with good discrimination. The results of a construct validity test using the CFA technique showed a good fit model (p < .001; RMSEA < .08; SRMR < .08), which was acceptable and supported the fit between the theoretical and empirical model. The reliability coefficient value of Cronbach's alpha was 0.88 (α > .70), indicating that the CFIT-scale-2 had good reliability, but the construct reliability was below an acceptable value (CR < .69). According to this study, the psychometric characteristics of the CFIT-scale-2 should be revised and reevaluated.","PeriodicalId":34093,"journal":{"name":"Jurnal Pengukuran Psikologi dan Pendidikan Indonesia","volume":"08 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85980767","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The Impact of Z-Score Transformation Scaling on the Validity, Reliability, and Measurement Error of Instrument SATS-36","authors":"Sumin Sumin","doi":"10.15408/jp3i.v11i2.26591","DOIUrl":"https://doi.org/10.15408/jp3i.v11i2.26591","url":null,"abstract":"The Likert scale is a psychometric scale commonly used for response measurement. This measurement scale includes techniques for designing and administering surveys as well as coding and analyzing data. However, Likert scaling has various limitations that can affect the resulting data. This study aims to reprove the number of dimensions of the SATS-36 instrument, prove the validity, and estimate the reliability of the statistical attitude instrument (SATS-36) on students at religious universities in Indonesia using Z-Score Transformation Scaling. The latent constructs of cognitive competence, value, difficulty, effect, and effort were constructed using a Likert scale according to the pattern of statements on each item. This study uses confirmatory research with a quantitative approach. For students at religious universities in Indonesia, 243 respondents were selected using a stratified one-stage cluster random sampling technique. Proof of validity and estimation of reliability was done using confirmatory factor analysis. The results of this study show that the rescaling method can improve the validity of the factors but cannot increase Cronbach's coefficient of internal consistency and cannot reduce the standard error of measurement for each item. This research implies that it is not enough to rescale or transform the data to improve the validity and reliability of a measuring instrument. However, it is necessary to calibrate the statement sentence or item question so that the item measures its construct. Further research also needs to test the effectiveness of rescaling in addition to the Z-Score in improving the validity and reliability of measuring instruments.","PeriodicalId":34093,"journal":{"name":"Jurnal Pengukuran Psikologi dan Pendidikan Indonesia","volume":"11 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82153429","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Principal Component Analysis and Exploratory Factor Analysis of the Mechanical Waves Conceptual Survey","authors":"P. H. Santoso, E. Istiyono, H. Haryanto","doi":"10.15408/jp3i.v11i2.27488","DOIUrl":"https://doi.org/10.15408/jp3i.v11i2.27488","url":null,"abstract":"Mechanical waves conceptual survey (MWCS) is a measurement tool established by the physics education research (PER) community to evaluate conceptual physics understanding of mechanical waves. A validation study is still needed to figure out the factor structure of MWCS using two data reduction techniques, namely exploratory factor analysis (EFA) and principal component analysis (PCA). The MWCS dataset in this paper was gathered from physics students (n = 419) from nineteen Ugandan secondary schools. The findings of this research suggested the single factor of the MWCS construct that has emerged from the dataset explored in this study. Several issues involved in the calculation of inter-item correlation within the dataset are suspected as the leading cause of the missing component solution or stable loading in the data. Moreover, there might be other issues that leave open space for future exploration. The findings reported in this paper could be the subject of further discussion in evaluating the validity of the MWCS as a research-based assessment (RBA) to measure students' conceptual understanding of wave mechanics within PER studies.","PeriodicalId":34093,"journal":{"name":"Jurnal Pengukuran Psikologi dan Pendidikan Indonesia","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83047470","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The Maslach-Trisni Burnout Inventory: Adaptation for Indonesia","authors":"Lucia Trisni Widhianingtanti, G. Luijtelaar","doi":"10.15408/jp3i.v11i1.24400","DOIUrl":"https://doi.org/10.15408/jp3i.v11i1.24400","url":null,"abstract":"Burnout is commonly measured with the Maslach Burnout Inventory (MBI), which consists of three subscales measuring emotional exhaustion, personal accomplishment, and cynicism. We adapted the scale and then explored and confirmed the three dimensions on the Indonesian version named The Maslach-Trisni Burnout Inventory (M-TBI) with an exploratory analysis followed by Confirmatory Factor Analysis (CFA) from 822 workforces. The sensitivity for different job characteristics and demographic factors was established with analyses of variance and based on percentile scores of the subscales, three categories for burnout tendency were proposed. The scores on the three subscales were compared with those of Western countries. There are similar scores for emotional exhaustion and cynicism, but the sample score for personal accomplishment tends to be lower than the western countries. It can be concluded that the M-TBI scale is a reliable, sensitive, and efficient tool to measure the burnout tendency in the workforce in Indonesia.","PeriodicalId":34093,"journal":{"name":"Jurnal Pengukuran Psikologi dan Pendidikan Indonesia","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83020445","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Qutest Construction and Psychometric Evaluation as Test of Attention and Willpower for Employee Selection Screening","authors":"Iqbal Maesa Febriawan, Achmad Afrizal Fauzan, Chelsea Adelina, Hana Naufalinda Afifah, Razaf Pari, Aswin Januarsjaf","doi":"10.15408/jp3i.v11i1.22352","DOIUrl":"https://doi.org/10.15408/jp3i.v11i1.22352","url":null,"abstract":"Attention and willpower are some of the primary modalities for work, so it is necessary to evaluate those potentials. However, standard tests for assessing the two aspects, such as the Pauli or Kraepelin test, are bias-prone to numerical ability. Due to that concern, Qutest was designed as an attention and willpower (screening) test with symbolic stimulus adapted from the d2 test (Brickencamp, 1998). Two studies were conducted for Qutest psychometric properties evaluation. In the first study, 261 participants finished Qutest on a web-based platform with a maximum of 96 pages, each containing 24 symbols of key stimuli (a symbol Q with two dots) and distractors that had to complete in a maximum of 30 minutes. Analyses of internal consistency and correlation with Pauli test results were performed to establish test psychometric properties. The results supported adequate internal consistency and convergent validity claim for Qutest. In addition to internal consistency, a second study was conducted to develop further and evaluate parallel-form consistency between mobile and computer versions. In the second study, 371 participants completed a maximum of 192-page Qutest with a similar amount of time to the previous study. Participants took the mobile version first and then the computer versions of the test with a minimum of one lag day. Statistically significant correlation index of results across devices supported parallel-form reliability of both mobile and laptop/desktop Qutest version. A follow-up analysis of answering aids (mouse, trackpad, touch screen) for the computer version recommended using a mouse or touch screen instead of a trackpad due to statistically significant difference in performance among the three tools. Thus, Qutest can be used as a psychometrically adequate test and be flexible in various devices to assess attention and willpower for (prospective) employee screening.","PeriodicalId":34093,"journal":{"name":"Jurnal Pengukuran Psikologi dan Pendidikan Indonesia","volume":"32 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75777639","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Scale Construction of The Discipline Scale For Indonesian Air Force (TNI Angkatan Udara) Military Personnel (IMPI-D32)","authors":"Yashinta Levy Septiarly, Saifuddin Azwar","doi":"10.15408/jp3i.v11i1.19478","DOIUrl":"https://doi.org/10.15408/jp3i.v11i1.19478","url":null,"abstract":"This study aims to create a discipline measuring tool with good psychometric properties for Indonesian Air Force Military Personnel (IMPI-D32). It was conducted using an integration of self-discipline, motivation to obey, and discipline theories in a military context. The IMPI-D32 consists of 32 items and its construction are based on the Classical Theory Test. The item's content validity was estimated using the Aiken V index at a minimum of .690. Furthermore, the item discriminations showed that the corrected item-total correlation for all items is above .3. Meanwhile, the reliability estimation with the Spearman-Brown formula indicated a satisfactory coefficient value of .916. The standard error of measuring the IMPI-D32 was 3.439 with the confidence of true score interval between X-6 to X+6.","PeriodicalId":34093,"journal":{"name":"Jurnal Pengukuran Psikologi dan Pendidikan Indonesia","volume":"42 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88567957","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Construct Validity of Group Resilience Measurement Scale in Indonesia","authors":"Lailatul Mubarokah, Adiyo Roebianto, Arni Sari","doi":"10.15408/jp3i.v11i1.20713","DOIUrl":"https://doi.org/10.15408/jp3i.v11i1.20713","url":null,"abstract":"Humans will always face challenges that interfere with their course of life. Their responses to face those challenges or resilience are varied, depending on environmental aspects. The discussion on resilience is used to understand the reasons why individuals can be more resistant to challenges than other individuals. The aspect that influences and forms resilience is the environment. One form of the influential environment is the environment in which humans are born or reside. The demographic characteristics of the Indonesian region are one form of the physical environment which is divided by geography (West Indonesia, Central Indonesia, and East Indonesia) and by type of administrative area (District and Municipalities). This study employed a quantitative approach to measure the construct validity of the CCRAM instrument which has been translated into Indonesian. This study involved 518 people (N = 518) as participants who came from three regions of Indonesia, namely East, Central, and West Indonesia. The research instrument was a questionnaire containing statements/items related to community resilience. After the data were collected online, Confirmatory Factor Analysis (CFA) was conducted to check the validity of each item on each dimension/construct. The results indicate that all dimensions and items were declared to meet the fit or valid criteria.","PeriodicalId":34093,"journal":{"name":"Jurnal Pengukuran Psikologi dan Pendidikan Indonesia","volume":"26 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80845182","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Measuring Peace of Heart: The Development and Validation of Taṭmainn al-Qulūb Scale (TQS)","authors":"Ahmad Rusdi, Rumiani Rumiani, Nyda Afsari, Rena Latifa","doi":"10.15408/jp3i.v11i1.23661","DOIUrl":"https://doi.org/10.15408/jp3i.v11i1.23661","url":null,"abstract":"Peace of heart is an inner spiritual experience that generates an emotional feeling of harmony. Peace of heart (taṭmainn al-qulūb) is an important aspect applicable for the life of the Muslim community as a treatment for the psychological problems of the modern era, mainly due to the absence of peace. Thus far, no research has been done on the development of peace of heart to capture the uniqueness, specific aspect, and distinctive aspect of peace in Muslim community. A total of 744 respondents responded to this research. Six experts were involved to examine item wording in this research (CVR= .67-1.00). This study has found that the TQS consists of two components (al-sukūn and al-yaqīn) with a good loading factor (.687-.884), Cronbach's Alpha (.844), and item consistency (.545-.857). All items had a good difficulty level and appropriate rating. Convergence validity on this scale was indicated by its correlation with The Brief Serenity Scale (r= .612). The criterion-related validity on this scale was indicated by its correlation with dhikr quality (r= .629), Islamic positive religious coping (r= .518), perceived stress (r= -.453), and sensibility (r= .103). Further studies need to be done based on the followings: 1) Examining the measurement on this topic with larger respondents having equal variance; 2) Considering gender, education level, and age in norming study of this scale; 3) Validating with other measurements to add validity information, especially discriminant validity","PeriodicalId":34093,"journal":{"name":"Jurnal Pengukuran Psikologi dan Pendidikan Indonesia","volume":"34 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73884439","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Development and Validation of Situational Judgement Test to Measure Continuous Learning Competency","authors":"Yunita Faela Nisa, Jahja Umar, Puspita Dian Arista, Helena Widaningrum, Bahrul Hayat","doi":"10.15408/jp3i.v11i1.25302","DOIUrl":"https://doi.org/10.15408/jp3i.v11i1.25302","url":null,"abstract":"Measuring continuous learning (CL) competency is beneficial to achieving success for individuals and organizations. For this reason, the availability of a brief but valid instrument is crucial. This study aims to develop a valid instrument to measure the CL using a situational judgment test (SJT). The instrument was developed and validated using respondents of 502 employees at the supervisory level in the electrical industry (with age M=30.13, SD=6.17). For content validity, we first held focus group discussions with supervisors and managers to identify and develop some essential characteristics of the CL. Subject matter experts were involved in writing and reviewing the items. A confirmatory factor analysis was conducted to test the construct validity, and it was found that 12 of 13 items fitted a unidimensional model. All the factor loadings were statistically significant (p<.05). A further test for parallel assumption was done to check the tau-equivalence. This test is vital because raw scores are mostly used in daily practice rather than scaled scores. The results showed that 12 items met the tau equivalent requirement. For further research, scoring for multiple-choice SJTs using the nominal response model (NRM) could be considered since there was a tendency for some of the questions to elicit ambiguous choices.","PeriodicalId":34093,"journal":{"name":"Jurnal Pengukuran Psikologi dan Pendidikan Indonesia","volume":"12 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88861400","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}