Daniel E. Iancu , Laurenţiu P. Maricuţoiu , Marian D. Ilie
{"title":"学生对教学的评价:对罗马尼亚版马什学生教育质量评价量表的在线和纸质施测程序的测量不变性分析","authors":"Daniel E. Iancu , Laurenţiu P. Maricuţoiu , Marian D. Ilie","doi":"10.1016/j.stueduc.2024.101340","DOIUrl":null,"url":null,"abstract":"<div><p>Student Evaluation of Teaching (SET) instruments can be administered online or with paper and pencil. These procedures involve different interactions between respondents and instruments which could cause errors when administrators and researchers want to compare or relate online results with paper-based results. This study aimed to analyze if the Romanian version of the Student Evaluations of Educational Quality instrument presents similar psychometric characteristics regardless if it is completed online or by paper and pencil. Data was collected from two groups of students (N = 809). One group completed the SEEQ on paper-pencil support (312 responders, 38.6%). The other group completed the scale for the same teachers and courses, but online and one year later. Psychometrical checks and measurement invariance analysis suggested that the Romanian version of SEEQ has passed the internal validity and reliability test and presented configural, metric, and scalar invariance across the results obtained from both administration procedures.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"81 ","pages":"Article 101340"},"PeriodicalIF":2.6000,"publicationDate":"2024-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0191491X24000191/pdfft?md5=7315e0b37310e6f3677862260ae9e50b&pid=1-s2.0-S0191491X24000191-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Student Evaluation of Teaching: The analysis of measurement invariance across online and paper-based administration procedures of the Romanian version of Marsh’s Student Evaluations of Educational Quality scale\",\"authors\":\"Daniel E. Iancu , Laurenţiu P. Maricuţoiu , Marian D. Ilie\",\"doi\":\"10.1016/j.stueduc.2024.101340\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Student Evaluation of Teaching (SET) instruments can be administered online or with paper and pencil. These procedures involve different interactions between respondents and instruments which could cause errors when administrators and researchers want to compare or relate online results with paper-based results. This study aimed to analyze if the Romanian version of the Student Evaluations of Educational Quality instrument presents similar psychometric characteristics regardless if it is completed online or by paper and pencil. Data was collected from two groups of students (N = 809). One group completed the SEEQ on paper-pencil support (312 responders, 38.6%). The other group completed the scale for the same teachers and courses, but online and one year later. Psychometrical checks and measurement invariance analysis suggested that the Romanian version of SEEQ has passed the internal validity and reliability test and presented configural, metric, and scalar invariance across the results obtained from both administration procedures.</p></div>\",\"PeriodicalId\":47539,\"journal\":{\"name\":\"Studies in Educational Evaluation\",\"volume\":\"81 \",\"pages\":\"Article 101340\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2024-02-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S0191491X24000191/pdfft?md5=7315e0b37310e6f3677862260ae9e50b&pid=1-s2.0-S0191491X24000191-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Studies in Educational Evaluation\",\"FirstCategoryId\":\"95\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0191491X24000191\",\"RegionNum\":2,\"RegionCategory\":\"教育学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Studies in Educational Evaluation","FirstCategoryId":"95","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0191491X24000191","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
Student Evaluation of Teaching: The analysis of measurement invariance across online and paper-based administration procedures of the Romanian version of Marsh’s Student Evaluations of Educational Quality scale
Student Evaluation of Teaching (SET) instruments can be administered online or with paper and pencil. These procedures involve different interactions between respondents and instruments which could cause errors when administrators and researchers want to compare or relate online results with paper-based results. This study aimed to analyze if the Romanian version of the Student Evaluations of Educational Quality instrument presents similar psychometric characteristics regardless if it is completed online or by paper and pencil. Data was collected from two groups of students (N = 809). One group completed the SEEQ on paper-pencil support (312 responders, 38.6%). The other group completed the scale for the same teachers and courses, but online and one year later. Psychometrical checks and measurement invariance analysis suggested that the Romanian version of SEEQ has passed the internal validity and reliability test and presented configural, metric, and scalar invariance across the results obtained from both administration procedures.
期刊介绍:
Studies in Educational Evaluation publishes original reports of evaluation studies. Four types of articles are published by the journal: (a) Empirical evaluation studies representing evaluation practice in educational systems around the world; (b) Theoretical reflections and empirical studies related to issues involved in the evaluation of educational programs, educational institutions, educational personnel and student assessment; (c) Articles summarizing the state-of-the-art concerning specific topics in evaluation in general or in a particular country or group of countries; (d) Book reviews and brief abstracts of evaluation studies.