{"title":"翻译和内容验证工具,以评估学生的教学","authors":"Joice Trindade Silveira, J. Rocha","doi":"10.15366/RIEE2017.10.2.003","DOIUrl":null,"url":null,"abstract":"O Student Evaluation Educacional Quality (SEEQ) e um instrumento multidimensional de avaliacao do ensino pelos alunos. O objetivo deste trabalho foi realizar o processo de traducao e validacao de conteudo do SEEQ para o Brasil. O trabalho foi desenvolvido em quatro etapas: 1. Traducao reversa (back translation); 2. Consolidacao da revisao preliminar; 3. Validacao de conteudo da versao preliminar; 4. Teste piloto. Quatro tradutores participaram da primeira etapa, dois realizando a traducao do ingles para o portugues e dois do portugues para o ingles. Os itens foram analisados por um comite para a obtencao de uma versao preliminar e, posteriormente, foram avaliado por especialistas quanto aos criterios de clareza de linguagem, pertinencia pratica, relevância teorica e dimensao. A versao preliminar apresentou muitos itens com coeficiente de validade de conteudo (CVC) abaixo do ponto de corte, sendo, por isso, adaptado e reavaliado. Apos as modificacoes, o instrumento apresentou CVC satisfatorio (igual ou maior a 0,80) nos tres criterios independentes e no instrumento como um todo. O coeficiente Kappa do criterio dimensao foi moderado (0,544). Apos o teste piloto, o instrumento esta apto a aplicacao em pesquisas. Futuramente, para sua aplicacao pratica, e necessario que sejam investigadas as caracteristicas psicometricas da escala.Palavras-chave: Avaliacao de cursos, Metodos de avaliacao, Avaliacao institucional, Avaliacao da atividade docente pelos estudantes. Translation and Validation Content of Instrument for Students’ Evaluation of TeachingStudent Evaluation of Educational Quality (SEEQ) is a multidimensional instrument to evaluate the teaching quality. The aim of this study was the translation and content validation process of SEEQ for Brazil. The study was done in four steps: 1. Back translation; 2. Consolidation of the preliminary version; 3. Content validation of preliminary version; 4. Pilot test. Four translators participated in the first stage, two performing the translation from English to Portuguese language and two from Portuguese to English. Items were reviewed by a committee to obtain the preliminary version of the instrument and then they were evaluated by experts in clarity of language, practical relevance, theoretical relevance and dimension criteria. The preliminary version presented many items with content validity coefficient (CVC) below the cut-off value, and therefore it was adapted and re-evaluated. After the modifications, the instrument presented satisfactory CVC (?0.80) at both three criteria and the whole instrument. The Kappa coefficient dimension criteria was moderate (0.544). After the pilot test, the instrument is able to use in research. For practical application, however, it is necessary that the psychometric characteristics of the scale are still investigated.Keywords: Course evaluation, Evaluation criteria, Evaluation method, Institutional evaluation, Student evaluation of teacher performance.","PeriodicalId":166932,"journal":{"name":"Revista Iberoamericana de Evaluación Educativa","volume":"56 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2017-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Tradução e Ferramenta de Validação de Conteúdo de Avaliação do Ensino pelos Alunos\",\"authors\":\"Joice Trindade Silveira, J. Rocha\",\"doi\":\"10.15366/RIEE2017.10.2.003\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"O Student Evaluation Educacional Quality (SEEQ) e um instrumento multidimensional de avaliacao do ensino pelos alunos. O objetivo deste trabalho foi realizar o processo de traducao e validacao de conteudo do SEEQ para o Brasil. O trabalho foi desenvolvido em quatro etapas: 1. Traducao reversa (back translation); 2. Consolidacao da revisao preliminar; 3. Validacao de conteudo da versao preliminar; 4. Teste piloto. Quatro tradutores participaram da primeira etapa, dois realizando a traducao do ingles para o portugues e dois do portugues para o ingles. Os itens foram analisados por um comite para a obtencao de uma versao preliminar e, posteriormente, foram avaliado por especialistas quanto aos criterios de clareza de linguagem, pertinencia pratica, relevância teorica e dimensao. A versao preliminar apresentou muitos itens com coeficiente de validade de conteudo (CVC) abaixo do ponto de corte, sendo, por isso, adaptado e reavaliado. Apos as modificacoes, o instrumento apresentou CVC satisfatorio (igual ou maior a 0,80) nos tres criterios independentes e no instrumento como um todo. O coeficiente Kappa do criterio dimensao foi moderado (0,544). Apos o teste piloto, o instrumento esta apto a aplicacao em pesquisas. Futuramente, para sua aplicacao pratica, e necessario que sejam investigadas as caracteristicas psicometricas da escala.Palavras-chave: Avaliacao de cursos, Metodos de avaliacao, Avaliacao institucional, Avaliacao da atividade docente pelos estudantes. Translation and Validation Content of Instrument for Students’ Evaluation of TeachingStudent Evaluation of Educational Quality (SEEQ) is a multidimensional instrument to evaluate the teaching quality. The aim of this study was the translation and content validation process of SEEQ for Brazil. The study was done in four steps: 1. Back translation; 2. Consolidation of the preliminary version; 3. Content validation of preliminary version; 4. Pilot test. Four translators participated in the first stage, two performing the translation from English to Portuguese language and two from Portuguese to English. Items were reviewed by a committee to obtain the preliminary version of the instrument and then they were evaluated by experts in clarity of language, practical relevance, theoretical relevance and dimension criteria. The preliminary version presented many items with content validity coefficient (CVC) below the cut-off value, and therefore it was adapted and re-evaluated. After the modifications, the instrument presented satisfactory CVC (?0.80) at both three criteria and the whole instrument. The Kappa coefficient dimension criteria was moderate (0.544). After the pilot test, the instrument is able to use in research. For practical application, however, it is necessary that the psychometric characteristics of the scale are still investigated.Keywords: Course evaluation, Evaluation criteria, Evaluation method, Institutional evaluation, Student evaluation of teacher performance.\",\"PeriodicalId\":166932,\"journal\":{\"name\":\"Revista Iberoamericana de Evaluación Educativa\",\"volume\":\"56 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2017-07-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Revista Iberoamericana de Evaluación Educativa\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.15366/RIEE2017.10.2.003\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Revista Iberoamericana de Evaluación Educativa","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.15366/RIEE2017.10.2.003","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Tradução e Ferramenta de Validação de Conteúdo de Avaliação do Ensino pelos Alunos
O Student Evaluation Educacional Quality (SEEQ) e um instrumento multidimensional de avaliacao do ensino pelos alunos. O objetivo deste trabalho foi realizar o processo de traducao e validacao de conteudo do SEEQ para o Brasil. O trabalho foi desenvolvido em quatro etapas: 1. Traducao reversa (back translation); 2. Consolidacao da revisao preliminar; 3. Validacao de conteudo da versao preliminar; 4. Teste piloto. Quatro tradutores participaram da primeira etapa, dois realizando a traducao do ingles para o portugues e dois do portugues para o ingles. Os itens foram analisados por um comite para a obtencao de uma versao preliminar e, posteriormente, foram avaliado por especialistas quanto aos criterios de clareza de linguagem, pertinencia pratica, relevância teorica e dimensao. A versao preliminar apresentou muitos itens com coeficiente de validade de conteudo (CVC) abaixo do ponto de corte, sendo, por isso, adaptado e reavaliado. Apos as modificacoes, o instrumento apresentou CVC satisfatorio (igual ou maior a 0,80) nos tres criterios independentes e no instrumento como um todo. O coeficiente Kappa do criterio dimensao foi moderado (0,544). Apos o teste piloto, o instrumento esta apto a aplicacao em pesquisas. Futuramente, para sua aplicacao pratica, e necessario que sejam investigadas as caracteristicas psicometricas da escala.Palavras-chave: Avaliacao de cursos, Metodos de avaliacao, Avaliacao institucional, Avaliacao da atividade docente pelos estudantes. Translation and Validation Content of Instrument for Students’ Evaluation of TeachingStudent Evaluation of Educational Quality (SEEQ) is a multidimensional instrument to evaluate the teaching quality. The aim of this study was the translation and content validation process of SEEQ for Brazil. The study was done in four steps: 1. Back translation; 2. Consolidation of the preliminary version; 3. Content validation of preliminary version; 4. Pilot test. Four translators participated in the first stage, two performing the translation from English to Portuguese language and two from Portuguese to English. Items were reviewed by a committee to obtain the preliminary version of the instrument and then they were evaluated by experts in clarity of language, practical relevance, theoretical relevance and dimension criteria. The preliminary version presented many items with content validity coefficient (CVC) below the cut-off value, and therefore it was adapted and re-evaluated. After the modifications, the instrument presented satisfactory CVC (?0.80) at both three criteria and the whole instrument. The Kappa coefficient dimension criteria was moderate (0.544). After the pilot test, the instrument is able to use in research. For practical application, however, it is necessary that the psychometric characteristics of the scale are still investigated.Keywords: Course evaluation, Evaluation criteria, Evaluation method, Institutional evaluation, Student evaluation of teacher performance.