Natalia Ronderos, R. Shavelson, Doreen Holtsch, O. Zlatkin‐Troitschanskaia, Guillermo Solano-Flores
{"title":"INTERNATIONAL PERFORMANCE ASSESSMENT OF CRITICAL THINKING: FRAMEWORK FOR TRANSLATION AND ADAPTATION","authors":"Natalia Ronderos, R. Shavelson, Doreen Holtsch, O. Zlatkin‐Troitschanskaia, Guillermo Solano-Flores","doi":"10.15366/JOSPOE2021.13.003","DOIUrl":null,"url":null,"abstract":"Higher education institutions worldwide claim they impact students’ learning outcomes within and across academic domains. Critical thinking (CT) is prominent among the intended outcomes (Braun et al., 2020). In this context, there is increasing interest in ecologically valid performance assessments (PAs) of CT that can be used internationally (Zlatkin-Troitschanskaia et al., 2018). While several studies have aimed to measure and compare CT skills across countries, this typically has been done using multiple-choice questions. Only a few studies involve adaptation of PAs. Their results point to the need for a more refined adaptation process (Braun et al., 2020), especially in terms of functionally equivalent adaptation and redesign. Based on a review of previous approaches related to test adaptation, with focus on the challenges of achieving cultural responsiveness, we propose a conceptual framework for adapting PAs of CT for international studies. The framework differentiates between two stages and three adaptation designs. The first stage involves a collaborative approach to the design of PAs of CT. The second stage offers three design alternatives which differ in their emphasis on linguistic considerations and cultural responsiveness. While this paper focuses on PAs of CT for higher education, it may be applicable to pre-college education.","PeriodicalId":162204,"journal":{"name":"Journal of Supranational Policies of Education (JOSPOE)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Supranational Policies of Education (JOSPOE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.15366/JOSPOE2021.13.003","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
Abstract
Higher education institutions worldwide claim they impact students’ learning outcomes within and across academic domains. Critical thinking (CT) is prominent among the intended outcomes (Braun et al., 2020). In this context, there is increasing interest in ecologically valid performance assessments (PAs) of CT that can be used internationally (Zlatkin-Troitschanskaia et al., 2018). While several studies have aimed to measure and compare CT skills across countries, this typically has been done using multiple-choice questions. Only a few studies involve adaptation of PAs. Their results point to the need for a more refined adaptation process (Braun et al., 2020), especially in terms of functionally equivalent adaptation and redesign. Based on a review of previous approaches related to test adaptation, with focus on the challenges of achieving cultural responsiveness, we propose a conceptual framework for adapting PAs of CT for international studies. The framework differentiates between two stages and three adaptation designs. The first stage involves a collaborative approach to the design of PAs of CT. The second stage offers three design alternatives which differ in their emphasis on linguistic considerations and cultural responsiveness. While this paper focuses on PAs of CT for higher education, it may be applicable to pre-college education.
世界各地的高等教育机构都声称,它们影响着学生在学术领域内和跨学术领域的学习成果。批判性思维(CT)在预期结果中很突出(Braun et al., 2020)。在这种背景下,人们对可在国际上使用的CT的生态有效性能评估(PAs)越来越感兴趣(Zlatkin-Troitschanskaia等人,2018)。虽然有几项研究旨在衡量和比较各国的CT技能,但这通常是通过多项选择题来完成的。只有少数研究涉及到PAs的适应。他们的研究结果表明,需要更精细的适应过程(Braun et al., 2020),特别是在功能等效适应和重新设计方面。在回顾以往与测试适应相关的方法的基础上,重点关注实现文化响应性的挑战,我们提出了一个使CT PAs适应国际研究的概念框架。该框架区分了两个阶段和三个适应设计。第一阶段是采用协作的方法来设计CT的PAs。第二阶段提供了三种不同的设计方案,它们在强调语言考虑和文化响应方面有所不同。虽然本文的重点是针对高等教育的CT PAs,但它可能适用于大学预科教育。