R. Shroff, F. Ting, Chi-lok Chan, Raycelle C. C. Garcia, W. Tsang, W. Lam
{"title":"在技术支持的背景下,对学习者基于问题的学习和同伴评估策略进行概念化、测量和初步验证","authors":"R. Shroff, F. Ting, Chi-lok Chan, Raycelle C. C. Garcia, W. Tsang, W. Lam","doi":"10.14742/ajet.7214","DOIUrl":null,"url":null,"abstract":"This study attempted to conceptualise and measure learners’ perceptions of their collaborative problem-based learning and peer assessment strategies in a technology-enabled context. Drawing on the extant literature, we integrate collaborative, problem-based and peer assessment learning strategies and propose a new model, the collaborative problem-based learning and peer assessment (Co-PBLa-PA) conceptual framework, which forms the basis of a new psychometrically sound and conceptually based scale, the collaborative problem-based learning and peer assessment strategies inventory (CO-PBLa-PA-SI). The development and validation of the CO-PBLa-PA-SI, based on the methodological and conceptual insights gained from prior research, involved identifying the following four scales: capacity to collaborate, readiness to engage, task-based interest and peer feedback usefulness. An item pool comprising of 16 items was established and verified by two panels of judges using a formalised card sorting procedure. Confirmatory factor analysis was conducted to validate the instrument of a small-scale (N = 164) study. The CO-PBLa-PA-SI scale showed strong construct validity and reliability with a Cronbach’s coefficient alpha ranging from .828 to .880, which suggested strong internal consistency. The resultant instrument is intended as a tool to reliably measure learners’ perceptions of their collaborative problem-based learning and peer assessment strategies in a technology-enabled context.\nImplications for practice or policy:\n\nA psychometrically validated scale could be used by a growing community of academicians, educators and instructional designers to assess learners’ collaborative problem-based learning and peer assessment strategies when using interactive technologies;\nA systematically collected data set obtained from the CO-PBLa-PA-SI data may have practical implications in terms of informing teachers about appropriate instructional design practices for the enhancement of collaborative, problem-based and peer assessment learning strategies in technology-enabled settings.\n","PeriodicalId":47812,"journal":{"name":"Australasian Journal of Educational Technology","volume":" ","pages":""},"PeriodicalIF":3.3000,"publicationDate":"2023-03-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Conceptualisation, measurement and preliminary validation of learners’ problem-based learning and peer assessment strategies in a technology-enabled context\",\"authors\":\"R. Shroff, F. Ting, Chi-lok Chan, Raycelle C. C. Garcia, W. Tsang, W. Lam\",\"doi\":\"10.14742/ajet.7214\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This study attempted to conceptualise and measure learners’ perceptions of their collaborative problem-based learning and peer assessment strategies in a technology-enabled context. Drawing on the extant literature, we integrate collaborative, problem-based and peer assessment learning strategies and propose a new model, the collaborative problem-based learning and peer assessment (Co-PBLa-PA) conceptual framework, which forms the basis of a new psychometrically sound and conceptually based scale, the collaborative problem-based learning and peer assessment strategies inventory (CO-PBLa-PA-SI). The development and validation of the CO-PBLa-PA-SI, based on the methodological and conceptual insights gained from prior research, involved identifying the following four scales: capacity to collaborate, readiness to engage, task-based interest and peer feedback usefulness. An item pool comprising of 16 items was established and verified by two panels of judges using a formalised card sorting procedure. Confirmatory factor analysis was conducted to validate the instrument of a small-scale (N = 164) study. The CO-PBLa-PA-SI scale showed strong construct validity and reliability with a Cronbach’s coefficient alpha ranging from .828 to .880, which suggested strong internal consistency. The resultant instrument is intended as a tool to reliably measure learners’ perceptions of their collaborative problem-based learning and peer assessment strategies in a technology-enabled context.\\nImplications for practice or policy:\\n\\nA psychometrically validated scale could be used by a growing community of academicians, educators and instructional designers to assess learners’ collaborative problem-based learning and peer assessment strategies when using interactive technologies;\\nA systematically collected data set obtained from the CO-PBLa-PA-SI data may have practical implications in terms of informing teachers about appropriate instructional design practices for the enhancement of collaborative, problem-based and peer assessment learning strategies in technology-enabled settings.\\n\",\"PeriodicalId\":47812,\"journal\":{\"name\":\"Australasian Journal of Educational Technology\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":3.3000,\"publicationDate\":\"2023-03-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Australasian Journal of Educational Technology\",\"FirstCategoryId\":\"95\",\"ListUrlMain\":\"https://doi.org/10.14742/ajet.7214\",\"RegionNum\":3,\"RegionCategory\":\"教育学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Australasian Journal of Educational Technology","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.14742/ajet.7214","RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
摘要
本研究试图在技术支持的背景下,对学习者对基于问题的合作学习和同伴评估策略的看法进行概念化和测量。在现有文献的基础上,我们整合了协作、基于问题和同伴评估的学习策略,并提出了一种新的模型,即基于问题的协作学习和同伴评估(Co-PBLa-PA)概念框架,该框架构成了一个新的心理测量学健全和基于概念的量表的基础,基于合作问题的学习和同伴评估策略清单(CO PBLa PA SI)。基于先前研究中获得的方法论和概念见解,制定和验证CO PBLa PA SI涉及确定以下四个量表:合作能力、参与意愿、基于任务的兴趣和同伴反馈有用性。建立了一个由16个项目组成的项目库,并由两个法官小组使用正式的卡片分拣程序进行验证。进行了验证性因素分析,以验证一项小规模(N=164)研究的工具。CO PBLa PA SI量表显示出较强的结构有效性和可靠性,Cronbach系数α在.228至.880之间,这表明具有较强的内部一致性。由此产生的工具旨在作为一种工具,在技术支持的背景下,可靠地衡量学习者对其基于问题的协作学习和同伴评估策略的看法。对实践或政策的影响:越来越多的学者、教育工作者和教学设计师可以使用心理计量学验证的量表来评估学习者在使用互动技术时基于问题的协作学习和同伴评估策略;从CO PBLa PA SI数据中获得的系统收集的数据集可能具有实际意义,可以让教师了解适当的教学设计实践,以在技术支持的环境中加强协作、基于问题和同伴评估的学习策略。
Conceptualisation, measurement and preliminary validation of learners’ problem-based learning and peer assessment strategies in a technology-enabled context
This study attempted to conceptualise and measure learners’ perceptions of their collaborative problem-based learning and peer assessment strategies in a technology-enabled context. Drawing on the extant literature, we integrate collaborative, problem-based and peer assessment learning strategies and propose a new model, the collaborative problem-based learning and peer assessment (Co-PBLa-PA) conceptual framework, which forms the basis of a new psychometrically sound and conceptually based scale, the collaborative problem-based learning and peer assessment strategies inventory (CO-PBLa-PA-SI). The development and validation of the CO-PBLa-PA-SI, based on the methodological and conceptual insights gained from prior research, involved identifying the following four scales: capacity to collaborate, readiness to engage, task-based interest and peer feedback usefulness. An item pool comprising of 16 items was established and verified by two panels of judges using a formalised card sorting procedure. Confirmatory factor analysis was conducted to validate the instrument of a small-scale (N = 164) study. The CO-PBLa-PA-SI scale showed strong construct validity and reliability with a Cronbach’s coefficient alpha ranging from .828 to .880, which suggested strong internal consistency. The resultant instrument is intended as a tool to reliably measure learners’ perceptions of their collaborative problem-based learning and peer assessment strategies in a technology-enabled context.
Implications for practice or policy:
A psychometrically validated scale could be used by a growing community of academicians, educators and instructional designers to assess learners’ collaborative problem-based learning and peer assessment strategies when using interactive technologies;
A systematically collected data set obtained from the CO-PBLa-PA-SI data may have practical implications in terms of informing teachers about appropriate instructional design practices for the enhancement of collaborative, problem-based and peer assessment learning strategies in technology-enabled settings.