Peter Skehan , Gavin Bui , Zhan Wang , Sabrina Shum
{"title":"Re-examining accuracy measures in second language task-based spoken performance","authors":"Peter Skehan , Gavin Bui , Zhan Wang , Sabrina Shum","doi":"10.1016/j.rmal.2024.100098","DOIUrl":null,"url":null,"abstract":"<div><p>This article reports on a study re-examining the measurement of accuracy in second language task-based performance. Three studies were re-analysed, loosely linked in research designs and experimental variables, but with standardised methods of measuring accuracy. Numerous accuracy measures were used, covering unit of measurement, error gravity, and error linked to length of clause. The contribution of the different measures was compared, largely through effect sizes. It is claimed that some measures are more sensitive than others. Variants of Errors per 100 words were found to be very effective. In contrast the conventional Error Free Clauses measure did not perform consistently well. Clause length accuracy was also distinctive, as was the concept of error gravity. It is proposed that greater understanding of measurement alternatives with accuracy can make a significant contribution to the field, in terms of comparability of studies, as well as the evaluation of theoretical models of second language task-based performance.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100098"},"PeriodicalIF":0.0000,"publicationDate":"2024-02-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000041/pdfft?md5=42aeb8e2617e767f44d5ed47f7adb9d1&pid=1-s2.0-S2772766124000041-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research Methods in Applied Linguistics","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2772766124000041","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
This article reports on a study re-examining the measurement of accuracy in second language task-based performance. Three studies were re-analysed, loosely linked in research designs and experimental variables, but with standardised methods of measuring accuracy. Numerous accuracy measures were used, covering unit of measurement, error gravity, and error linked to length of clause. The contribution of the different measures was compared, largely through effect sizes. It is claimed that some measures are more sensitive than others. Variants of Errors per 100 words were found to be very effective. In contrast the conventional Error Free Clauses measure did not perform consistently well. Clause length accuracy was also distinctive, as was the concept of error gravity. It is proposed that greater understanding of measurement alternatives with accuracy can make a significant contribution to the field, in terms of comparability of studies, as well as the evaluation of theoretical models of second language task-based performance.