Kazuya Saito, Konstantinos Macmillan, T. Mai, Yui Suzukida, Hui Sun, Viktoria Magne, Meltem Ilkan, Akira Murakami
{"title":"Developing, Analyzing and Sharing Multivariate Datasets: Individual Differences in L2 Learning Revisited","authors":"Kazuya Saito, Konstantinos Macmillan, T. Mai, Yui Suzukida, Hui Sun, Viktoria Magne, Meltem Ilkan, Akira Murakami","doi":"10.1017/S0267190520000045","DOIUrl":null,"url":null,"abstract":"Abstract Following the trends established in psychology and emerging in L2 research, we explain our support for an Open Science approach in this paper (i.e., developing, analyzing and sharing datasets) as a way to answer controversial and complex questions in applied linguistics. We illustrate this with a focus on a frequently debated question, what underlies individual differences in the dynamic system of post-pubertal L2 speech learning? We provide a detailed description of our dataset which consists of spontaneous speech samples, elicited from 110 late L2 speakers in the UK with diverse linguistic, experiential and sociopsychological backgrounds, rated by ten L1 English listeners for comprehensibility and nativelikeness. We explain how we examined the source of individual differences by linking different levels of L2 speech performance to a range of learner-extrinsic and intrinsic variables related to first language backgrounds, age, experience, motivation, awareness, and attitudes using a series of factor and Bayesian mixed-effects ordinal regression analyses. We conclude with a range of suggestions for the fields of applied linguistics and SLA, including the use of Bayesian methods in analyzing multivariate, multifactorial data of this kind, and advocating for publicly available datasets. In keeping with recommendations for increasing openness of the field, we invite readers to rethink and redo our analyses and interpretations from multiple angles by making our dataset and coding publicly available as part of our 40th anniversary ARAL article.","PeriodicalId":47490,"journal":{"name":"Annual Review of Applied Linguistics","volume":"40 1","pages":"9 - 25"},"PeriodicalIF":2.8000,"publicationDate":"2020-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1017/S0267190520000045","citationCount":"24","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Annual Review of Applied Linguistics","FirstCategoryId":"98","ListUrlMain":"https://doi.org/10.1017/S0267190520000045","RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"LANGUAGE & LINGUISTICS","Score":null,"Total":0}
引用次数: 24
Abstract
Abstract Following the trends established in psychology and emerging in L2 research, we explain our support for an Open Science approach in this paper (i.e., developing, analyzing and sharing datasets) as a way to answer controversial and complex questions in applied linguistics. We illustrate this with a focus on a frequently debated question, what underlies individual differences in the dynamic system of post-pubertal L2 speech learning? We provide a detailed description of our dataset which consists of spontaneous speech samples, elicited from 110 late L2 speakers in the UK with diverse linguistic, experiential and sociopsychological backgrounds, rated by ten L1 English listeners for comprehensibility and nativelikeness. We explain how we examined the source of individual differences by linking different levels of L2 speech performance to a range of learner-extrinsic and intrinsic variables related to first language backgrounds, age, experience, motivation, awareness, and attitudes using a series of factor and Bayesian mixed-effects ordinal regression analyses. We conclude with a range of suggestions for the fields of applied linguistics and SLA, including the use of Bayesian methods in analyzing multivariate, multifactorial data of this kind, and advocating for publicly available datasets. In keeping with recommendations for increasing openness of the field, we invite readers to rethink and redo our analyses and interpretations from multiple angles by making our dataset and coding publicly available as part of our 40th anniversary ARAL article.
期刊介绍:
The Annual Review of Applied Linguistics publishes research on key topics in the broad field of applied linguistics. Each issue is thematic, providing a variety of perspectives on the topic through research summaries, critical overviews, position papers and empirical studies. Being responsive to the field, some issues are tied to the theme of that year''s annual conference of the American Association for Applied Linguistics. Also, at regular intervals an issue will take the approach of covering applied linguistics as a field more broadly, including coverage of critical or controversial topics. ARAL provides cutting-edge and timely articles on a wide number of areas, including language learning and pedagogy, second language acquisition, sociolinguistics, language policy and planning, language assessment, and research design and methodology, to name just a few.