{"title":"New Technologies in Second Language Signed Assessment","authors":"Sarah Ebling, Necati Cihan Camgöz, R. Bowden","doi":"10.1093/oso/9780190885052.003.0036","DOIUrl":"https://doi.org/10.1093/oso/9780190885052.003.0036","url":null,"abstract":"In this chapter, two signed language technologies are introduced: signed language recognition and signed language synthesis/animation. The modality-specific challenges of these technologies are discussed, originating in the multichannel nature of signs and the lack of a standardized writing system. The state of research of each technology is outlined, demonstrating that the existing body of research is considerably smaller than that of the field of automatic spoken language processing. The chapter describes the combination of the two signed language technologies in real-world applications. Most importantly, it explores the potential application of each technology to second language (L2) signed language assessment. Finally, an example of an existing use case is given: the application of signed language recognition to a vocabulary test for adult L2 learners of Swiss German Sign Language.","PeriodicalId":150857,"journal":{"name":"The Handbook of Language Assessment Across Modalities","volume":"101 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114892254","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
C. Chapelle, P. Hauser, Hye-won Lee, C. Rathmann, Krister Schönström
{"title":"Discussion of Validation Issues in Signed and Spoken Assessments for Adult L2 Learners","authors":"C. Chapelle, P. Hauser, Hye-won Lee, C. Rathmann, Krister Schönström","doi":"10.1093/oso/9780190885052.003.0025","DOIUrl":"https://doi.org/10.1093/oso/9780190885052.003.0025","url":null,"abstract":"The use of argument-based validity as a framework for discussion of validity issues in spoken and signed second language (L2) assessment reveals many areas of commonality. Common areas include the role of systematic test development practices in the validity argument, the complexity of rating issues, the need to define and assess a construct of functional communication of meaning, and the centrality of test use in the validity argument. Examining these areas of commonality in this chapter reveals the fundamental similarities in the basic validity issues faced in spoken and signed language assessment. This chapter is a joint discussion of key items related to validation issues related to signed and spoken language assessment that were discussed in Chapters 8.1 and 8.2.","PeriodicalId":150857,"journal":{"name":"The Handbook of Language Assessment Across Modalities","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126275528","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Validation of Spoken Language Assessments for Adult L2 Learners","authors":"C. Chapelle, Hye-won Lee","doi":"10.1093/oso/9780190885052.003.0023","DOIUrl":"https://doi.org/10.1093/oso/9780190885052.003.0023","url":null,"abstract":"Assessments of second language speaking are used for a range of purposes, from assigning grades in language courses to certifying qualifications for employment and assessing readiness for university study. The types of validation efforts undertaken across language assessment contexts are equally wide-ranging. This chapter introduces the validation practices used to evaluate the degree to which interpretations and uses of test scores are justified in particular contexts. The types of validation practices are tied to the types of inferences that are made when tests of spoken language are used as well as the need to present empirical evidence and theoretical rationales to support the inferences.","PeriodicalId":150857,"journal":{"name":"The Handbook of Language Assessment Across Modalities","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114759245","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
T. Haug, E. Boers-Visker, W. Mann, Geoffrey S. Poor, Beppie van den Bogaerde
{"title":"Scoring Second Signed Language Assessment","authors":"T. Haug, E. Boers-Visker, W. Mann, Geoffrey S. Poor, Beppie van den Bogaerde","doi":"10.1093/oso/9780190885052.003.0027","DOIUrl":"https://doi.org/10.1093/oso/9780190885052.003.0027","url":null,"abstract":"There exists a scarcity in signed language assessment research, especially on scoring issues and interrater reliability. This chapter describes two related assessment instruments, the SLPI and the NFA, which offer scoring criteria. Raters are provided with scales for evaluating the different components of the language production of the candidate. Through its use, the rating system has been proved successful; there is, however, hardly any data on interrater reliability. In this chapter, the authors describe reliability issues with attention to raters’ training and score resolution techniques and discuss how to identify and increase rater reliability. The dearth of knowledge on signed language assessment, and in particular its validity and reliability, indicates an urgent need for more research in this area.","PeriodicalId":150857,"journal":{"name":"The Handbook of Language Assessment Across Modalities","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132555826","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Dynamic Assessment of Learners of a Spoken Language","authors":"Natalie Hasson","doi":"10.1093/oso/9780190885052.003.0008","DOIUrl":"https://doi.org/10.1093/oso/9780190885052.003.0008","url":null,"abstract":"Dynamic assessment (DA), or the assessment of learning potential, is becoming recognized as an alternative method that has wide application within the assessment of language. In moving away from comparison to normative data, the assessment enables a wider range of children to be assessed, including all of those for whom the norms do not apply, such as children with autistic spectrum conditions, attention deficit hyperactivity disorder (ADHD), hearing loss, and bi- or multilingual children. In addition to differentiating language difficulties due to lack of experience with the target language from developmental language disorders (DLD), the DA procedure contributes a considerable amount of qualitative information about the learning skills of the test-taker. This chapter reviews the multiple models and methods of DA and the work that has been done to develop tools to assess language skills in first language learners.","PeriodicalId":150857,"journal":{"name":"The Handbook of Language Assessment Across Modalities","volume":"421 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134440343","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Score Use and Interpretation of First Spoken Language Assessments","authors":"B. Camilleri","doi":"10.1093/oso/9780190885052.003.0005","DOIUrl":"https://doi.org/10.1093/oso/9780190885052.003.0005","url":null,"abstract":"Several elements are involved in collecting valid and reliable information about a child’s spoken language abilities. The use and interpretation of commercially available “standardized” spoken language assessments is but one of these elements and can only take place when assessments have been developed for use with the child’s language, something that is far from being a given in many countries and languages. This chapter discusses the use of norm-referenced and other types of standardized assessments (which may involve standardized administration but not normative data) for the assessment of different aspects or areas of children’s language. In addition, the ways in which scores and other data obtained from these assessments are interpreted and used for clinical decision-making will be reviewed, highlighting both the advantages and limitations of these assessments. Finally, the author considers the extent to which the use of standardized assessments within research and clinical contexts overlaps and/or diverges.","PeriodicalId":150857,"journal":{"name":"The Handbook of Language Assessment Across Modalities","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130178215","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Assessing Spoken Language Development in Children with Autism Spectrum Disorder","authors":"Amy Kissel Frisbie","doi":"10.1093/oso/9780190885052.003.0011","DOIUrl":"https://doi.org/10.1093/oso/9780190885052.003.0011","url":null,"abstract":"In this chapter, the author discusses assessment of language development in children with autism spectrum disorder (ASD). According to evidence-based practice, it is vital to evaluate all aspects of communication in order to determine a specific diagnosis or to direct intervention. While this is true for any child suspected of having a language impairment, it is especially true for children also diagnosed with ASD. Although there are a number of accepted standardized measures to evaluate receptive and expressive language and speech articulation, evaluation of pragmatic abilities is often more complicated. With the incidence of children and young adults with ASD, and social (pragmatic) communication disorders, on the rise in all settings, it is vital to thoughtfully consider best practice related to the thorough assessment of communication abilities for those with ASD, from our youngest learners to adolescents.","PeriodicalId":150857,"journal":{"name":"The Handbook of Language Assessment Across Modalities","volume":"2010 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127342996","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}