George Kachergis, Virginia A Marchman, Philip S Dale, Jessica Mankewitz, Michael C Frank
{"title":"儿童英语和墨西哥西班牙语词汇发展在线计算机自适应测试。","authors":"George Kachergis, Virginia A Marchman, Philip S Dale, Jessica Mankewitz, Michael C Frank","doi":"10.1044/2022_JSLHR-21-00372","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Measuring the growth of young children's vocabulary is important for researchers seeking to understand language learning as well as for clinicians aiming to identify early deficits. The MacArthur-Bates Communicative Development Inventories (CDIs) are parent report instruments that offer a reliable and valid method for measuring early productive and receptive vocabulary across a number of languages. CDI forms typically include hundreds of words, however, and so the burden of completion is significant. We address this limitation by building on previous work using item response theory (IRT) models to create computer adaptive test (CAT) versions of the CDIs. We created CDI-CATs for both comprehension and production vocabulary, for both American English and Mexican Spanish.</p><p><strong>Method: </strong>Using a data set of 7,633 English-speaking children ages 12-36 months and 1,692 Spanish-speaking children ages 12-30 months, across three CDI forms (Words & Gestures, Words & Sentences, and CDI-III), we found that a 2-parameter logistic IRT model fits well for a majority of the 680 pooled vocabulary items. We conducted CAT simulations on this data set, assessing simulated tests of varying length (25-400 items).</p><p><strong>Results: </strong>Even very short CATs recovered participant abilities very well with little bias across ages. An empirical validation study with <i>N</i> = 204 children ages 15-36 months showed a correlation of <i>r</i> = .92 between language ability estimated from full CDI versus CDI-CAT forms.</p><p><strong>Conclusion: </strong>We provide our item bank along with fitted parameters and other details, offer recommendations for how to construct CDI-CATs in new languages, and suggest when this type of assessment may or may not be appropriate.</p>","PeriodicalId":46629,"journal":{"name":"Journal of Intervention and Statebuilding","volume":"4 1","pages":"2288-2308"},"PeriodicalIF":2.3000,"publicationDate":"2022-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9567402/pdf/","citationCount":"0","resultStr":"{\"title\":\"Online Computerized Adaptive Tests of Children's Vocabulary Development in English and Mexican Spanish.\",\"authors\":\"George Kachergis, Virginia A Marchman, Philip S Dale, Jessica Mankewitz, Michael C Frank\",\"doi\":\"10.1044/2022_JSLHR-21-00372\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>Measuring the growth of young children's vocabulary is important for researchers seeking to understand language learning as well as for clinicians aiming to identify early deficits. The MacArthur-Bates Communicative Development Inventories (CDIs) are parent report instruments that offer a reliable and valid method for measuring early productive and receptive vocabulary across a number of languages. CDI forms typically include hundreds of words, however, and so the burden of completion is significant. We address this limitation by building on previous work using item response theory (IRT) models to create computer adaptive test (CAT) versions of the CDIs. We created CDI-CATs for both comprehension and production vocabulary, for both American English and Mexican Spanish.</p><p><strong>Method: </strong>Using a data set of 7,633 English-speaking children ages 12-36 months and 1,692 Spanish-speaking children ages 12-30 months, across three CDI forms (Words & Gestures, Words & Sentences, and CDI-III), we found that a 2-parameter logistic IRT model fits well for a majority of the 680 pooled vocabulary items. We conducted CAT simulations on this data set, assessing simulated tests of varying length (25-400 items).</p><p><strong>Results: </strong>Even very short CATs recovered participant abilities very well with little bias across ages. An empirical validation study with <i>N</i> = 204 children ages 15-36 months showed a correlation of <i>r</i> = .92 between language ability estimated from full CDI versus CDI-CAT forms.</p><p><strong>Conclusion: </strong>We provide our item bank along with fitted parameters and other details, offer recommendations for how to construct CDI-CATs in new languages, and suggest when this type of assessment may or may not be appropriate.</p>\",\"PeriodicalId\":46629,\"journal\":{\"name\":\"Journal of Intervention and Statebuilding\",\"volume\":\"4 1\",\"pages\":\"2288-2308\"},\"PeriodicalIF\":2.3000,\"publicationDate\":\"2022-06-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9567402/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Intervention and Statebuilding\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1044/2022_JSLHR-21-00372\",\"RegionNum\":2,\"RegionCategory\":\"社会学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2022/6/3 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"INTERNATIONAL RELATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Intervention and Statebuilding","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1044/2022_JSLHR-21-00372","RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2022/6/3 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"INTERNATIONAL RELATIONS","Score":null,"Total":0}
Online Computerized Adaptive Tests of Children's Vocabulary Development in English and Mexican Spanish.
Purpose: Measuring the growth of young children's vocabulary is important for researchers seeking to understand language learning as well as for clinicians aiming to identify early deficits. The MacArthur-Bates Communicative Development Inventories (CDIs) are parent report instruments that offer a reliable and valid method for measuring early productive and receptive vocabulary across a number of languages. CDI forms typically include hundreds of words, however, and so the burden of completion is significant. We address this limitation by building on previous work using item response theory (IRT) models to create computer adaptive test (CAT) versions of the CDIs. We created CDI-CATs for both comprehension and production vocabulary, for both American English and Mexican Spanish.
Method: Using a data set of 7,633 English-speaking children ages 12-36 months and 1,692 Spanish-speaking children ages 12-30 months, across three CDI forms (Words & Gestures, Words & Sentences, and CDI-III), we found that a 2-parameter logistic IRT model fits well for a majority of the 680 pooled vocabulary items. We conducted CAT simulations on this data set, assessing simulated tests of varying length (25-400 items).
Results: Even very short CATs recovered participant abilities very well with little bias across ages. An empirical validation study with N = 204 children ages 15-36 months showed a correlation of r = .92 between language ability estimated from full CDI versus CDI-CAT forms.
Conclusion: We provide our item bank along with fitted parameters and other details, offer recommendations for how to construct CDI-CATs in new languages, and suggest when this type of assessment may or may not be appropriate.
期刊介绍:
The Journal of Intervention and Statebuilding is a cross-disciplinary journal devoted to critical analysis of international intervention, focussing on interactions and practices that shape, influence and transform states and societies. In 21st century political practice, states and other actors increasingly strive to transplant what they see as normatively progressive political orders to other contexts. Accordingly, JISB focuses on the complex interconnections and mutually shaping interactions between donor and recipient communities within military, economic, social, or other interventional contexts, and welcomes perspectives on political life of, and beyond, European state-building processes. The journal brings together academics and practitioners from cross-disciplinary backgrounds, including international relations, political science, political economy, sociology, international law, social anthropology, geography, and regional studies. The editors are particularly interested in specific or comparative in-depth analyses of contemporary or historical interventions and state-building processes that are grounded in careful fieldwork and/or innovative methodologies. Multi or cross-disciplinary contributions and theoretically challenging pieces that broaden the study of intervention and state building to encompass processes of decision-making, or the complex interplay between actors on the ground, are especially encouraged.