{"title":"通过基于计算机的评估中的过程数据评估多种能力:多维顺序响应模型(MSRM)。","authors":"Yuting Han, Feng Ji, Pujue Wang, Hongyun Liu","doi":"10.3758/s13428-025-02658-7","DOIUrl":null,"url":null,"abstract":"<p><p>With the advent of computer-based assessment (CBA), process data have assumed an increasingly pivotal role in estimating examinees' latent abilities by capturing detailed records of their response processes. This study introduces the Multidimensional sequential response model (MSRM), a novel model for assessing multiple abilities through process data in computer-based cognitive and psychological assessments. A Bayesian estimation method for the MSRM is proposed and examined through a Monte Carlo simulation study across varying conditions. The results suggest that the MSRM's parameter estimation demonstrates adequate accuracy and computational efficiency, with estimation quality improving as sample sizes and sequence lengths increase. We demonstrate the practical utility of MSRM through two empirical studies, showing that it can be effectively applied in various contexts. This methodology provides valuable insights for tailored instruction by offering detailed assessments of ability mastery across multiple dimensions, thereby supporting more targeted educational interventions.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 5","pages":"152"},"PeriodicalIF":4.6000,"publicationDate":"2025-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Assessing multiple abilities through process data in computer-based assessments: The multidimensional sequential response model (MSRM).\",\"authors\":\"Yuting Han, Feng Ji, Pujue Wang, Hongyun Liu\",\"doi\":\"10.3758/s13428-025-02658-7\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>With the advent of computer-based assessment (CBA), process data have assumed an increasingly pivotal role in estimating examinees' latent abilities by capturing detailed records of their response processes. This study introduces the Multidimensional sequential response model (MSRM), a novel model for assessing multiple abilities through process data in computer-based cognitive and psychological assessments. A Bayesian estimation method for the MSRM is proposed and examined through a Monte Carlo simulation study across varying conditions. The results suggest that the MSRM's parameter estimation demonstrates adequate accuracy and computational efficiency, with estimation quality improving as sample sizes and sequence lengths increase. We demonstrate the practical utility of MSRM through two empirical studies, showing that it can be effectively applied in various contexts. This methodology provides valuable insights for tailored instruction by offering detailed assessments of ability mastery across multiple dimensions, thereby supporting more targeted educational interventions.</p>\",\"PeriodicalId\":8717,\"journal\":{\"name\":\"Behavior Research Methods\",\"volume\":\"57 5\",\"pages\":\"152\"},\"PeriodicalIF\":4.6000,\"publicationDate\":\"2025-04-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Behavior Research Methods\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.3758/s13428-025-02658-7\",\"RegionNum\":2,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHOLOGY, EXPERIMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Behavior Research Methods","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.3758/s13428-025-02658-7","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, EXPERIMENTAL","Score":null,"Total":0}
Assessing multiple abilities through process data in computer-based assessments: The multidimensional sequential response model (MSRM).
With the advent of computer-based assessment (CBA), process data have assumed an increasingly pivotal role in estimating examinees' latent abilities by capturing detailed records of their response processes. This study introduces the Multidimensional sequential response model (MSRM), a novel model for assessing multiple abilities through process data in computer-based cognitive and psychological assessments. A Bayesian estimation method for the MSRM is proposed and examined through a Monte Carlo simulation study across varying conditions. The results suggest that the MSRM's parameter estimation demonstrates adequate accuracy and computational efficiency, with estimation quality improving as sample sizes and sequence lengths increase. We demonstrate the practical utility of MSRM through two empirical studies, showing that it can be effectively applied in various contexts. This methodology provides valuable insights for tailored instruction by offering detailed assessments of ability mastery across multiple dimensions, thereby supporting more targeted educational interventions.
期刊介绍:
Behavior Research Methods publishes articles concerned with the methods, techniques, and instrumentation of research in experimental psychology. The journal focuses particularly on the use of computer technology in psychological research. An annual special issue is devoted to this field.