British Journal of Mathematical & Statistical Psychology最新文献_第10页

Compromised item detection: A Bayesian change-point perspective 折衷项目检测:贝叶斯变更点视角

IF 2.6 3区心理学

British Journal of Mathematical & Statistical Psychology Pub Date : 2022-09-07 DOI: 10.1111/bmsp.12286

Yang Du, Susu Zhang, Hua-Hua Chang

{"title":"Compromised item detection: A Bayesian change-point perspective","authors":"Yang Du, Susu Zhang, Hua-Hua Chang","doi":"10.1111/bmsp.12286","DOIUrl":"10.1111/bmsp.12286","url":null,"abstract":"Psychometric methods for accurate and timely detection of item compromise have been a long-standing topic. While Bayesian methods can incorporate prior knowledge or expert inputs as additional information for item compromise detection, they have not been employed in item compromise detection itself. The current study proposes a two-phase Bayesian change-point framework for both stationary and real-time detection of changes in each item's compromise status. In Phase I, a stationary Bayesian change-point model for compromise detection is fitted to the observed responses over a specified time-frame. The model produces parameter estimates for the change-point of each item from uncompromised to compromised, as well as structural parameters accounting for the post-change response distribution. Using the post-change model identified in Phase I, the Shiryaev procedure for sequential testing is employed in Phase II for real-time monitoring of item compromise. The proposed methods are evaluated in terms of parameter recovery, detection accuracy, and detection efficiency under various simulation conditions and in a real data example. The proposed method also showed superior detection accuracy and efficiency compared to the cumulative sum procedure.","PeriodicalId":55322,"journal":{"name":"British Journal of Mathematical & Statistical Psychology","volume":"76 1","pages":"131-153"},"PeriodicalIF":2.6,"publicationDate":"2022-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/59/dc/BMSP-76-131.PMC10086862.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9640555","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

The biasing effects of selection and attrition on estimating the mean 选择和损耗对估计平均值的偏置效应

IF 2.6 3区心理学

British Journal of Mathematical & Statistical Psychology Pub Date : 2022-08-07 DOI: 10.1111/bmsp.12284

Seunghoo Lee, Jorge Mendoza

{"title":"The biasing effects of selection and attrition on estimating the mean","authors":"Seunghoo Lee, Jorge Mendoza","doi":"10.1111/bmsp.12284","DOIUrl":"10.1111/bmsp.12284","url":null,"abstract":"Organizational and validation researchers often work with data that has been subjected to selection on the predictor and attrition on the criterion. These researchers often use the data observed under these conditions to estimate either the predictor or criterion's restricted population means. We show that the restricted means due to direct or indirect selection are a function of the population means plus the selection ratios. Thus, any difference between selected mean groups reflects the population difference plus the selection ratio difference. When there is also attrition on the criterion, the estimation of group differences becomes even more complicated. The effect of selection and attrition induces measurement bias when estimating the restricted population mean of either the predictor or criterion. A sample mean observed under selection and attrition does not estimate either the population mean or the restricted population mean. We propose several procedures under normality that yield unbiased estimates of the mean. The procedures focus on correcting the effects of selection and attrition. Each procedure was evaluated with a Monte Carlo simulation to ascertain its strengths and weaknesses. Given appropriate sample size and conditions, we show that these procedures yield unbiased estimators of the restricted and unrestricted population means for both predictor and criterion. We also show how our findings have implications for replicating selected group differences.","PeriodicalId":55322,"journal":{"name":"British Journal of Mathematical & Statistical Psychology","volume":"76 1","pages":"106-130"},"PeriodicalIF":2.6,"publicationDate":"2022-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9091018","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

CD-polytomous knowledge spaces and corresponding polytomous surmise systems cd -多分知识空间和相应的多分猜测系统

IF 2.6 3区心理学

British Journal of Mathematical & Statistical Psychology Pub Date : 2022-07-29 DOI: 10.1111/bmsp.12283

Bo Wang, Jinjin Li, Wen Sun

{"title":"CD-polytomous knowledge spaces and corresponding polytomous surmise systems","authors":"Bo Wang, Jinjin Li, Wen Sun","doi":"10.1111/bmsp.12283","DOIUrl":"10.1111/bmsp.12283","url":null,"abstract":"Heller (2021) generalized quasi-ordinal knowledge spaces to polytomous items. Inspired by this paper, we propose CD-polytomous knowledge space and its polytomous surmise system. A Galois connection is established between the collection <math>\u0000 <semantics>\u0000 <mrow>\u0000 <mi>K</mi>\u0000 </mrow>\u0000 </semantics></math> of all polytomous knowledge structures and the collection <math>\u0000 <semantics>\u0000 <mrow>\u0000 <msub>\u0000 <mi>F</mi>\u0000 <mn>1</mn>\u0000 </msub>\u0000 </mrow>\u0000 </semantics></math> of particular polytomous attribute functions. The closed elements of the Galois connection are CD-polytomous knowledge spaces in <math>\u0000 <semantics>\u0000 <mrow>\u0000 <mi>K</mi>\u0000 </mrow>\u0000 </semantics></math> and polytomous surmise functions in <math>\u0000 <semantics>\u0000 <mrow>\u0000 <msub>\u0000 <mi>F</mi>\u0000 <mn>1</mn>\u0000 </msub>\u0000 </mrow>\u0000 </semantics></math>, respectively. With the help of these, this paper provides a characterization of the polytomous knowledge structure corresponding to the polytomous surmise function that is weakly factorial. Based on the finite sets of items and response values, these results generalize the previous approaches for polytomous knowledge spaces.","PeriodicalId":55322,"journal":{"name":"British Journal of Mathematical & Statistical Psychology","volume":"76 1","pages":"87-105"},"PeriodicalIF":2.6,"publicationDate":"2022-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10509096","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

Item selection methods with exposure and time control for computerized classification test 计算机分类测验中具有曝光和时间控制的选题方法

IF 2.6 3区心理学

British Journal of Mathematical & Statistical Psychology Pub Date : 2022-07-15 DOI: 10.1111/bmsp.12281

Yingshi Huang, He Ren, Ping Chen

引用次数: 0

Modelling multiple problem-solving strategies and strategy shift in cognitive diagnosis for growth 多问题解决策略建模与成长认知诊断中的策略转换

IF 2.6 3区心理学

British Journal of Mathematical & Statistical Psychology Pub Date : 2022-07-10 DOI: 10.1111/bmsp.12280

Manqian Liao, Hong Jiao

{"title":"Modelling multiple problem-solving strategies and strategy shift in cognitive diagnosis for growth","authors":"Manqian Liao, Hong Jiao","doi":"10.1111/bmsp.12280","DOIUrl":"10.1111/bmsp.12280","url":null,"abstract":"Problem-solving strategies, defined as actions people select intentionally to achieve desired objectives, are distinguished from skills that are implemented unintentionally. In education, strategy-oriented instructions that guide students to form problem-solving strategies are found to be more effective for low-achieving students than the skill-oriented instructions designed for enhancing their skill implementation ability. Although the existing longitudinal cognitive diagnosis models (CDMs) can model the change in students' dynamic skill mastery status over time, they are not designed to model the shift in students' problem-solving strategies. This study proposes a longitudinal CDM that considers both between-person multiple strategies and within-person strategy shift. The model, separating the strategy choice process from the skill implementation process, is intended to provide diagnostic information on strategy choice as well as skill mastery status. A simulation study is conducted to evaluate the parameter recovery of the proposed model and investigate the consequences of ignoring the presence of multiple strategies or strategy shift. Further, an empirical data analysis is conducted to illustrate the use of the proposed model to measure strategy shift, growth in skill implementation ability and skill mastery status.","PeriodicalId":55322,"journal":{"name":"British Journal of Mathematical & Statistical Psychology","volume":"76 1","pages":"20-51"},"PeriodicalIF":2.6,"publicationDate":"2022-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10566849","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Flexible Bayesian modelling in dichotomous item response theory using mixtures of skewed item curves 基于混合倾斜项目曲线的二分类项目反应理论中的灵活贝叶斯建模

IF 2.6 3区心理学

British Journal of Mathematical & Statistical Psychology Pub Date : 2022-07-05 DOI: 10.1111/bmsp.12282

Flávio B. Gonçalves, Juliane Venturelli S. L., Rosangela H. Loschi

{"title":"Flexible Bayesian modelling in dichotomous item response theory using mixtures of skewed item curves","authors":"Flávio B. Gonçalves, Juliane Venturelli S. L., Rosangela H. Loschi","doi":"10.1111/bmsp.12282","DOIUrl":"10.1111/bmsp.12282","url":null,"abstract":"Most item response theory (IRT) models for dichotomous responses are based on probit or logit link functions which assume a symmetric relationship between the probability of a correct response and the latent traits of individuals taking a test. This assumption restricts the use of those models to the case in which all items behave symmetrically. On the other hand, asymmetric models proposed in the literature impose that all the items in a test behave asymmetrically. This assumption is inappropriate for great majority of tests which are, in general, composed of both symmetric and asymmetric items. Furthermore, a straightforward extension of the existing models in the literature would require a prior selection of the items' symmetry/asymmetry status. This paper proposes a Bayesian IRT model that accounts for symmetric and asymmetric items in a flexible but parsimonious way. That is achieved by assigning a finite mixture prior to the skewness parameter, with one of the mixture components being a point mass at zero. This allows for analyses under both model selection and model averaging approaches. Asymmetric item curves are designed through the centred skew normal distribution, which has a particularly appealing parametrization in terms of parameter interpretation and computational efficiency. An efficient Markov chain Monte Carlo algorithm is proposed to perform Bayesian inference and its performance is investigated in some simulated examples. Finally, the proposed methodology is applied to a data set from a large-scale educational exam in Brazil.","PeriodicalId":55322,"journal":{"name":"British Journal of Mathematical & Statistical Psychology","volume":"76 1","pages":"69-86"},"PeriodicalIF":2.6,"publicationDate":"2022-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10511589","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

An explanatory mixture IRT model for careless and insufficient effort responding in self-report measures 自我报告测量中粗心和不充分努力反应的解释性混合IRT模型

IF 2.6 3区心理学

British Journal of Mathematical & Statistical Psychology Pub Date : 2022-06-22 DOI: 10.1111/bmsp.12272

Esther Ulitzsch, Seyma Nur Yildirim-Erbasli, Guher Gorgun, Okan Bulut

{"title":"An explanatory mixture IRT model for careless and insufficient effort responding in self-report measures","authors":"Esther Ulitzsch, Seyma Nur Yildirim-Erbasli, Guher Gorgun, Okan Bulut","doi":"10.1111/bmsp.12272","DOIUrl":"10.1111/bmsp.12272","url":null,"abstract":"Careless and insufficient effort responding (C/IER) on self-report measures results in responses that do not reflect the trait to be measured, thereby posing a major threat to the quality of survey data. Reliable approaches for detecting C/IER aid in increasing the validity of inferences being made from survey data. First, once detected, C/IER can be taken into account in data analysis. Second, approaches for detecting C/IER support a better understanding of its occurrence, which facilitates designing surveys that curb the prevalence of C/IER. Previous approaches for detecting C/IER are limited in that they identify C/IER at the aggregate respondent or scale level, thereby hindering investigations of item characteristics evoking C/IER. We propose an explanatory mixture item response theory model that supports identifying and modelling C/IER at the respondent-by-item level, can detect a wide array of C/IER patterns, and facilitates a deeper understanding of item characteristics associated with its occurrence. As the approach only requires raw response data, it is applicable to data from paper-and-pencil and online surveys. The model shows good parameter recovery and can well handle the simultaneous occurrence of multiple types of C/IER patterns in simulated data. The approach is illustrated on a publicly available Big Five inventory data set, where we found later item positions to be associated with higher C/IER probabilities. We gathered initial supporting validity evidence for the proposed approach by investigating agreement with multiple commonly employed indicators of C/IER.","PeriodicalId":55322,"journal":{"name":"British Journal of Mathematical & Statistical Psychology","volume":"75 3","pages":"668-698"},"PeriodicalIF":2.6,"publicationDate":"2022-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://bpspsychub.onlinelibrary.wiley.com/doi/epdf/10.1111/bmsp.12272","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40163455","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 8

A flexible approach to modelling over-, under- and equidispersed count data in IRT: The Two-Parameter Conway–Maxwell–Poisson Model 在IRT中对过分散、欠分散和等分散计数数据建模的一种灵活方法:双参数康威-麦克斯韦-泊松模型

IF 2.6 3区心理学

British Journal of Mathematical & Statistical Psychology Pub Date : 2022-06-09 DOI: 10.1111/bmsp.12273

Marie Beisemann

{"title":"A flexible approach to modelling over-, under- and equidispersed count data in IRT: The Two-Parameter Conway–Maxwell–Poisson Model","authors":"Marie Beisemann","doi":"10.1111/bmsp.12273","DOIUrl":"10.1111/bmsp.12273","url":null,"abstract":"Several psychometric tests and self-reports generate count data (e.g., divergent thinking tasks). The most prominent count data item response theory model, the Rasch Poisson Counts Model (RPCM), is limited in applicability by two restrictive assumptions: equal item discriminations and equidispersion (conditional mean equal to conditional variance). Violations of these assumptions lead to impaired reliability and standard error estimates. Previous work generalized the RPCM but maintained some limitations. The two-parameter Poisson counts model allows for varying discriminations but retains the equidispersion assumption. The Conway–Maxwell–Poisson Counts Model allows for modelling over- and underdispersion (conditional mean less than and greater than conditional variance, respectively) but still assumes constant discriminations. The present work introduces the Two-Parameter Conway–Maxwell–Poisson (2PCMP) model which generalizes these three models to allow for varying discriminations and dispersions within one model, helping to better accommodate data from count data tests and self-reports. A marginal maximum likelihood method based on the EM algorithm is derived. An implementation of the 2PCMP model in R and C++ is provided. Two simulation studies examine the model's statistical properties and compare the 2PCMP model to established models. Data from divergent thinking tasks are reanalysed with the 2PCMP model to illustrate the model's flexibility and ability to test assumptions of special cases.","PeriodicalId":55322,"journal":{"name":"British Journal of Mathematical & Statistical Psychology","volume":"75 3","pages":"411-443"},"PeriodicalIF":2.6,"publicationDate":"2022-06-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://bpspsychub.onlinelibrary.wiley.com/doi/epdf/10.1111/bmsp.12273","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9545874","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

Score-based measurement invariance checks for Bayesian maximum-a-posteriori estimates in item response theory 项目反应理论中贝叶斯最大后验估计的基于分数的测量不变性检验

IF 2.6 3区心理学

British Journal of Mathematical & Statistical Psychology Pub Date : 2022-06-06 DOI: 10.1111/bmsp.12275

Rudolf Debelak, Samuel Pawel, Carolin Strobl, Edgar C. Merkle

引用次数: 0

Tracking a multitude of abilities as they develop 跟踪各种能力的发展

IF 2.6 3区心理学

British Journal of Mathematical & Statistical Psychology Pub Date : 2022-06-05 DOI: 10.1111/bmsp.12276

Maria Bolsinova, Matthieu J. S. Brinkhuis, Abe D. Hofman, Gunter Maris

{"title":"Tracking a multitude of abilities as they develop","authors":"Maria Bolsinova, Matthieu J. S. Brinkhuis, Abe D. Hofman, Gunter Maris","doi":"10.1111/bmsp.12276","DOIUrl":"10.1111/bmsp.12276","url":null,"abstract":"Recently, the Urnings algorithm (Bolsinova et al., 2022, J. R. Stat. Soc. Ser. C Appl. Statistics, 71, 91) has been proposed that allows for tracking the development of abilities of the learners and the difficulties of the items in adaptive learning systems. It is a simple and scalable algorithm which is suited for large-scale applications in which large streams of data are coming into the system and on-the-fly updating is needed. Compared to alternatives like the Elo rating system and its extensions, the Urnings rating system allows the uncertainty of the ratings to be evaluated and accounts for adaptive item selection which, if not corrected for, may distort the ratings. In this paper we extend the Urnings algorithm to allow for both between-item and within-item multidimensionality. This allows for tracking the development of interrelated abilities both at the individual and the population level. We present formal derivations of the multidimensional Urnings algorithm, illustrate its properties in simulations, and present an application to data from an adaptive learning system for primary school mathematics called Math Garden.","PeriodicalId":55322,"journal":{"name":"British Journal of Mathematical & Statistical Psychology","volume":"75 3","pages":"753-778"},"PeriodicalIF":2.6,"publicationDate":"2022-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9796260/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10454182","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0