IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2024-10-29 DOI: 10.1177/10731911241280763

Erin M Buchanan

{"title":"Visualizemi: Visualization, Effect Size, and Replication of Measurement Invariance for Registered Reports.","authors":"Erin M Buchanan","doi":"10.1177/10731911241280763","DOIUrl":"10.1177/10731911241280763","url":null,"abstract":"Latent variable modeling as a lens for psychometric theory is a popular tool for social scientists to examine measurement of constructs. Journals, such as Assessment regularly publish articles supporting measures of latent constructs wherein a measurement model is established. Confirmatory factor analysis can be used to investigate the replicability and generalizability of the measurement model in new samples, while multigroup confirmatory factor analysis is used to examine the measurement model across groups within samples. With the rise of the replication crisis and \"psychology's renaissance,\" interest in divergence in measurement has increased, often focused on small parameter differences within the latent model. This article presents visualizemi, an R package that provides functionality to calculate multigroup models, partial invariance, visualizations for (non)-invariance, effect sizes for models and parameters, and potential replication rates compared with random models. Readers will learn how to interpret the impact and size of the proposed non-invariance in models with a focus on potential replication and how to plan for registered reports.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"190-205"},"PeriodicalIF":3.5,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142543378","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

How to Produce, Identify, and Motivate Robust Psychological Science: A Roadmap and a Response to Vize et al. 如何产生、识别和激励健全的心理科学：路线图和对维兹等人的回应。

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2024-11-29 DOI: 10.1177/10731911241299723

E David Klonsky

{"title":"How to Produce, Identify, and Motivate Robust Psychological Science: A Roadmap and a Response to Vize et al.","authors":"E David Klonsky","doi":"10.1177/10731911241299723","DOIUrl":"10.1177/10731911241299723","url":null,"abstract":"Some wish to mandate preregistration as a response to the replication crisis, while I and others caution that such mandates inadvertently cause harm and distract from more critical reforms. In this article, after briefly critiquing a recently published defense of preregistration mandates, I propose a three-part vision for cultivating a robust and cumulative psychological science. First, we must know how to produce robust rather than fragile findings. Key ingredients include sufficient sample sizes, valid measurement, and honesty/transparency. Second, we must know how to identify robust (and non-robust) findings. To this end, I reframe robustness checks broadly into four types: across analytic decisions, across measures, across samples, and across investigative teams. Third, we must be motivated to produce and care about robust science. This aim requires marshaling sociocultural forces to support, reward, and celebrate the production of robust findings, just as we once rewarded flashy but fragile findings. Critically, these sociocultural reinforcements must be tied as closely as possible to rigor and robustness themselves-rather than cosmetic indicators of rigor and robustness, as we have done in the past.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"244-252"},"PeriodicalIF":3.5,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142754457","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Portable Touchscreen Assessment of Motor Skill: A Registered Report of the Reliability and Validity of EDNA MoTap. 便携式触摸屏运动技能评估：关于 EDNA MoTap 可靠性和有效性的注册报告。

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2024-07-29 DOI: 10.1177/10731911241266306

Thomas B McGuckian, Jade Laracas, Nadine Roseboom, Sophie Eichler, Szymon Kardas, Stefan Piantella, Michael H Cole, Ross Eldridge, Jonathan Duckworth, Bert Steenbergen, Dido Green, Peter H Wilson

{"title":"Portable Touchscreen Assessment of Motor Skill: A Registered Report of the Reliability and Validity of EDNA MoTap.","authors":"Thomas B McGuckian, Jade Laracas, Nadine Roseboom, Sophie Eichler, Szymon Kardas, Stefan Piantella, Michael H Cole, Ross Eldridge, Jonathan Duckworth, Bert Steenbergen, Dido Green, Peter H Wilson","doi":"10.1177/10731911241266306","DOIUrl":"10.1177/10731911241266306","url":null,"abstract":"Portable and flexible administration of manual dexterity assessments is necessary to monitor recovery from brain injury and the effects of interventions across clinic and home settings, especially when in-person testing is not possible or convenient. This paper aims to assess the concurrent validity and test-retest reliability of a new suite of touchscreen-based manual dexterity tests (called EDNA™MoTap) that are designed for portable and efficient administration. A minimum sample of 49 healthy young adults will be conveniently recruited. The EDNA™MoTap tasks will be assessed for concurrent validity against standardized tools (the Box and Block Test [BBT] and the Purdue Pegboard Test) and for test-retest reliability over a 1- to 2-week interval. Correlation coefficients of r > .6 will indicate acceptable validity, and intraclass correlation coefficient (ICC) values > .75 will indicate acceptable reliability for healthy adults. The sample were primarily right-handed (91%) adults aged 19 and 34 years (M = 24.93, SD = 4.21, 50% female). The MoTap tasks did not demonstrate acceptable validity, with tasks showing weak-to-moderate associations with the criterion assessments. Some outcomes demonstrated acceptable test-retest reliability; however, this was not consistent. Touchscreen-based assessments of dexterity remain relevant; however, there is a need for further development of the EDNA™MoTap task administration.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"269-282"},"PeriodicalIF":3.5,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141791778","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Good Fit Is Weak Evidence of Replication: Increasing Rigor Through Prior Predictive Similarity Checking. 拟合度高就是复制的证据不足：通过事先预测的相似性检查提高严谨性。

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2024-03-14 DOI: 10.1177/10731911241234118

Wes Bonifay, Sonja D Winter, Hanamori F Skoblow, Ashley L Watts

{"title":"Good Fit Is Weak Evidence of Replication: Increasing Rigor Through Prior Predictive Similarity Checking.","authors":"Wes Bonifay, Sonja D Winter, Hanamori F Skoblow, Ashley L Watts","doi":"10.1177/10731911241234118","DOIUrl":"10.1177/10731911241234118","url":null,"abstract":"Replication provides a confrontation of psychological theory, not only in experimental research, but also in model-based research. Goodness of fit (GOF) of the original model to the replication data is routinely provided as meaningful evidence of replication. We demonstrate, however, that GOF obscures important differences between the original and replication studies. As an alternative, we present Bayesian prior predictive similarity checking: a tool for rigorously evaluating the degree to which the data patterns and parameter estimates of a model replication study resemble those of the original study. We apply this method to original and replication data from the National Comorbidity Survey. Both data sets yielded excellent GOF, but the similarity checks often failed to support close or approximate empirical replication, especially when examining covariance patterns and indicator thresholds. We conclude with recommendations for applied research, including registered reports of model-based research, and provide extensive annotated R code to facilitate future applications of prior predictive similarity checking.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"170-189"},"PeriodicalIF":3.5,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140130643","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

From Confirmation to Theory: Introduction to the Special Section on "Assessment, Measurement, and Registered Replication".

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2025-02-10 DOI: 10.1177/10731911251320053

Kristian E Markon, Thomas Olino

引用次数: 0

Campbell's Law Explains the Replication Crisis: Pre-Registration Badges Are History Repeating. 坎贝尔定律解释了复制危机：预注册徽章是历史的重演。

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2024-05-23 DOI: 10.1177/10731911241253430

E David Klonsky

{"title":"Campbell's Law Explains the Replication Crisis: Pre-Registration Badges Are History Repeating.","authors":"E David Klonsky","doi":"10.1177/10731911241253430","DOIUrl":"10.1177/10731911241253430","url":null,"abstract":"Campbell's Law explains the replication crisis. In brief, useful tools such as hypotheses, p-values, and multi-study designs came to be viewed as indicators of strong science, and thus goals in and of themselves. Consequently, their use became distorted in unanticipated ways (e.g., hypothesizing after results were known [HARKing], p-Hacking, misuses of researcher degrees of freedom), and fragile findings proliferated. Pre-registration mandates are positioned as an antidote. However, I argue that such efforts, perhaps best exemplified by pre-registration badges (PRBs), are history repeating: Another useful tool has been converted into an indicator of strong science and a goal in and of itself. This, too, will distort its use and harm psychological science in unanticipated ways. For example, there is already evidence that papers seeking PRBs routinely violate the rules and spirit of pre-registration. I suggest that pre-registration mandates will (a) discourage optimal scientific practice, (b) exacerbate the file drawer problem, (c) encourage pre-registering after results are known (PRARKing), and (d) create false trust in fragile findings. I conclude that multiple design features can help support replicability (e.g., adequate sample size, valid measurement, robustness checks, pre-registration), none should be canonized, replication is the only arbiter of replicability, and the most important solution is sociocultural: to foster a field that reveres and reinforces robust science-just as we once revered and reinforced flashy but fragile science.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"224-234"},"PeriodicalIF":3.5,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141086411","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The Effect of Different Construct Operationalizations, Study Duration, and Preprocessing Choices on Power-Based Sample Size Recommendations in Intensive Longitudinal Research. 不同的结构操作、研究持续时间和预处理选择对密集纵向研究中基于功率的样本量建议的影响。

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2024-11-14 DOI: 10.1177/10731911241286868

Ginette Lafit, Jordan Revol, Leonie Cloos, Peter Kuppens, Eva Ceulemans

{"title":"The Effect of Different Construct Operationalizations, Study Duration, and Preprocessing Choices on Power-Based Sample Size Recommendations in Intensive Longitudinal Research.","authors":"Ginette Lafit, Jordan Revol, Leonie Cloos, Peter Kuppens, Eva Ceulemans","doi":"10.1177/10731911241286868","DOIUrl":"10.1177/10731911241286868","url":null,"abstract":"To shed light on the dynamics of psychological processes, researchers often collect intensive longitudinal (IL) data by asking people to repeatedly report on their momentary experiences in daily life. Two important decisions when designing an IL study concern the number of persons and the number of measurement occasions to be included. These sample size decisions are ideally based on statistical power considerations. When conducting statistical power analysis, it is necessary to provide the value of the effect size of interest as well as of all other model parameters. In IL research, these values have to be based on previous studies. This implies that these values are subject to large heterogeneity due to differences in study design and preprocessing choices. This between-study heterogeneity can severely impact power-based sample size recommendations. In this article, we introduce an approach to investigate the impact of study design and pre-processing of previous studies and to determine a recommended sample size to account for this impact. We demonstrate how to use this approach to investigate the effect of different construct operationalizations, study duration, and preprocessing choices. This approach paves the way for more thoughtful and robust sample-size decisions.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"206-223"},"PeriodicalIF":3.5,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142613862","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Examining the Structure of Personality Dysfunction Among Individuals Involved in Mental Health treatment: A Registered Report. 研究接受心理健康治疗者的人格功能障碍结构：注册报告。

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2024-12-14 DOI: 10.1177/10731911241301475

Ashmita Ghosh, Nathaniel L Phillips, Chelsea E Sleep, Donald R Lynam, Joshua D Miller

{"title":"Examining the Structure of Personality Dysfunction Among Individuals Involved in Mental Health treatment: A Registered Report.","authors":"Ashmita Ghosh, Nathaniel L Phillips, Chelsea E Sleep, Donald R Lynam, Joshua D Miller","doi":"10.1177/10731911241301475","DOIUrl":"10.1177/10731911241301475","url":null,"abstract":"Personality dysfunction is a core element of the diagnosis of personality disorders in both main diagnostic systems (Diagnostic and Statistical Manual of Mental Disorders [5th ed.] Personality Disorders and ICD-11 [International Classification of Diseases, 11th Revision] Personality Disorders). A recent study by Sleep et al. explored the structure of personality dysfunction (N = 517 undergraduates) with exploratory bass-ackward factor analyses at the item level using items from six measures of personality functioning. The present study represents a replication of the study by Sleep and colleagues in a community sample of individuals currently in or seeking psychological/psychiatric treatment. Participants were recruited from Prolific who completed items from six measures of personality dysfunction (N = 457). The primary factor analysis identified three lower-order factors of impairment (Negative Self-Regard, Disagreeableness, and Intimacy Problems). These dysfunction factors showed moderate to strong relations to the factors generated by Sleep et al.; however, there were important differences in the overall structure suggesting a lack of formal replication.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"283-299"},"PeriodicalIF":3.5,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142823622","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The Structural Validity of the Barkley Deficits in Executive Functioning Scale-Short Form Among College Students Who Drink Alcohol. 饮酒大学生的巴克利执行功能缺陷量表-简表的结构有效性。

IF 3.5 2区心理学

Assessment Pub Date : 2025-02-28 DOI: 10.1177/10731911251316468

Alexandra Hernandez-Vallant, Margo C Hurlocker, Alison Looby, Byron L Zamboanga

引用次数: 0

Psychometric and Normative Information on the Child and Adolescent Behavior Inventory With Parent Ratings in a Nationally Representative Sample of Spanish Youth.

IF 3.5 2区心理学

Assessment Pub Date : 2025-02-24 DOI: 10.1177/10731911251317785

G Leonard Burns, Juan José Montaño, Stephen P Becker, Mateu Servera

{"title":"Psychometric and Normative Information on the Child and Adolescent Behavior Inventory With Parent Ratings in a Nationally Representative Sample of Spanish Youth.","authors":"G Leonard Burns, Juan José Montaño, Stephen P Becker, Mateu Servera","doi":"10.1177/10731911251317785","DOIUrl":"https://doi.org/10.1177/10731911251317785","url":null,"abstract":"Psychometric and normative information is provided for the Child and Adolescent Behavior Inventory (CABI) cognitive disengagement syndrome, anxiety, depression, attention-deficit/hyperactivity disorder (ADHD)-inattention, ADHD-hyperactivity/impulsivity, oppositional defiant disorder, social impairment, peer rejection, withdrawal from peer interactions, and academic impairment scales with a nationally representative sample of Spanish youth. Parents of 5,525 Spanish youth (ages 5-16, 56.1% males) completed the CABI scales on their sons and daughters. Scores on the 10 CABI scales demonstrated excellent reliability, invariance, and validity for males and females within early childhood (ages 5-8), middle childhood (ages 9-12), and adolescence (ages 13-16). Normative information (T-scores) is provided for females and males within each age group for the 10 CABI scales. The new psychometric and normative information increase the usefulness of the CABI scale scores for research and clinical activities. Copies of the CABI and the norms are available at no cost to professionals.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911251317785"},"PeriodicalIF":3.5,"publicationDate":"2025-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143481990","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Assessment最新文献