Assessment最新文献_第3页

Portable Touchscreen Assessment of Motor Skill: A Registered Report of the Reliability and Validity of EDNA MoTap. 便携式触摸屏运动技能评估：关于 EDNA MoTap 可靠性和有效性的注册报告。

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2024-07-29 DOI: 10.1177/10731911241266306

Thomas B McGuckian, Jade Laracas, Nadine Roseboom, Sophie Eichler, Szymon Kardas, Stefan Piantella, Michael H Cole, Ross Eldridge, Jonathan Duckworth, Bert Steenbergen, Dido Green, Peter H Wilson

{"title":"Portable Touchscreen Assessment of Motor Skill: A Registered Report of the Reliability and Validity of EDNA MoTap.","authors":"Thomas B McGuckian, Jade Laracas, Nadine Roseboom, Sophie Eichler, Szymon Kardas, Stefan Piantella, Michael H Cole, Ross Eldridge, Jonathan Duckworth, Bert Steenbergen, Dido Green, Peter H Wilson","doi":"10.1177/10731911241266306","DOIUrl":"10.1177/10731911241266306","url":null,"abstract":"Portable and flexible administration of manual dexterity assessments is necessary to monitor recovery from brain injury and the effects of interventions across clinic and home settings, especially when in-person testing is not possible or convenient. This paper aims to assess the concurrent validity and test-retest reliability of a new suite of touchscreen-based manual dexterity tests (called EDNA™MoTap) that are designed for portable and efficient administration. A minimum sample of 49 healthy young adults will be conveniently recruited. The EDNA™MoTap tasks will be assessed for concurrent validity against standardized tools (the Box and Block Test [BBT] and the Purdue Pegboard Test) and for test-retest reliability over a 1- to 2-week interval. Correlation coefficients of r > .6 will indicate acceptable validity, and intraclass correlation coefficient (ICC) values > .75 will indicate acceptable reliability for healthy adults. The sample were primarily right-handed (91%) adults aged 19 and 34 years (M = 24.93, SD = 4.21, 50% female). The MoTap tasks did not demonstrate acceptable validity, with tasks showing weak-to-moderate associations with the criterion assessments. Some outcomes demonstrated acceptable test-retest reliability; however, this was not consistent. Touchscreen-based assessments of dexterity remain relevant; however, there is a need for further development of the EDNA™MoTap task administration.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"269-282"},"PeriodicalIF":3.5,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11874617/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141791778","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Good Fit Is Weak Evidence of Replication: Increasing Rigor Through Prior Predictive Similarity Checking. 拟合度高就是复制的证据不足：通过事先预测的相似性检查提高严谨性。

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2024-03-14 DOI: 10.1177/10731911241234118

Wes Bonifay, Sonja D Winter, Hanamori F Skoblow, Ashley L Watts

{"title":"Good Fit Is Weak Evidence of Replication: Increasing Rigor Through Prior Predictive Similarity Checking.","authors":"Wes Bonifay, Sonja D Winter, Hanamori F Skoblow, Ashley L Watts","doi":"10.1177/10731911241234118","DOIUrl":"10.1177/10731911241234118","url":null,"abstract":"Replication provides a confrontation of psychological theory, not only in experimental research, but also in model-based research. Goodness of fit (GOF) of the original model to the replication data is routinely provided as meaningful evidence of replication. We demonstrate, however, that GOF obscures important differences between the original and replication studies. As an alternative, we present Bayesian prior predictive similarity checking: a tool for rigorously evaluating the degree to which the data patterns and parameter estimates of a model replication study resemble those of the original study. We apply this method to original and replication data from the National Comorbidity Survey. Both data sets yielded excellent GOF, but the similarity checks often failed to support close or approximate empirical replication, especially when examining covariance patterns and indicator thresholds. We conclude with recommendations for applied research, including registered reports of model-based research, and provide extensive annotated R code to facilitate future applications of prior predictive similarity checking.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"170-189"},"PeriodicalIF":3.5,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140130643","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

From Confirmation to Theory: Introduction to the Special Section on "Assessment, Measurement, and Registered Replication".

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2025-02-10 DOI: 10.1177/10731911251320053

Kristian E Markon, Thomas Olino

引用次数: 0

Campbell's Law Explains the Replication Crisis: Pre-Registration Badges Are History Repeating. 坎贝尔定律解释了复制危机：预注册徽章是历史的重演。

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2024-05-23 DOI: 10.1177/10731911241253430

E David Klonsky

{"title":"Campbell's Law Explains the Replication Crisis: Pre-Registration Badges Are History Repeating.","authors":"E David Klonsky","doi":"10.1177/10731911241253430","DOIUrl":"10.1177/10731911241253430","url":null,"abstract":"Campbell's Law explains the replication crisis. In brief, useful tools such as hypotheses, p-values, and multi-study designs came to be viewed as indicators of strong science, and thus goals in and of themselves. Consequently, their use became distorted in unanticipated ways (e.g., hypothesizing after results were known [HARKing], p-Hacking, misuses of researcher degrees of freedom), and fragile findings proliferated. Pre-registration mandates are positioned as an antidote. However, I argue that such efforts, perhaps best exemplified by pre-registration badges (PRBs), are history repeating: Another useful tool has been converted into an indicator of strong science and a goal in and of itself. This, too, will distort its use and harm psychological science in unanticipated ways. For example, there is already evidence that papers seeking PRBs routinely violate the rules and spirit of pre-registration. I suggest that pre-registration mandates will (a) discourage optimal scientific practice, (b) exacerbate the file drawer problem, (c) encourage pre-registering after results are known (PRARKing), and (d) create false trust in fragile findings. I conclude that multiple design features can help support replicability (e.g., adequate sample size, valid measurement, robustness checks, pre-registration), none should be canonized, replication is the only arbiter of replicability, and the most important solution is sociocultural: to foster a field that reveres and reinforces robust science-just as we once revered and reinforced flashy but fragile science.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"224-234"},"PeriodicalIF":3.5,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11874590/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141086411","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The Effect of Different Construct Operationalizations, Study Duration, and Preprocessing Choices on Power-Based Sample Size Recommendations in Intensive Longitudinal Research. 不同的结构操作、研究持续时间和预处理选择对密集纵向研究中基于功率的样本量建议的影响。

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2024-11-14 DOI: 10.1177/10731911241286868

Ginette Lafit, Jordan Revol, Leonie Cloos, Peter Kuppens, Eva Ceulemans

{"title":"The Effect of Different Construct Operationalizations, Study Duration, and Preprocessing Choices on Power-Based Sample Size Recommendations in Intensive Longitudinal Research.","authors":"Ginette Lafit, Jordan Revol, Leonie Cloos, Peter Kuppens, Eva Ceulemans","doi":"10.1177/10731911241286868","DOIUrl":"10.1177/10731911241286868","url":null,"abstract":"To shed light on the dynamics of psychological processes, researchers often collect intensive longitudinal (IL) data by asking people to repeatedly report on their momentary experiences in daily life. Two important decisions when designing an IL study concern the number of persons and the number of measurement occasions to be included. These sample size decisions are ideally based on statistical power considerations. When conducting statistical power analysis, it is necessary to provide the value of the effect size of interest as well as of all other model parameters. In IL research, these values have to be based on previous studies. This implies that these values are subject to large heterogeneity due to differences in study design and preprocessing choices. This between-study heterogeneity can severely impact power-based sample size recommendations. In this article, we introduce an approach to investigate the impact of study design and pre-processing of previous studies and to determine a recommended sample size to account for this impact. We demonstrate how to use this approach to investigate the effect of different construct operationalizations, study duration, and preprocessing choices. This approach paves the way for more thoughtful and robust sample-size decisions.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"206-223"},"PeriodicalIF":3.5,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142613862","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Examining the Structure of Personality Dysfunction Among Individuals Involved in Mental Health treatment: A Registered Report. 研究接受心理健康治疗者的人格功能障碍结构：注册报告。

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2024-12-14 DOI: 10.1177/10731911241301475

Ashmita Ghosh, Nathaniel L Phillips, Chelsea E Sleep, Donald R Lynam, Joshua D Miller

{"title":"Examining the Structure of Personality Dysfunction Among Individuals Involved in Mental Health treatment: A Registered Report.","authors":"Ashmita Ghosh, Nathaniel L Phillips, Chelsea E Sleep, Donald R Lynam, Joshua D Miller","doi":"10.1177/10731911241301475","DOIUrl":"10.1177/10731911241301475","url":null,"abstract":"Personality dysfunction is a core element of the diagnosis of personality disorders in both main diagnostic systems (Diagnostic and Statistical Manual of Mental Disorders [5th ed.] Personality Disorders and ICD-11 [International Classification of Diseases, 11th Revision] Personality Disorders). A recent study by Sleep et al. explored the structure of personality dysfunction (N = 517 undergraduates) with exploratory bass-ackward factor analyses at the item level using items from six measures of personality functioning. The present study represents a replication of the study by Sleep and colleagues in a community sample of individuals currently in or seeking psychological/psychiatric treatment. Participants were recruited from Prolific who completed items from six measures of personality dysfunction (N = 457). The primary factor analysis identified three lower-order factors of impairment (Negative Self-Regard, Disagreeableness, and Intimacy Problems). These dysfunction factors showed moderate to strong relations to the factors generated by Sleep et al.; however, there were important differences in the overall structure suggesting a lack of formal replication.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"283-299"},"PeriodicalIF":3.5,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142823622","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The Structural Validity of the Barkley Deficits in Executive Functioning Scale-Short Form Among College Students Who Drink Alcohol. 饮酒大学生的巴克利执行功能缺陷量表-简表的结构有效性。

IF 3.5 2区心理学

Assessment Pub Date : 2025-02-28 DOI: 10.1177/10731911251316468

Alexandra Hernandez-Vallant, Margo C Hurlocker, Alison Looby, Byron L Zamboanga

引用次数: 0

Psychometric and Normative Information on the Child and Adolescent Behavior Inventory With Parent Ratings in a Nationally Representative Sample of Spanish Youth.

IF 3.5 2区心理学

Assessment Pub Date : 2025-02-24 DOI: 10.1177/10731911251317785

G Leonard Burns, Juan José Montaño, Stephen P Becker, Mateu Servera

{"title":"Psychometric and Normative Information on the Child and Adolescent Behavior Inventory With Parent Ratings in a Nationally Representative Sample of Spanish Youth.","authors":"G Leonard Burns, Juan José Montaño, Stephen P Becker, Mateu Servera","doi":"10.1177/10731911251317785","DOIUrl":"https://doi.org/10.1177/10731911251317785","url":null,"abstract":"Psychometric and normative information is provided for the Child and Adolescent Behavior Inventory (CABI) cognitive disengagement syndrome, anxiety, depression, attention-deficit/hyperactivity disorder (ADHD)-inattention, ADHD-hyperactivity/impulsivity, oppositional defiant disorder, social impairment, peer rejection, withdrawal from peer interactions, and academic impairment scales with a nationally representative sample of Spanish youth. Parents of 5,525 Spanish youth (ages 5-16, 56.1% males) completed the CABI scales on their sons and daughters. Scores on the 10 CABI scales demonstrated excellent reliability, invariance, and validity for males and females within early childhood (ages 5-8), middle childhood (ages 9-12), and adolescence (ages 13-16). Normative information (T-scores) is provided for females and males within each age group for the 10 CABI scales. The new psychometric and normative information increase the usefulness of the CABI scale scores for research and clinical activities. Copies of the CABI and the norms are available at no cost to professionals.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911251317785"},"PeriodicalIF":3.5,"publicationDate":"2025-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143481990","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Factor Structure and Psychometric Properties of the Learning, Executive, and Attention Functioning (LEAF) Scale in Young Adults.

IF 3.5 2区心理学

Assessment Pub Date : 2025-02-19 DOI: 10.1177/10731911251317788

Cory A Munroe, Jennifer Leckey, Shannon A Johnson, Sophie Jacques

{"title":"Factor Structure and Psychometric Properties of the Learning, Executive, and Attention Functioning (LEAF) Scale in Young Adults.","authors":"Cory A Munroe, Jennifer Leckey, Shannon A Johnson, Sophie Jacques","doi":"10.1177/10731911251317788","DOIUrl":"https://doi.org/10.1177/10731911251317788","url":null,"abstract":"The Learning, Executive, and Attention Functioning (LEAF) scale is a resource-friendly means of assessing executive functions (EFs) and related constructs (e.g., academic abilities) in children and adolescents that has been adapted for use with adults. However, no study in any population has investigated the factor structure of all LEAF EF items to determine whether items factor in a manner consistent with the originally proposed scale structure. Therefore, we examined LEAF scale responses of 546 young adults (Mage = 20.05, SD = 2.17). Upon removing academic items following a preliminary factor analysis, we performed principal axis factoring on the remaining 39 EF items. The final model accounted for 61.75% of the total variance in LEAF EF items and suggested that these items assess six moderately correlated EF constructs in young adults. We constructed six updated subscales to help researchers measure these EFs in young adults using the LEAF scale, each of which uniquely and differentially predicted measures of self-reported impulsivity, academic difficulties, and learning-related disorder history. Overall, the LEAF promises to be an accessible means of assessing a range of EF constructs in young adults, particularly when updated subscale structures based on factor analysis are used.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911251317788"},"PeriodicalIF":3.5,"publicationDate":"2025-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143456728","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Assessment of Cognition and Language Using Alternative Response Modalities.

IF 3.5 2区心理学

Assessment Pub Date : 2025-02-12 DOI: 10.1177/10731911251315012

Kristine Stadskleiv, Katy Latham, Kristina Tufteskog Spanne, Karen Sætre, Anna Fraas, Ilaria Ruscito, Yasmine Taha, Janice Murray

{"title":"Assessment of Cognition and Language Using Alternative Response Modalities.","authors":"Kristine Stadskleiv, Katy Latham, Kristina Tufteskog Spanne, Karen Sætre, Anna Fraas, Ilaria Ruscito, Yasmine Taha, Janice Murray","doi":"10.1177/10731911251315012","DOIUrl":"https://doi.org/10.1177/10731911251315012","url":null,"abstract":"Assessing cognition and language using standardized tests is challenging when the individual has severe speech and motor impairments. Tests with a multiple-choice format may be adapted without compromising standardization using alternative response modes like partner assisted scanning (PAS) and eye-pointing (EP). Standardization of such assessment is little researched. The study investigates the (a) reliability of, (b) transparency of, and (c) adherence to assessment protocols using PAS and EP. The participants were students from special needs education and speech and language therapy, who worked in dyads (n = 39). Two observers recorded a number of errors made in protocol delivery, independently of each other. The dyads made between 0 and 81.5 errors. Number of errors was not related to response mode, t(38) = -0.21, p = .839. The observers were in high agreement, with an intraclass correlation coefficient of .97, p < .001. The study suggests that assessing language involving alternative modes of responding can be successfully taught to novice practitioners.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911251315012"},"PeriodicalIF":3.5,"publicationDate":"2025-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143397928","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0