Assessment最新文献_第8页

From Confirmation to Theory: Introduction to the Special Section on "Assessment, Measurement, and Registered Replication". 从确认到理论：“评估、测量和注册复制”专题导论。

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2025-02-10 DOI: 10.1177/10731911251320053

Kristian E Markon, Thomas Olino

引用次数: 0

Campbell's Law Explains the Replication Crisis: Pre-Registration Badges Are History Repeating. 坎贝尔定律解释了复制危机：预注册徽章是历史的重演。

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2024-05-23 DOI: 10.1177/10731911241253430

E David Klonsky

{"title":"Campbell's Law Explains the Replication Crisis: Pre-Registration Badges Are History Repeating.","authors":"E David Klonsky","doi":"10.1177/10731911241253430","DOIUrl":"10.1177/10731911241253430","url":null,"abstract":"Campbell's Law explains the replication crisis. In brief, useful tools such as hypotheses, p-values, and multi-study designs came to be viewed as indicators of strong science, and thus goals in and of themselves. Consequently, their use became distorted in unanticipated ways (e.g., hypothesizing after results were known [HARKing], p-Hacking, misuses of researcher degrees of freedom), and fragile findings proliferated. Pre-registration mandates are positioned as an antidote. However, I argue that such efforts, perhaps best exemplified by pre-registration badges (PRBs), are history repeating: Another useful tool has been converted into an indicator of strong science and a goal in and of itself. This, too, will distort its use and harm psychological science in unanticipated ways. For example, there is already evidence that papers seeking PRBs routinely violate the rules and spirit of pre-registration. I suggest that pre-registration mandates will (a) discourage optimal scientific practice, (b) exacerbate the file drawer problem, (c) encourage pre-registering after results are known (PRARKing), and (d) create false trust in fragile findings. I conclude that multiple design features can help support replicability (e.g., adequate sample size, valid measurement, robustness checks, pre-registration), none should be canonized, replication is the only arbiter of replicability, and the most important solution is sociocultural: to foster a field that reveres and reinforces robust science-just as we once revered and reinforced flashy but fragile science.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"224-234"},"PeriodicalIF":3.5,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11874590/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141086411","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The Effect of Different Construct Operationalizations, Study Duration, and Preprocessing Choices on Power-Based Sample Size Recommendations in Intensive Longitudinal Research. 不同的结构操作、研究持续时间和预处理选择对密集纵向研究中基于功率的样本量建议的影响。

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2024-11-14 DOI: 10.1177/10731911241286868

Ginette Lafit, Jordan Revol, Leonie Cloos, Peter Kuppens, Eva Ceulemans

{"title":"The Effect of Different Construct Operationalizations, Study Duration, and Preprocessing Choices on Power-Based Sample Size Recommendations in Intensive Longitudinal Research.","authors":"Ginette Lafit, Jordan Revol, Leonie Cloos, Peter Kuppens, Eva Ceulemans","doi":"10.1177/10731911241286868","DOIUrl":"10.1177/10731911241286868","url":null,"abstract":"To shed light on the dynamics of psychological processes, researchers often collect intensive longitudinal (IL) data by asking people to repeatedly report on their momentary experiences in daily life. Two important decisions when designing an IL study concern the number of persons and the number of measurement occasions to be included. These sample size decisions are ideally based on statistical power considerations. When conducting statistical power analysis, it is necessary to provide the value of the effect size of interest as well as of all other model parameters. In IL research, these values have to be based on previous studies. This implies that these values are subject to large heterogeneity due to differences in study design and preprocessing choices. This between-study heterogeneity can severely impact power-based sample size recommendations. In this article, we introduce an approach to investigate the impact of study design and pre-processing of previous studies and to determine a recommended sample size to account for this impact. We demonstrate how to use this approach to investigate the effect of different construct operationalizations, study duration, and preprocessing choices. This approach paves the way for more thoughtful and robust sample-size decisions.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"206-223"},"PeriodicalIF":3.5,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142613862","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Examining the Structure of Personality Dysfunction Among Individuals Involved in Mental Health treatment: A Registered Report. 研究接受心理健康治疗者的人格功能障碍结构：注册报告。

IF 3.5 2区心理学

Assessment Pub Date : 2025-03-01 Epub Date: 2024-12-14 DOI: 10.1177/10731911241301475

Ashmita Ghosh, Nathaniel L Phillips, Chelsea E Sleep, Donald R Lynam, Joshua D Miller

{"title":"Examining the Structure of Personality Dysfunction Among Individuals Involved in Mental Health treatment: A Registered Report.","authors":"Ashmita Ghosh, Nathaniel L Phillips, Chelsea E Sleep, Donald R Lynam, Joshua D Miller","doi":"10.1177/10731911241301475","DOIUrl":"10.1177/10731911241301475","url":null,"abstract":"Personality dysfunction is a core element of the diagnosis of personality disorders in both main diagnostic systems (Diagnostic and Statistical Manual of Mental Disorders [5th ed.] Personality Disorders and ICD-11 [International Classification of Diseases, 11th Revision] Personality Disorders). A recent study by Sleep et al. explored the structure of personality dysfunction (N = 517 undergraduates) with exploratory bass-ackward factor analyses at the item level using items from six measures of personality functioning. The present study represents a replication of the study by Sleep and colleagues in a community sample of individuals currently in or seeking psychological/psychiatric treatment. Participants were recruited from Prolific who completed items from six measures of personality dysfunction (N = 457). The primary factor analysis identified three lower-order factors of impairment (Negative Self-Regard, Disagreeableness, and Intimacy Problems). These dysfunction factors showed moderate to strong relations to the factors generated by Sleep et al.; however, there were important differences in the overall structure suggesting a lack of formal replication.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"283-299"},"PeriodicalIF":3.5,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142823622","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The Structural Validity of the Barkley Deficits in Executive Functioning Scale-Short Form Among College Students Who Drink Alcohol. 饮酒大学生的巴克利执行功能缺陷量表-简表的结构有效性。

IF 3.5 2区心理学

Assessment Pub Date : 2025-02-28 DOI: 10.1177/10731911251316468

Alexandra Hernandez-Vallant, Margo C Hurlocker, Alison Looby, Byron L Zamboanga

引用次数: 0

Psychometric and Normative Information on the Child and Adolescent Behavior Inventory With Parent Ratings in a Nationally Representative Sample of Spanish Youth. 儿童和青少年行为量表的心理测量和规范信息与父母评分在西班牙青年的全国代表性样本。

IF 3.5 2区心理学

Assessment Pub Date : 2025-02-24 DOI: 10.1177/10731911251317785

G Leonard Burns, Juan José Montaño, Stephen P Becker, Mateu Servera

{"title":"Psychometric and Normative Information on the Child and Adolescent Behavior Inventory With Parent Ratings in a Nationally Representative Sample of Spanish Youth.","authors":"G Leonard Burns, Juan José Montaño, Stephen P Becker, Mateu Servera","doi":"10.1177/10731911251317785","DOIUrl":"https://doi.org/10.1177/10731911251317785","url":null,"abstract":"Psychometric and normative information is provided for the Child and Adolescent Behavior Inventory (CABI) cognitive disengagement syndrome, anxiety, depression, attention-deficit/hyperactivity disorder (ADHD)-inattention, ADHD-hyperactivity/impulsivity, oppositional defiant disorder, social impairment, peer rejection, withdrawal from peer interactions, and academic impairment scales with a nationally representative sample of Spanish youth. Parents of 5,525 Spanish youth (ages 5-16, 56.1% males) completed the CABI scales on their sons and daughters. Scores on the 10 CABI scales demonstrated excellent reliability, invariance, and validity for males and females within early childhood (ages 5-8), middle childhood (ages 9-12), and adolescence (ages 13-16). Normative information (T-scores) is provided for females and males within each age group for the 10 CABI scales. The new psychometric and normative information increase the usefulness of the CABI scale scores for research and clinical activities. Copies of the CABI and the norms are available at no cost to professionals.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911251317785"},"PeriodicalIF":3.5,"publicationDate":"2025-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143481990","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Factor Structure and Psychometric Properties of the Learning, Executive, and Attention Functioning (LEAF) Scale in Young Adults. 青少年学习、执行和注意功能（LEAF）量表的因素结构和心理测量特征。

IF 3.5 2区心理学

Assessment Pub Date : 2025-02-19 DOI: 10.1177/10731911251317788

Cory A Munroe, Jennifer Leckey, Shannon A Johnson, Sophie Jacques

{"title":"Factor Structure and Psychometric Properties of the Learning, Executive, and Attention Functioning (LEAF) Scale in Young Adults.","authors":"Cory A Munroe, Jennifer Leckey, Shannon A Johnson, Sophie Jacques","doi":"10.1177/10731911251317788","DOIUrl":"https://doi.org/10.1177/10731911251317788","url":null,"abstract":"The Learning, Executive, and Attention Functioning (LEAF) scale is a resource-friendly means of assessing executive functions (EFs) and related constructs (e.g., academic abilities) in children and adolescents that has been adapted for use with adults. However, no study in any population has investigated the factor structure of all LEAF EF items to determine whether items factor in a manner consistent with the originally proposed scale structure. Therefore, we examined LEAF scale responses of 546 young adults (Mage = 20.05, SD = 2.17). Upon removing academic items following a preliminary factor analysis, we performed principal axis factoring on the remaining 39 EF items. The final model accounted for 61.75% of the total variance in LEAF EF items and suggested that these items assess six moderately correlated EF constructs in young adults. We constructed six updated subscales to help researchers measure these EFs in young adults using the LEAF scale, each of which uniquely and differentially predicted measures of self-reported impulsivity, academic difficulties, and learning-related disorder history. Overall, the LEAF promises to be an accessible means of assessing a range of EF constructs in young adults, particularly when updated subscale structures based on factor analysis are used.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911251317788"},"PeriodicalIF":3.5,"publicationDate":"2025-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143456728","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Assessment of Cognition and Language Using Alternative Response Modalities. 使用替代反应模式评估认知和语言。

IF 3.5 2区心理学

Assessment Pub Date : 2025-02-12 DOI: 10.1177/10731911251315012

Kristine Stadskleiv, Katy Latham, Kristina Tufteskog Spanne, Karen Sætre, Anna Fraas, Ilaria Ruscito, Yasmine Taha, Janice Murray

{"title":"Assessment of Cognition and Language Using Alternative Response Modalities.","authors":"Kristine Stadskleiv, Katy Latham, Kristina Tufteskog Spanne, Karen Sætre, Anna Fraas, Ilaria Ruscito, Yasmine Taha, Janice Murray","doi":"10.1177/10731911251315012","DOIUrl":"https://doi.org/10.1177/10731911251315012","url":null,"abstract":"Assessing cognition and language using standardized tests is challenging when the individual has severe speech and motor impairments. Tests with a multiple-choice format may be adapted without compromising standardization using alternative response modes like partner assisted scanning (PAS) and eye-pointing (EP). Standardization of such assessment is little researched. The study investigates the (a) reliability of, (b) transparency of, and (c) adherence to assessment protocols using PAS and EP. The participants were students from special needs education and speech and language therapy, who worked in dyads (n = 39). Two observers recorded a number of errors made in protocol delivery, independently of each other. The dyads made between 0 and 81.5 errors. Number of errors was not related to response mode, t(38) = -0.21, p = .839. The observers were in high agreement, with an intraclass correlation coefficient of .97, p < .001. The study suggests that assessing language involving alternative modes of responding can be successfully taught to novice practitioners.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911251315012"},"PeriodicalIF":3.5,"publicationDate":"2025-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143397928","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Development of an Examiner-Examinee Rapport Scale for Neuropsychological Testing: The Barnett Rapport Questionnaire - 2. 神经心理测试考官-考生关系量表的开发：Barnett关系问卷- 2。

IF 3.5 2区心理学

Assessment Pub Date : 2025-02-10 DOI: 10.1177/10731911251315626

Michael D Barnett, Jenna M Moore, Rebekah A Griffin

{"title":"Development of an Examiner-Examinee Rapport Scale for Neuropsychological Testing: The Barnett Rapport Questionnaire - 2.","authors":"Michael D Barnett, Jenna M Moore, Rebekah A Griffin","doi":"10.1177/10731911251315626","DOIUrl":"https://doi.org/10.1177/10731911251315626","url":null,"abstract":"Rapport in the context of neuropsychological assessment refers to the interpersonal interaction between the examinee and examiner. The purpose of this study was to improve upon the original Barnett Rapport Questionnaire. Participants consisted of college students (n = 55), middle-aged adults (n = 30), and older adults (n = 99) at a university-affiliated neuropsychology clinic, who were administered a brief test battery. After testing, both examinees (n = 184) and examiners (n = 12) completed items regarding the nature of the interpersonal interaction. Confirmatory factor analyses indicated a two-factor model consisting of nine items found on both the examinee and examiner versions. No age cohort differences were found on the total Barnett Rapport Questionnaire - 2 (BRQ-2) scores for the examiner or examinee version; however, older adults endorsed the positively worded items more than young adults, and examiners endorsed the negatively worded items more for young adult examinees than for older adult examinees. No differences were found by gender or by race/ethnicity. The BRQ-2 promises better usability and improved psychometric qualities for the measurement of rapport in the context of neuropsychological assessment.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911251315626"},"PeriodicalIF":3.5,"publicationDate":"2025-02-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143381444","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The Role of Language Aspects in the Assessment of Cognitive and Developmental Functions in Children: An Analysis of the Intelligence and Development Scales-2. 语言方面在儿童认知和发展功能评估中的作用：对智力和发展量表的分析-2。

IF 3.5 2区心理学

Assessment Pub Date : 2025-02-03 DOI: 10.1177/10731911251315027

Salome D Odermatt, Silvia Grieder, Florine Schweizer, Anette Bünger, Alexander Grob

{"title":"The Role of Language Aspects in the Assessment of Cognitive and Developmental Functions in Children: An Analysis of the Intelligence and Development Scales-2.","authors":"Salome D Odermatt, Silvia Grieder, Florine Schweizer, Anette Bünger, Alexander Grob","doi":"10.1177/10731911251315027","DOIUrl":"https://doi.org/10.1177/10731911251315027","url":null,"abstract":"The assessment of multilingual participants is challenging, as, for example, proficiency in the test language may interfere with test performance. We examined whether different language aspects (i.e., receptive and expressive language abilities, bi/multilingualism) contribute independently to the variance in scores on cognitive and developmental functions of the Intelligence and Development Scales-2 (IDS-2). The sample comprised 826 children aged 5 to 10 years living in German-speaking regions. Hierarchical regression analyses revealed that receptive language ability was significantly associated with almost all IDS-2 scores. Expressive language ability explained little additional variance, except for the intelligence composites, Verbal Reasoning (including subtests), and the basic skills subtests. Bi/multilingualism explained variance above language abilities only in subtests of Verbal Reasoning and verbal Long-Term Memory. Findings highlight the importance of considering language proficiency, particularly in tasks with high verbal demands, when assessing cognitive and developmental functions with the IDS-2 in participants at risk for linguistic disadvantages.","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911251315027"},"PeriodicalIF":3.5,"publicationDate":"2025-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143078502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0