AssessmentPub Date : 2024-07-24DOI: 10.1177/10731911241261436
Astrid M Suchy-Dicey, Thao T Vo, Kyra Oziel, Dedra S Buchwald, Kristoffer Rhoads, Brian F French
{"title":"Psychometric Reliability, Validity, and Generalizability of MoCA in American Indian Adults: The Strong Heart Study.","authors":"Astrid M Suchy-Dicey, Thao T Vo, Kyra Oziel, Dedra S Buchwald, Kristoffer Rhoads, Brian F French","doi":"10.1177/10731911241261436","DOIUrl":"10.1177/10731911241261436","url":null,"abstract":"<p><p>Standardized neuropsychological instruments are used to evaluate cognitive impairment, but few have been psychometrically evaluated in American Indians. We collected Montreal Cognitive Assessment (MoCA) in 403 American Indians 70 to 95 years, as well as age, sex, education, bilingual status, depression symptoms, and other neuropsychological instruments. We evaluated inferences of psychometric validity, including scoring inference using confirmatory factor analysis and structural equation modeling, generalizability inference using reliability coefficient, and extrapolation inference by examining performance across different contexts and substrata. The unidimensional (total score) model had good fit criteria. Internal consistency reliability was high. MoCA scores were positively associated with crystallized cognition (ρ = 0.48, <i>p</i> < .001) and inversely with depression symptoms (ρ = -0.27, <i>p</i> < .001). Significant differences were found by education (<i>d</i> = 0.79, <i>p</i> < .05) depression (<i>d</i> = 0.484, <i>p</i> < .05), and adjudicated cognitive status (<i>p</i> = .0001) strata; however, MoCA was not sensitive or specific in discriminating cognitive impairment from normal cognition (area under the curve <0.5). MoCA scores had psychometric validity in older American Indians, but education and depression are important contextual features for score interpretability. Future research should evaluate cultural or community-specific adaptations, to improve test discriminability in this underserved population.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141750970","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-07-01Epub Date: 2023-10-14DOI: 10.1177/10731911231199424
Boqing Lu, Yuan Fang, Jimin Cai, Zhiyan Chen
{"title":"Psychometric Evaluation of the Affective Reactivity Index Among Children and Adolescents in China: A Multi-Method Assessment Approach.","authors":"Boqing Lu, Yuan Fang, Jimin Cai, Zhiyan Chen","doi":"10.1177/10731911231199424","DOIUrl":"10.1177/10731911231199424","url":null,"abstract":"<p><p>The Affective Reactivity Index (ARI) is one of the most studied scales for assessing youth irritability, but little is known about its measurement performance in community populations. This study applied item response theory (IRT), network analysis, and classical test theory (CTT) to examine the psychometric properties of the ARI in a sample of <i>n</i> = 395 community-based children (<i>M</i><sub>age</sub> = 13.44, <i>SD</i> = 2.51) and <i>n</i> = 403 parents. In this sample, the ARI demonstrated good reliability, as well as convergent and concurrent validity. The one-factor structure was supported by both confirmatory factor analysis (CFA) and network analysis. IRT analysis revealed that the ARI effectively distinguished between various levels of irritability within the community population. Network analysis identified \"Loses temper easily,\"\"Gets angry frequently,\" and \"Often loses temper\" are central aspects of irritability. The findings support the ARI as a brief, reliable, and valid instrument to assess irritability in community children and adolescents.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41189557","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-07-01Epub Date: 2023-10-24DOI: 10.1177/10731911231201159
Alison S Buchholz, Gila Z Reckess, Victor A Del Bene, S Marc Testa, Jeffrey L Crawford, David J Schretlen
{"title":"Within-Person Test Score Distributions: How Typical Is \"Normal\"?","authors":"Alison S Buchholz, Gila Z Reckess, Victor A Del Bene, S Marc Testa, Jeffrey L Crawford, David J Schretlen","doi":"10.1177/10731911231201159","DOIUrl":"10.1177/10731911231201159","url":null,"abstract":"<p><p>We evaluated within-person variability across a cognitive test battery by analyzing the <i>shape</i> of the distribution of each individual's scores within a battery of tests. We hypothesized that most healthy adults would produce test scores that are normally distributed around their own personal battery-wide, within-person (wp) mean. Using cross-sectional data from 327 neurologically healthy adults, we computed each person's mean, standard deviation, skew, and kurtosis for 30 neuropsychological measures. Raw scores were converted to <i>T</i>-scores using three degrees of calibration: (a) none, (b) age, and (c) age, sex, race, education, and estimated premorbid IQ. Regardless of calibration, no participant showed abnormal within-person skew (<sup>wp</sup>skew) and only 10 (3.1%) to 16 (4.9%) showed <sup>wp</sup>kurtosis greater than 2. If replicated in other samples and measures, these findings could illuminate how healthy individuals are endowed with different cognitive abilities and provide the foundation for a new method of inference in clinical neuropsychology.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50156931","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-07-01Epub Date: 2023-10-27DOI: 10.1177/10731911231205547
Brooke R Leonelli, Christian A L Bean, Joel W Hughes
{"title":"Psychometric Properties and Factor Structure of the Multidimensional Behavioral Health Screen (MBHS) With a University Sample.","authors":"Brooke R Leonelli, Christian A L Bean, Joel W Hughes","doi":"10.1177/10731911231205547","DOIUrl":"10.1177/10731911231205547","url":null,"abstract":"<p><p>The Multidimensional Behavioral Health Screen (MBHS) is a brief screening measure of behavioral health symptoms. Although the measure was first developed for primary care, it is likely to have clinical utility in other settings. This study examined the MBHS's factor structure and psychometric properties with a university undergraduate and graduate student sample (<i>n =</i> 602, 58.6% female, 75.9% White, primarily aged 20-24) during the COVID-19 pandemic. MBHS subscale scores demonstrated internal consistency reliability and both convergent and discriminant relations with external, criterion variables. Confirmatory factor analyses supported a 7-subscale factor structure of the MBHS and did not find evidence of higher order factors. Clinical and theoretical implications, as well as future research directions, are discussed.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"54227498","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-07-01Epub Date: 2023-10-15DOI: 10.1177/10731911231203966
Javier García-Campayo, Alberto Barceló-Soler, David Martínez-Rubio, Jaime Navarrete, Adrián Pérez-Aranda, Albert Feliu-Soler, Juan V Luciano, Ruth Baer, Willem Kuyken, Jesus Montero-Marin
{"title":"Exploring the Relationship Between Self-Compassion and Compassion for Others: The Role of Psychological Distress and Wellbeing.","authors":"Javier García-Campayo, Alberto Barceló-Soler, David Martínez-Rubio, Jaime Navarrete, Adrián Pérez-Aranda, Albert Feliu-Soler, Juan V Luciano, Ruth Baer, Willem Kuyken, Jesus Montero-Marin","doi":"10.1177/10731911231203966","DOIUrl":"10.1177/10731911231203966","url":null,"abstract":"<p><p>We addressed construct validity and explored the relationship between self-compassion and compassion for others using the two main current operationalizations of compassion (Neff's and the Sussex-Oxford Compassion Scales, SOCSs). Relationships with psychological distress and wellbeing, and potential differences in the association between self-compassion and compassion for others by level of psychological distress and wellbeing were also explored. Participants (<i>n</i> = 811) completed the Spanish adaptations of the Self-Compassion Scale (SCS), the Compassion Scale (CS), the SOCSs (for the self/others), the Short Warwick-Edinburgh Mental Well-Being Scale (SWEMWBS), and the Depression Anxiety Stress Scales-21 (DASS-21). We fitted bifactor models to estimate the general factor of each construct for the different operationalizations, and calculated correlations between them. Relationships between self-compassion and compassion for others from the same operationalization were intermediate, while those between the same constructs from different operationalizations were large. Both constructs showed positive associations with wellbeing, while only self-compassion was associated with decreased psychological distress. Participants with good mental health showed higher associations between self-compassion and compassion for others than those with poorer mental health. Self-compassion and compassion for others appear to be dimensional constructs that can converge or diverge. When they converge, it is associated with better mental health.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11134997/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41231995","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-07-01Epub Date: 2023-10-24DOI: 10.1177/10731911231204831
Sohrab Hadeei
{"title":"Development and Validation of a New Measurement Scale for Existential Loneliness.","authors":"Sohrab Hadeei","doi":"10.1177/10731911231204831","DOIUrl":"10.1177/10731911231204831","url":null,"abstract":"<p><p>This article deals with the development and initial validation of the Existential Loneliness Scale (ELS). An initial pool of 40 items, generated based on literature review, qualitative studies, and previously developed scales, was evaluated by the experts' judgment, so 30 items were retained and then administered to an Iranian sample of 433 youth and adult participants aged 20 to 85 years. Participants also completed other measures relevant for construct validity: Existential Loneliness Questionnaire (ELQ), De Jong Gierveld Loneliness Scale (DJGLS-6), Existential Anxiety Questionnaire (EAQ), Meaning in Life Questionnaire (MLQ), Beck Depression Inventory (BDI-13), and Satisfaction with Life Scale (SWLS). Exploratory factor analysis and parallel analysis showed strong evidence of unidimensionality. This result was also supported by confirmatory factor analysis test. Finally, 19 items were kept, which were free from DIF by gender and by marital status. The scale had high internal consistency (α = .95 and ω = .95) and adequate test-retest reliability with a 1-month interval (<i>r</i> = .74). Examination of the ELS' correlation with criterion measures indicated that the scale has good concurrent, discriminant, and convergent validity. Findings revealed the ELS as a reliable, valid, and suitable instrument to measure existential loneliness in the Iranian adult population.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50156929","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-07-01Epub Date: 2023-09-14DOI: 10.1177/10731911231198214
Erin D Ozturk, Yichi Zhang, Mark H C Lai, McKenna S Sakamoto, Catherine Chanfreau-Coffinier, Victoria C Merritt
{"title":"Measurement Invariance of the Neurobehavioral Symptom Inventory in Male and Female Million Veteran Program Enrollees Completing the Comprehensive Traumatic Brain Injury Evaluation.","authors":"Erin D Ozturk, Yichi Zhang, Mark H C Lai, McKenna S Sakamoto, Catherine Chanfreau-Coffinier, Victoria C Merritt","doi":"10.1177/10731911231198214","DOIUrl":"10.1177/10731911231198214","url":null,"abstract":"<p><p>This study evaluated measurement invariance across males and females on the Neurobehavioral Symptom Inventory (NSI) in U.S. military veterans enrolled in the VA Million Veteran Program. Participants (<i>N</i> = 17,059; males: <i>n</i> = 15,450; females: <i>n</i> = 1,609) included Veterans who took part in the VA Traumatic Brain Injury (TBI) Screening and Evaluation Program and completed the NSI. Multiple-group confirmatory factor analyses investigated measurement invariance of the NSI 4-factor model. The configural (comparative fit index [CFI] = 0.948, root mean square error of approximation [RMSEA] = 0.060) and metric (CFI = 0.948, RMSEA = 0.058) invariance models showed acceptable fit. There was a minor violation of scalar invariance (Δχ<sup>2</sup> = 232.50, <i>p</i> < .001); however, the degree of noninvariance was mild (ΔCFI = -0.002, <math><mrow><mi>Δ</mi><mi>RMSEA</mi><mo>=</mo><mn>0</mn><mo>.</mo><mn>000</mn></mrow></math>). Our results demonstrate measurement invariance across sex, suggesting that the NSI 4-factor model can be used to accurately assess symptoms in males and females following TBI. Findings highlight the importance of considering validity of measurement across study groups to increase confidence that a measure is interpreted similarly by respondents from different subgroups.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10242717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-07-01Epub Date: 2023-10-24DOI: 10.1177/10731911231203968
Pascal Schlechter, Thomas Meyer, Nexhmedin Morina
{"title":"Comparison Is the Thief of Joy? Introducing the Attitudes Towards Social Comparison Inventory.","authors":"Pascal Schlechter, Thomas Meyer, Nexhmedin Morina","doi":"10.1177/10731911231203968","DOIUrl":"10.1177/10731911231203968","url":null,"abstract":"<p><p>Social comparison has a significant impact on individuals' motivation, affect, and behavior. However, we lack a scale that captures individual differences in attitudes toward social comparison. To address this gap, we developed the Attitudes Toward Social Comparison Inventory (ASCI) drawing on existing scales that tap into metacognitive beliefs about worrying, self-motives, beliefs about emotions, and the general comparative-processing model. We examined the psychometric properties of the ASCI in a longitudinal study (<i>N</i> = 1,084), and a second (<i>N</i> = 550) and third cross-sectional study (<i>N</i> = 306). Through exploratory and confirmatory factor analyses, we identified a 12-item two-factor solution capturing positive and negative attitudes toward social comparison. The ASCI demonstrated measurement invariance across gender and time. The two factors were differentially and longitudinally associated with relevant constructs, including social comparison, metacognitive beliefs about worrying, depression, self-concept clarity, envy, and self-esteem. The ASCI facilitates comprehensive investigations of social comparison processes.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11134996/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50156928","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-07-01Epub Date: 2023-10-30DOI: 10.1177/10731911231204832
Morgan G Rosen, Joseph H Grochowalski
{"title":"Change Score and Subscore Precision and Reliability of the Children's Depression Inventory.","authors":"Morgan G Rosen, Joseph H Grochowalski","doi":"10.1177/10731911231204832","DOIUrl":"10.1177/10731911231204832","url":null,"abstract":"<p><p>The Child Depression Inventory (CDI) is often used to assess change in depression over time, but no studies estimate the reliability of CDI change scores nor its five subscores. Our study investigated the reliability of change scores for both the total score on the CDI as well as its five subscores. We examined CDI responses from 186 maltreated children and estimated change score reliability for relative (e.g., comparison) and absolute (e.g., diagnosis) purposes. We also conducted subscore utility analysis, which determines if subscores have adequate reliability and provide information beyond the total score. We found that the total change score had acceptable reliability of .70 for our sample for both relative and absolute interpretations. In addition, the total score was a better predictor of true subscore values than the observed subscores-suggesting subscores did not add value over the total score, and that the reliability of changes in subscores was too low to be useful for any purpose. In summary, we found that the total CDI change scores were useful for assessing change in studies that examine relative or absolute change, and we advise caution when interpreting CDI subscores based on our analysis.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71410399","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-07-01Epub Date: 2023-10-14DOI: 10.1177/10731911231203960
Sarah A Walker, Carolyn MacCann
{"title":"Faking Good on Self-Reports Versus Informant-Reports of Emotional Intelligence.","authors":"Sarah A Walker, Carolyn MacCann","doi":"10.1177/10731911231203960","DOIUrl":"10.1177/10731911231203960","url":null,"abstract":"<p><p>Research demonstrates that people can fake on self-rated emotional intelligence scales. As yet, no studies have investigated whether informants (where a knowledgeable informant rates a target's emotional intelligence) can also fake on emotional intelligence inventories. This study compares mean score differences for a simulated job selection versus a standard instructed set for both self-ratings and informant-ratings on the Trait Emotional Intelligence Questionnaire-Short Form (TEIQue-SF). In a 2 × 2 between-person design, participants (<i>N</i> = 81 community volunteers, 151 university students) completed the TEIQue-SF as either self-report or informant-report in one of two instruction conditions (answer honestly, job simulation). Both self-reports (<i>d</i> = 1.47) and informant-reports (<i>d</i> = 1.56) were significantly higher for job simulation than \"answer honestly\" instructions, indicating substantial faking. We conclude that people can fake emotional intelligence for both themselves (self-report) and on behalf of someone else (informant-report). We discuss the relevance of our findings for self- and informant-report assessment in applied contexts.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11134977/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41189556","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}