AssessmentPub Date : 2024-12-01Epub Date: 2024-03-08DOI: 10.1177/10731911241234220
Daniel Ventus, Patrik Söderberg
{"title":"Are In-the-Moment Resilience Processes Predicted by Questionnaire-Based Measures of Resilience?","authors":"Daniel Ventus, Patrik Söderberg","doi":"10.1177/10731911241234220","DOIUrl":"10.1177/10731911241234220","url":null,"abstract":"<p><p>Research on resilience is a growing field, and resilience has been conceptualized and operationalized in multiple ways. The aim of this study was to compare the Brief Resilient Coping Scale (BRCS), a conventional measure of resilience, with within-person process indicators derived from experience sampling method (ESM). A sample of 177 teachers from southern Finland participated in the study, commencing with a startup session followed by an 8-day ESM period. Through twice-daily prompts, participants reported their immediate positive and negative affect as well as recent stressors encountered, such as workload and challenging social interactions. As expected, within-person variation in affect was predicted by stressors. However, contrary to expectations, individual differences in affective reactivity to stressors were not predicted by BRCS (β<sub>positive affect</sub> [95% CI] = -.20, [-.51, .11]; β<sub>negative affect</sub> = .33, [-.07, .69]). Item response theory analyses of the BRCS revealed problems with precision. The results call into question the validity of measuring resilience using single administrations of retrospective self-report questionnaires such as the BRCS.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1615-1625"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11484166/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140058577","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-01Epub Date: 2024-03-11DOI: 10.1177/10731911241236315
Pablo Ezequiel Flores-Kanter, Jesús M Alvarado
{"title":"The State of Open Science Practices in Psychometric Studies of Suicide: A Systematic Review.","authors":"Pablo Ezequiel Flores-Kanter, Jesús M Alvarado","doi":"10.1177/10731911241236315","DOIUrl":"10.1177/10731911241236315","url":null,"abstract":"<p><p>The adoption of open science practices (OSPs) is crucial for promoting transparency and robustness in research. We conducted a systematic review to assess the frequency and trends of OSPs in psychometric studies focusing on measures of suicidal thoughts and behavior. We analyzed publications from two international databases, examining the use of OSPs such as open access publication, preregistration, provision of open materials, and data sharing. Our findings indicate a lack of adherence to OSPs in psychometric studies of suicide. The majority of manuscripts were published under restricted access, and preregistrations were not utilized. The provision of open materials and data was rare, with limited access to instruments and analysis scripts. Open access versions (preprints/postprints) were scarce. The low adoption of OSPs in psychometric studies of suicide calls for urgent action. Embracing a culture of open science will enhance transparency, reproducibility, and the impact of research in suicide prevention efforts.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1567-1579"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140100919","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-01Epub Date: 2024-03-11DOI: 10.1177/10731911241235465
Luciano Giromini, Claudia Pignolo, Alessandro Zennaro, Martin Sellbom
{"title":"Using the MMPI-2-RF, IOP-29, IOP-M, and FIT in the In-Person and Remote Administration Formats: A Simulation Study on Feigned mTBI.","authors":"Luciano Giromini, Claudia Pignolo, Alessandro Zennaro, Martin Sellbom","doi":"10.1177/10731911241235465","DOIUrl":"10.1177/10731911241235465","url":null,"abstract":"<p><p>Our study compared the impact of administering Symptom Validity Tests (SVTs) and Performance Validity Tests (PVTs) in in-person versus remote formats and assessed different approaches to combining validity test results. Using the MMPI-2-RF, IOP-29, IOP-M, and FIT, we assessed 164 adults, with half instructed to feign mild traumatic brain injury (mTBI) and half to respond honestly. Within each subgroup, half completed the tests in person, and the other half completed them online via videoconferencing. Results from 2 ×2 analyses of variance showed no significant effects of administration format on SVT and PVT scores. When comparing feigners to controls, the MMPI-2-RF RBS exhibited the largest effect size (d = 3.05) among all examined measures. Accordingly, we conducted a series of two-step hierarchical logistic regression models by entering the MMPI-2-RF RBS first, followed by each other SVT and PVT individually. We found that the IOP-29 and IOP-M were the only measures that yielded incremental validity beyond the effects of the MMPI-2-RF RBS in predicting group membership. Taken together, these findings suggest that administering these SVTs and PVTs in-person or remotely yields similar results, and the combination of MMPI and IOP indexes might be particularly effective in identifying feigned mTBI.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1626-1642"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140100920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-01Epub Date: 2024-02-15DOI: 10.1177/10731911241229566
Tiffany Wu, Christina Weiland, Meghan McCormick, JoAnn Hsueh, Catherine Snow, Jason Sachs
{"title":"One Score to Rule Them All? Comparing the Predictive and Concurrent Validity of 30 Hearts and Flowers Scoring Approaches.","authors":"Tiffany Wu, Christina Weiland, Meghan McCormick, JoAnn Hsueh, Catherine Snow, Jason Sachs","doi":"10.1177/10731911241229566","DOIUrl":"10.1177/10731911241229566","url":null,"abstract":"<p><p>The Hearts and Flowers (H&F) task is a computerized executive functioning (EF) assessment that has been used to measure EF from early childhood to adulthood. It provides data on accuracy and reaction time (RT) across three different task blocks (hearts, flowers, and mixed). However, there is a lack of consensus in the field on how to score the task that makes it difficult to interpret findings across studies. The current study, which includes a demographically diverse population of kindergarteners from Boston Public Schools (<i>N</i> = 946), compares the predictive and concurrent validity of 30 ways of scoring H&F, each with a different combination of accuracy, RT, and task block(s). Our exploratory results provide evidence supporting the use of a <i>two-vector average</i> score based on Zelazo et al.'s approach of adding accuracy and RT scores together only after individuals pass a certain accuracy threshold. Findings have implications for scoring future tablet-based developmental assessments.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1702-1720"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139740249","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-01Epub Date: 2024-02-12DOI: 10.1177/10731911241229573
Pascal Schlechter, Sharon A S Neufeld
{"title":"Longitudinal and Gender Measurement Invariance of the General Health Questionnaire-12 (GHQ-12) From Adolescence to Emerging Adulthood.","authors":"Pascal Schlechter, Sharon A S Neufeld","doi":"10.1177/10731911241229573","DOIUrl":"10.1177/10731911241229573","url":null,"abstract":"<p><p>Psychological distress often onsets during adolescence, necessitating an accurate understanding of its development. Assessing change in distress is based on the seldom examined premise of longitudinal measurement invariance (MI). Thus, we used three waves of data from Next Steps, a representative cohort of young people in the UK (<i>N</i> = 13,539) to examine MI of the General Health Questionnaire-12 (GHQ-12). We examined MI across time and gender from ages 15 to 25 in four competing latent models: (a) a single-factor model, (b) a three-factor correlated model, (c) a bifactor model of \"general distress\" and two orthogonal specific factors capturing positive and negative wording, and (d) a single-factor model including error covariances of negatively phrased items. We also tested acceptability of assumptions underlying sum score models. For all factor models, residual MI was confirmed from ages 15 to 25 years and across gender. The bifactor model had the best fit. While sum score model fit was not unequivocally acceptable, most mean differences across time and gender were equivalent across sum scores and latent difference scores. Thus, GHQ-12 sum scores may be used to assess change in psychological distress in young people. However, latent scores appear more accurate, and model fit can be improved by accounting for item wording.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1687-1701"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11492552/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139721339","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-11-28DOI: 10.1177/10731911241298079
Charlie C Su, Camilo J Ruggero, Craig S Neumann, David C Cicero
{"title":"Measurement Equivalence of Family Functioning and Psychosis Risk Measures in the Adolescent Brain Cognitive Development<sup>SM</sup> Study.","authors":"Charlie C Su, Camilo J Ruggero, Craig S Neumann, David C Cicero","doi":"10.1177/10731911241298079","DOIUrl":"https://doi.org/10.1177/10731911241298079","url":null,"abstract":"<p><p>Decades of research show a clear link between family factors and psychopathology. Family functioning varies across cultures, suggesting potential cultural differences in the association between family factors and psychopathology. In addition, assessing family functioning generally involves tools not systematically validated for diverse cultural backgrounds. Using the Adolescent Brain Cognitive Development<sup>SM</sup> data (<i>N</i> = 11,864), this study found: (a) full scalar invariance was tenable for the Children's Reports of Parental Behavior Inventory (CRPBI) and Prodromal Questionnaire-Brief Child Version (PQ-BC) across race/ethnicity, but not for the Family Environment Scale (FES) and Parental Monitoring Survey (PMQ); (b) the CRPBI and PMQ were significantly associated with the PQ-BC, and (c) all three family scales had equivalent relations with the PQ-BC across groups. This highlights the importance of evaluating scales for measurement invariance across race/ethnicity. Results also help to connect specific family factors to the etiology of psychosis risk among U.S. children and adolescents.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241298079"},"PeriodicalIF":3.5,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142738201","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-11-23DOI: 10.1177/10731911241289249
Lindsay N Gabel, Thomas M Olino, Brandon L Goldstein, Daniel N Klein, Kasey Stanton, Elizabeth P Hayden
{"title":"Latent Structure and Item Functioning of Self-Referent Encoding Task Word Stimuli in Preadolescent Youth.","authors":"Lindsay N Gabel, Thomas M Olino, Brandon L Goldstein, Daniel N Klein, Kasey Stanton, Elizabeth P Hayden","doi":"10.1177/10731911241289249","DOIUrl":"https://doi.org/10.1177/10731911241289249","url":null,"abstract":"<p><p>The Self-Referent Encoding Task (SRET) can be used to measure self-concept via endorsement of trait words, a robust metric associated with depression severity. Our study is the first to investigate the structural validity and item functioning of SRET endorsement scores using confirmatory factor analysis and item response theory. Community-dwelling preadolescent youth (<i>N</i> = 508; <i>M</i><sub>age</sub> = 12.39 years, <i>SD</i><sub>age</sub> = .72) were shown a list of positive and negative trait adjectives and made binary ratings of whether words were self-descriptive. The SRET exhibited a two-factor structure, comprising positive and negative factors. Positive items were endorsed by most children and best estimated information about positive self-concepts below average levels of positivity. Conversely, negative items were unendorsed by most children and best estimated information about negative self-concepts above average levels of negativity. We identify standardized, psychometrically sound, and developmentally sensitive SRET items for assessing youth self-concept and its associations with depression risk.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241289249"},"PeriodicalIF":3.5,"publicationDate":"2024-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142695241","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-11-23DOI: 10.1177/10731911241293222
C E Broshek, A J Kurtz, N S Udupa, C J Chang, M L Rogers, B A Feinstein, E A Selby, K L Gratz, M T Tull, T E Joiner, M E Jeon
{"title":"Psychometric Evaluation of the Heterosexist Harassment, Rejection, and Discrimination Scale: Identification of a Unidimensional 11-Item Scale.","authors":"C E Broshek, A J Kurtz, N S Udupa, C J Chang, M L Rogers, B A Feinstein, E A Selby, K L Gratz, M T Tull, T E Joiner, M E Jeon","doi":"10.1177/10731911241293222","DOIUrl":"https://doi.org/10.1177/10731911241293222","url":null,"abstract":"<p><p>Despite the Heterosexist Harassment, Rejection, and Discrimination Scale (HHRDS) being a routinely used measure of discrimination, there is no current consensus regarding its fundamental psychometric properties. This study sought to: (a) test the dimensionality of the scale using a classical test theory approach, and (b), if lacking a clear multidimensional structure, use an item response theory approach to develop a concise unidimensional measure and examine differential item and test functioning across various identity factors. In a sample of sexual minority adults (<i>N</i> = 1,243), evaluation of the HHRDS supported a reduced 11-item unidimensional measure. Assessment of differential item functioning suggested differences for some items between cisgender men and cisgender women, cisgender men and gender-diverse individuals, gay/lesbian and bi+ individuals, and white/non-Latine individuals and people of color. However, differential item functioning had minimal impact on total test scores, supporting the use of the revised 11-item HHRDS across groups.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241293222"},"PeriodicalIF":3.5,"publicationDate":"2024-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142695242","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-11-20DOI: 10.1177/10731911241293939
Martin Sellbom
{"title":"MMPI-3 Assessment of Externalizing Psychopathology in Targeted Community and University Samples.","authors":"Martin Sellbom","doi":"10.1177/10731911241293939","DOIUrl":"https://doi.org/10.1177/10731911241293939","url":null,"abstract":"<p><p>The Minnesota Multiphasic Personality Inventory-3 (MMPI-3) scales that are designed to assess various forms of externalizing psychopathology have received relatively little research attention to date. The goal of this investigation was therefore to examine the validity of these MMPI-3 scales in the measurement of the externalizing spectrum. A community sample (<i>n</i> = 206) with high levels of externalizing psychopathology and a university sample (<i>n</i> = 645) were used. The former sample was administered structured clinical interviews for various forms of externalizing psychopathology, whereas the student sample completed the Externalizing Spectrum Inventory-160. Confirmatory factor analysis was used to operationalize the externalizing spectrum using each set of measures. The results indicated that the externalizing MMPI-3 scales were associated with a general externalizing factor and an expected pattern of associations, while systematic residuals of individual disorder symptoms also emerged. Moreover, in the university sample, specific MMPI-3 scales hypothesized to assess antagonistic-externalizing (Aggressiveness, Aggression, and Cynicism) emerged as key predictors of a callous-aggression residual group factor. The Substance Abuse scale was unsurprisingly the best predictor of such dysfunction. These findings provide guidance for mental health practitioners who use the MMPI-3 for the assessment of externalizing psychopathology symptoms.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241293939"},"PeriodicalIF":3.5,"publicationDate":"2024-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142680616","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-11-20DOI: 10.1177/10731911241289987
S M Boelders, E Butterbrod, L V D E Vogelsmeier, M M Sitskoorn, L L Ong, K Gehring
{"title":"Factor Structure and Validity of Composite Scores Resulting From a Computerized Cognitive Test Battery in Healthy Adults and Patients With Primary Brain Tumors.","authors":"S M Boelders, E Butterbrod, L V D E Vogelsmeier, M M Sitskoorn, L L Ong, K Gehring","doi":"10.1177/10731911241289987","DOIUrl":"https://doi.org/10.1177/10731911241289987","url":null,"abstract":"<p><p>Computerized neuropsychological test batteries (CNTs), such as Central Nervous System Vital Signs (CNS VS), are increasingly used for measuring cognitive functioning, but empirical evidence of how they measure cognition is scarce. We investigated the factor structure of CNS VS using exploratory factor analyses four samples: healthy adults (<i>n</i> = 169), patients with meningioma (392), low-grade glioma (99), and high-grade glioma (247). We tested model fit and investigated measurement invariance. Differences in factor interpretation existed between healthy participants and patients. Factor structures among patient groups were approximately the same but differed in non-zero loadings. Overall, factor structures largely did not support the \"clinical domains\" provided by CNS VS for clinical interpretation. Confirmatory models did not have a good fit, and measurement invariance could not be established. Our results indicate that (weighted) sum scores of CNS VS results may lack validity. We recommend researchers and clinicians to use scores on individual test measures.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241289987"},"PeriodicalIF":3.5,"publicationDate":"2024-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142680612","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}