AssessmentPub Date : 2024-06-06DOI: 10.1177/10731911241256434
Madison N Sewell, Hee J Yoon, Clemens M Lechner, Christopher M Napolitano, Beatrice Rammstedt, Brent W Roberts, Christopher J Soto
{"title":"Assessing Social, Emotional, and Behavioral Skills in Just a Few Minutes: 96-, 45-, and 20-Item Short Forms of the BESSI.","authors":"Madison N Sewell, Hee J Yoon, Clemens M Lechner, Christopher M Napolitano, Beatrice Rammstedt, Brent W Roberts, Christopher J Soto","doi":"10.1177/10731911241256434","DOIUrl":"https://doi.org/10.1177/10731911241256434","url":null,"abstract":"<p><p>Social, emotional, and behavioral (SEB) skills matter for individuals' well-being and success. The behavioral, emotional, and social skills inventory (BESSI) uses 192 items to assess 32 specific SEB skills across five broad skill domains. This research developed three short forms of the BESSI-192 and explored their measurement properties, predictive validity, and cross-cultural comparability. We found that BESSI-96, BESSI-45, and BESSI-20 largely captured the psychological content of the BESSI-192 measure, retained a robust multidimensional structure, and demonstrated adequate reliability. At the domain and facet level, the BESSI short forms showed patterns of associations with external criteria that were similar to the BESSI-192 and preserved most of the BESSI-192's predictive power. The BESSI short forms also demonstrated full or partial measurement invariance between the primarily U.S.-based and German adult samples. We conclude by discussing contexts in which the short forms may be useful for researchers and practitioners.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141282829","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-06-06DOI: 10.1177/10731911241256439
Hilary L DeShong, Courtney K Mason, Ben Porter, Kren Kelley, Stephanie N Mullins-Sweatt, Donald R Lynam, Joshua D Miller, Thomas Widiger
{"title":"Development and Validation of the Five-Factor Borderline Inventory-Super Short Form and Screener.","authors":"Hilary L DeShong, Courtney K Mason, Ben Porter, Kren Kelley, Stephanie N Mullins-Sweatt, Donald R Lynam, Joshua D Miller, Thomas Widiger","doi":"10.1177/10731911241256439","DOIUrl":"https://doi.org/10.1177/10731911241256439","url":null,"abstract":"<p><p>The Five-Factor Borderline Inventory (FFBI) and FFBI-Short Form (FFBI-SF) are 120-item and 48-item measures that assess the underlying maladaptive personality traits of borderline personality disorder (BPD). The purpose of this study was to develop a super short form (FFBI-SSF) and an FFBI-Screener to facilitate the use of dimensional trait measures for BPD. Using item response theory analyses, the 48-item measure was reduced to 22 items using a large undergraduate sample (<i>N</i> = 1300) and then retested using a Mechanical Turk sample (<i>N</i> = 602), demonstrating strong replicability. IRT was again used to further reduce the measure from 22 items to four items to provide a brief screening tool. Correlations of the FFBI-SSF and Screener with measures of BPD-related variables were compared across five samples (<i>N</i> = 919, 204, 580, 281, and 488). Overall, the FFBI-SSF showed similar relations to the FFBI-SF at the full scale and domain-level scales, while the FFBI-screener demonstrated similar relations at the full scale level. This super short form and screener may best be used in large-scale research studies or as part of a screening tool in clinical settings.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141261350","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-06-05DOI: 10.1177/10731911241256430
Miranda R Chilver, Richard A Burns, Ferdi Botha, Peter Butterworth
{"title":"Testing the Impact of Variations in Administration on the Kessler Psychological Distress Scale (K10).","authors":"Miranda R Chilver, Richard A Burns, Ferdi Botha, Peter Butterworth","doi":"10.1177/10731911241256430","DOIUrl":"https://doi.org/10.1177/10731911241256430","url":null,"abstract":"<p><p>Self-report measures are useful in psychological research and practice, but scores may be impacted by administration methods. This study investigated whether changing the recall period (from 30 to 7 days) and response option order (from ascending to descending) alters the score distribution of the Kessler Psychological Distress Scale (K10). Participants were presented with the K10 with either different recall periods or different response option orders. There was weak evidence of lower mean K10 scores when using a 7-day recall period than when using the 30-day recall period (B = 1.96, 95% CI [0.04-3.90]) but no evidence of a change in the estimated prevalence of very high psychological distress. Presenting the response options in ascending order did not affect mean scores, but there was weak evidence of reduced prevalence of very high distress relative to the descending order (incidence rate ratio [IRR] = 0.60, 95% CI [0.36-0.98]). These findings suggest that varying the administration method may result in minor differences in population estimates of very high psychological distress when using the K10.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141261287","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-06-03DOI: 10.1177/10731911241253659
Rebekka Schwesig, Maike Borchardt, Julia Velten, Jürgen Hoyer
{"title":"Psychometric Properties of the Diagnostic Interview for Sexual Dysfunctions in Women in a Symptom-Reporting Sample.","authors":"Rebekka Schwesig, Maike Borchardt, Julia Velten, Jürgen Hoyer","doi":"10.1177/10731911241253659","DOIUrl":"10.1177/10731911241253659","url":null,"abstract":"<p><p>While structured clinical interviews are considered the gold standard for diagnosing mental disorders, respective instruments are still lacking in the field of sexual dysfunctions. The study evaluates the psychometric properties of the new <i>Diagnostic Interview for Sexual Dysfunctions in Women</i> (DISEX-F), which is based on the eleventh edition of the <i>International Statistical Classification of Diseases</i> (ICD-11) and the fifth edition of the <i>Diagnostic and Statistical Manual of Mental Disorders</i> (DSM-5), in a sample of 100 women with self-reported sexual problems. Participants were interviewed twice by trained diagnosticians with the DISEX-F. A third diagnostician evaluated the audio records of the initial interview. Participants also completed self-report measures of sexual functioning/distress and interview acceptance. The DISEX-F demonstrates excellent inter-rater reliability, good test-retest reliability, and strong convergent and discriminant evidence of validity. Furthermore, it achieves high acceptance among participants. Discordant diagnostic outcomes were especially linked to false differential diagnostic decisions and information variance in participants reporting. The results strongly support using the DISEX-F for women presenting with self-reported sexual problems in practice and research.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141199452","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-06-01Epub Date: 2023-09-12DOI: 10.1177/10731911231196486
Samuel R C Arnold, Yunhe Huang, Lauren P Lawson, Julianne M Higgins, Ye In Jane Hwang, Amanda Richdale, Julian N Trollor
{"title":"Development of the Impact of Diagnosis Scale-Revised (IODS-R).","authors":"Samuel R C Arnold, Yunhe Huang, Lauren P Lawson, Julianne M Higgins, Ye In Jane Hwang, Amanda Richdale, Julian N Trollor","doi":"10.1177/10731911231196486","DOIUrl":"10.1177/10731911231196486","url":null,"abstract":"<p><p>No tools quantify the experience, psychological, and practical impact of receiving a diagnosis from a non-deficit perspective. Autism is increasingly late diagnosed in adulthood. The Impact of Diagnosis Scale (IODS) was initially developed for borderline personality disorder. We aimed to develop a revised version suitable for autistic adults and potentially other diagnostic groups. Following a trial of a preliminary revision, the researchers and autistic research advisors co-produced an expanded pool of 46 items, scored on 7-point Likert-type scale, within 6 hypothesized domains. Scale reduction processes were applied to data from 125 formally diagnosed autistic adults. Following iterative rounds of factor analysis using maximum likelihood estimation with Promax rotation, 22 items were retained across 4 domains to comprise the IODS-R. The IODS-R adds new understanding to the experience of receiving an autism diagnosis in adulthood. It may be useful for evaluating diagnostic services and other diagnostic groups.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11092292/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10572583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-06-01Epub Date: 2023-08-07DOI: 10.1177/10731911231190098
Andrew Rakhshani, M Brent Donnellan, Brent W Roberts, Richard E Lucas
{"title":"Brief Report: Does the Number of Response Options Matter for the BFI-2? Conceptual Replication and Extension.","authors":"Andrew Rakhshani, M Brent Donnellan, Brent W Roberts, Richard E Lucas","doi":"10.1177/10731911231190098","DOIUrl":"10.1177/10731911231190098","url":null,"abstract":"<p><p>We evaluated how the number of response options affects the psychometric properties of the Big Five Inventory-2 (BFI-2). Using two large samples collected from a market research company (<i>N</i>s = 893 and 1,213), we tested how different response options of the BFI-2 influenced scale score distributions, internal consistency estimates, convergent validity correlations, and criterion validity correlations. Results suggest that score distributions were impacted by the number of response options such that ceiling and floor effects were more common when using two or three response options than when using more options. Estimates of Cronbach's alpha were generally lower with fewer scale points as compared with more scale points, but these effects disappeared when ordinal alpha was used. There were no systematic effects of response options on convergent validity and criterion validity correlations. Given these results, there seems to be few psychometric reasons for deciding whether to administer personality items with five, six, or seven scale points.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9949600","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-06-01Epub Date: 2023-09-14DOI: 10.1177/10731911231198207
Paul E Jenkins, Dan V Blalock, Alan Duffy, Philip S Mehler, Renee D Rienecke
{"title":"Empirical Investigation of Different Factor Structures for the Eating Disorder Examination-Questionnaire in Adult Women With Anorexia Nervosa.","authors":"Paul E Jenkins, Dan V Blalock, Alan Duffy, Philip S Mehler, Renee D Rienecke","doi":"10.1177/10731911231198207","DOIUrl":"10.1177/10731911231198207","url":null,"abstract":"<p><p>The Eating Disorder Examination-Questionnaire (EDE-Q) is a widely used self-report measure of eating pathology. Despite widespread use, investigations of its factor structure have proved inconclusive and rarely supported the \"original\" interpretation. The current study evaluates several proposed factor solutions of the EDE-Q using latent variable analysis in a sample of adult women with anorexia nervosa (AN). A total of 804 patients from a specialist treatment center in the United States participated in the study. Confirmatory factor analysis was conducted on 22 EDE-Q items assessing attitudinal features of eating pathology. Findings suggested that three full-item versions (none of which was the \"original\" interpretation) fit the data adequately, with a brief, seven-item version showing excellent fit. The study is one of the first to examine this within a sample of women with AN and provides an empirical foundation for how best to use the EDE-Q among clinical and research participants with AN. Findings suggest that the \"original\" factor structure lacks structural validity in women with AN. Its use should generally be discouraged, and future work on screening and treatment outcomes might consider the EDE-Q7.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10232034","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-06-01Epub Date: 2023-09-01DOI: 10.1177/10731911231194971
Jana Chi-San Ho, Catherine McBride, Kelvin Fai Hong Lui, Marta Łockiewicz
{"title":"WordSword: An Efficient Online Word Reading Assessment for Global English.","authors":"Jana Chi-San Ho, Catherine McBride, Kelvin Fai Hong Lui, Marta Łockiewicz","doi":"10.1177/10731911231194971","DOIUrl":"10.1177/10731911231194971","url":null,"abstract":"<p><p>The development of efficient and reliable online assessments has become increasingly important in the digital era. We developed a 10-min online word reading assessment of global English based on the existing paper-and-pencil version of our English silent word reading test. The test includes two parts, namely, random word recognition and contextual word reading. A total of 889 participants (437 children and 392 adults; 62.7% female) took part in the study. They were from various regions including mainland China, Hong Kong SAR, Macau SAR, Poland, the United States, and the Philippines. Reliability and validity analyses on various demographics samples (by age and country/region of origin) demonstrated that the WordSword Test is highly reliable and valid (e.g., the correlation of this test with other English reading measures were above .80). Education level was positively correlated with test performance, while the correlations between age and test performance were not consistent. Ninety-seven children participants also took the paper-and-pencil version of the WordSword Test. The correlation between performances on the online and paper-and-pencil versions of the test was .879, one year apart. With more children and adults taking the WordSword Test, we ultimately hope to establish norms by area, grade level, and age.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10492462","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-06-01Epub Date: 2023-09-11DOI: 10.1177/10731911231198205
Michael A Levine, Huan Chen, Ericka L Wodka, Alyssa C Deronda, Brian S Caffo, Joshua B Ewen
{"title":"A Multi-Trait Multi-Method Examination of Psychometric Instrument Performance in Autism Spectrum Disorder.","authors":"Michael A Levine, Huan Chen, Ericka L Wodka, Alyssa C Deronda, Brian S Caffo, Joshua B Ewen","doi":"10.1177/10731911231198205","DOIUrl":"10.1177/10731911231198205","url":null,"abstract":"<p><p>Anecdotal evidence has suggested that rater-based measures (e.g., parent report) may have strong across-trait/within-individual covariance that detracts from trait-specific measurement precision; rater measurement-related bias may help explain poor correlation within Autism Spectrum Disorder (ASD) samples between rater-based and performance-based measures of the same trait. We used a multi-trait, multi-method approach to examine method-associated bias within an ASD sample (<i>n</i> = 83). We examined performance/rater-instrument pairs for attention, inhibition, working memory, motor coordination, and core ASD features. Rater-based scores showed an overall greater methodology bias (57% of variance in score explained by method), while performance-based scores showed a weaker methodology bias (22%). The degree of inter-individual variance explained by method alone substantiates an anecdotal concern associated with the use of rater measures in ASD.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10202829","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-06-01Epub Date: 2023-08-07DOI: 10.1177/10731911231190097
Leigha Rose, Donald R Lynam, Joshua D Miller
{"title":"Measuring the \"Dark\" Triad: Comparing the Five-Factor Model Antagonistic Triad Measure to Other Commonly Used Self-Report Instruments.","authors":"Leigha Rose, Donald R Lynam, Joshua D Miller","doi":"10.1177/10731911231190097","DOIUrl":"10.1177/10731911231190097","url":null,"abstract":"<p><p>The \"Dark\" Triad (DT) refers to three personality constructs with ties to socially aversive behaviors: psychopathy, narcissism, and Machiavellianism. These constructs are commonly assessed via omnibus self-report inventories such as the Short Dark Triad (SD3) or the Dirty Dozen. Alternatively, researchers wishing to measure \"dark\" traits can compile stand-alone measures of each construct. Recently, the Five Factor Model Antagonistic Triad Measure (FFM ATM) was developed, which measures the DT from the perspective of the widely used Five Factor Model of personality. Initial validation studies indicated that the FFM ATM addresses common concerns with other omnibus inventories (e.g., allows for multifaceted examination of DT constructs). The current study tested the FFM ATM in relation to these other methods of measuring the DT (i.e., omnibus inventories and combinations of single-construct measures). Across three tests of validity (i.e., nomological network analysis, intraclass correlations, and incremental validity analyses), the FFM ATM showed favorable results and outperformed other measures of the DT.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10303547","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}