AssessmentPub Date : 2024-09-01Epub Date: 2023-12-31DOI: 10.1177/10731911231217478
Emily M Britton, Radia Taisir, Alysha Cooper, Shannon Remers, Yelena Chorny, Onawa LaBelle, Brian Rush, James MacKillop, Mary Jean Costello
{"title":"Psychometric Evaluation of an Adapted Short-Form Spirituality Scale in a Sample of Predominantly White Adults in an Inpatient Substance Use Disorder Treatment Program.","authors":"Emily M Britton, Radia Taisir, Alysha Cooper, Shannon Remers, Yelena Chorny, Onawa LaBelle, Brian Rush, James MacKillop, Mary Jean Costello","doi":"10.1177/10731911231217478","DOIUrl":"10.1177/10731911231217478","url":null,"abstract":"<p><p>Spirituality is an important aspect of treatment and recovery for substance use disorders (SUDs), but ambiguities in measurement can make it difficult to incorporate as part of routine care. We evaluated the psychometric properties of an adapted short-form version of the Spirituality Scale (the Spirituality Scale-Short-Form; SS-SF) for use in SUD treatment settings. Participants were adult patients (<i>N</i> = 1,388; <i>M<sub>age</sub></i> = 41.23 years, <i>SD<sub>age</sub></i> = 11.55; 68% male; 86% White) who entered a large, clinically mixed inpatient SUD treatment program. Factor analysis supported the two-dimensional structure, with factors representing Self-Discovery and Transcendent Connection. Tests of measurement invariance demonstrated that the scale was invariant across age and gender subgroups. The SS-SF exhibited convergent and concurrent validity via associations with participation in spiritual activities, hopefulness, life satisfaction, 12-step participation, and depressive symptoms. Finally, scores on the SS-SF were significantly higher at discharge compared to admission, demonstrating short-term sensitivity to change. These findings support use of the SS-SF as a concise, psychometrically sound measure of spirituality in the context of substance use treatment.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1309-1323"},"PeriodicalIF":3.5,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139073302","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-09-01Epub Date: 2023-11-14DOI: 10.1177/10731911231202440
Daniel J Lee, Michael L Crowe, Frank W Weathers, Michelle J Bovin, Stephanie Ellickson, Denise M Sloan, Paula Schnurr, Terence M Keane, Brian P Marx
{"title":"An Item Response Theory Analysis of the Clinician-Administered PTSD Scale for <i>DSM-5</i> Among Veterans.","authors":"Daniel J Lee, Michael L Crowe, Frank W Weathers, Michelle J Bovin, Stephanie Ellickson, Denise M Sloan, Paula Schnurr, Terence M Keane, Brian P Marx","doi":"10.1177/10731911231202440","DOIUrl":"10.1177/10731911231202440","url":null,"abstract":"<p><p>We used item response theory (IRT) analysis to examine Clinician-Administered PTSD Scale for <i>DSM-5</i> (CAPS-5) item performance using data from three large samples of veterans (total <i>N</i> = 808) using both binary and ordinal rating methods. Relative to binary ratings, ordinal ratings provided good coverage from well below to well above average within each symptom cluster. However, coverage varied by cluster, and item difficulties were unevenly distributed within each cluster, with numerous instances of redundancy. For both binary and ordinal scores, flashbacks, dissociative amnesia, and self-destructive behavior items showed a pattern of high difficulty but relatively poor discrimination. Results indicate that CAPS-5 ordinal ratings provide good severity coverage and that most items accurately differentiated between participants by severity. Observed uneven distribution and redundancy in item difficulty suggest there is opportunity to create an abbreviated version of the CAPS-5 for determining PTSD symptom severity, but not <i>DSM-5</i> PTSD diagnosis, without sacrificing precision.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1262-1269"},"PeriodicalIF":3.5,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"92152559","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-09-01Epub Date: 2023-12-14DOI: 10.1177/10731911231213845
Johanna Perzl, Elisabeth Maria Riedl, Joachim Thomas
{"title":"Measuring Situational Cognitive Performance in the Wild: A Psychometric Evaluation of Three Brief Smartphone-Based Test Procedures.","authors":"Johanna Perzl, Elisabeth Maria Riedl, Joachim Thomas","doi":"10.1177/10731911231213845","DOIUrl":"10.1177/10731911231213845","url":null,"abstract":"<p><p>Mobile devices provide new opportunities to draw conclusions about cognitive performance in everyday situations. To gain insights into cognitive performance patterns in healthy adult populations, we adapted three established cognitive tests for smartphone use: the Digit Symbol Substitution Task (DSST), Sustained Attention to Response Task (SART), and Psychomotor Vigilance Task (PVT). To increase their feasibility for ambulatory assessment, we identified the minimum measurement durations that provide reliable and valid state measures of cognitive performance. Over 2 weeks, 46 participants performed each test once per day at random times, along with self-reports (e.g., on concentration, mood, and mental demands). The validity and reliability of change are promising for the 30-second PVT and 90-second DSST and SART. The DSST and SART provide fruitful outcomes for ambulatory field studies linked to mood, stress, and mental demands. We provide digital versions of the adapted DSST and SART online for free.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1270-1291"},"PeriodicalIF":3.5,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11292980/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138795705","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-09-01Epub Date: 2023-11-14DOI: 10.1177/10731911231207796
Dustin Wood, P D Harms, Ryne A Sherman, Michael Boudreaux, Graham H Lowman, Robert Hogan
{"title":"Development of the Hogan Personality Content Single-Items Inventory.","authors":"Dustin Wood, P D Harms, Ryne A Sherman, Michael Boudreaux, Graham H Lowman, Robert Hogan","doi":"10.1177/10731911231207796","DOIUrl":"10.1177/10731911231207796","url":null,"abstract":"<p><p>The Hogan Personality Inventory (HPI) and Hogan Developmental Survey (HDS) are among the most widely used and extensively well-validated personality inventories for organizational applications; however, they are rarely used in basic research. We describe the <i>Hogan Personality Content Single-Items</i> (HPCS) inventory, an inventory designed to measure the 74 content subscales of the HPI and HDS via a single-item each. We provide evidence of the reliability and validity of the HPCS, including item-level retest reliability estimates, both self-other agreement and other-other (or observer) agreement, convergent correlations with the corresponding scales from the full HPI/HDS instruments, and analyze how similarly the HPCS and full HPI/HDS instruments relate to other variables. We discuss situations where administering the HPCS may have certain advantages and disadvantages relative to the full HPI and HDS. We also discuss how the current findings contribute to an emerging picture of best practices for the development and use of inventories consisting of single-item scales.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1233-1261"},"PeriodicalIF":3.5,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"92152560","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-09-01Epub Date: 2023-11-14DOI: 10.1177/10731911231209282
Álvaro Postigo, Jaime García-Fernández, Marcelino Cuesta, Patricia Recio, Javier Barría-González, Luis Manuel Lozano
{"title":"Giving Meaning to the Dark Triad: Comparison of Different Factor Structures of the Dirty Dozen Through Eight Regions of the World.","authors":"Álvaro Postigo, Jaime García-Fernández, Marcelino Cuesta, Patricia Recio, Javier Barría-González, Luis Manuel Lozano","doi":"10.1177/10731911231209282","DOIUrl":"10.1177/10731911231209282","url":null,"abstract":"<p><p>The traits of the dark triad (narcissism, psychopathy, and Machiavellianism) capture the individual differences in the aversive personality. The dark triad has shown significant relations with behaviors that affect people's lives. One of the best-known instruments to assess the dark triad is the Dirty Dozen. However, controversy continues over the use of one general dark triad score or, conversely, three different scores. This study aimed to investigate the factor structure of the Dirty Dozen across eight global regions. There were 11,477 participants in 49 countries grouped into eight regions. Different factor structures were studied using confirmatory factor analyses. Both the three-dimensional models and the bifactor models (symmetrical or traditional and non-symmetrical or bifactor-[S - 1]) showed a good fit to the data. The bifactor-(S - 1) models (with psychopathy or Machiavellianism as the reference factors) show adequate fit to the data, supported by the coherence of the factorial loadings and the bifactor indices. Regarding measurement invariance for both models, configural, metric, and scalar invariance were satisfied. The results indicate that it is not clear whether a psychopathy or Machiavellianism reference factor predominates in the Dirty Dozen. For both models, templates are provided to obtain standardized scores for applied researchers in the eight studied world regions until future studies offer a greater amount of validity evidence for this instrument.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1218-1232"},"PeriodicalIF":3.5,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"92152561","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-08-29DOI: 10.1177/10731911241273352
Halle A Thomas, Jennifer D Ellis, Emily R Grekin
{"title":"Lessons Learned in Developing a Behavioral Economic Measure of Cannabis Use Using a Predominantly White Sample.","authors":"Halle A Thomas, Jennifer D Ellis, Emily R Grekin","doi":"10.1177/10731911241273352","DOIUrl":"https://doi.org/10.1177/10731911241273352","url":null,"abstract":"<p><p>Behavioral economic approaches to measuring cannabis demand represent a well-validated, low-cost method of assessing risk for hazardous cannabis use. One widely used measure of cannabis demand is the Marijuana Purchase Task (MPT), which has shown good psychometric properties across multiple samples. However, preliminary data suggest that changes could improve task ecological validity and acceptability. Using a predominantly White convenience sample, this study aimed to develop a revised MPT that uses a modern dispensary scenario to better reflect national trends in cannabis use (e.g., multiple forms of cannabis consumption). Participant inattentiveness due to increased task length and difficulty estimating purchases for the next month may have impacted demand measures. Lessons learned are discussed to inform future efforts to assess cannabis demand in a manner that is more reflective of naturalistic use: including minimizing participant burden, setting higher price ceilings to increase task utility, and considering person-level factors that may influence demand.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241273352"},"PeriodicalIF":3.5,"publicationDate":"2024-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142103854","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-08-13DOI: 10.1177/10731911241266286
Leonie Cloos, Merijn Mestdagh, Wolf Vanpaemel, Eva Ceulemans, Peter Kuppens
{"title":"Measuring Continuous Affect in Daily Life With Intensity Profile Drawings.","authors":"Leonie Cloos, Merijn Mestdagh, Wolf Vanpaemel, Eva Ceulemans, Peter Kuppens","doi":"10.1177/10731911241266286","DOIUrl":"https://doi.org/10.1177/10731911241266286","url":null,"abstract":"<p><p>We examined continuous affect drawings as innovative measure of affective experiences over time. Intensive longitudinal data often rely on discrete assessments, containing \"blind spots\" between measurements. With continuous affect drawings participants visually depict their affect fluctuations between assessments. In an experience sampling study, participants (<i>N</i> = 115) rated their momentary positive and negative affect 6 times daily. From the second daily rating on, they additionally drew their positive and negative affect changes and reported affective events between assessments. They received one measurement burst between assessments daily. The strength of the approach is a substantial amount of informational gain (average 7%) over linearly interpolated points between assessments. The additional information was subsequently categorized into positive and negative affect peaks and valleys, each occurring once a day per person on average. The probability of detecting peaks and valleys increased with reported events. The drawings correlated positively with momentary affect scores from the burst. Yet, the drawing predicted the bursts less well suggesting that the momentary ratings may yield different information than the drawings. Although the timing of retrospective drawings is less precise than individual momentary assessments, this method provides a comprehensive understanding of affective experiences between assessments, offering a unique perspective on affect dynamics.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241266286"},"PeriodicalIF":3.5,"publicationDate":"2024-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141974966","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-08-02DOI: 10.1177/10731911241266293
Molly J Gardner, Michael C Edwards
{"title":"Evaluating When Subscores Add Value in Psychological and Health Applications.","authors":"Molly J Gardner, Michael C Edwards","doi":"10.1177/10731911241266293","DOIUrl":"https://doi.org/10.1177/10731911241266293","url":null,"abstract":"<p><p>Many scales used in psychological and health research are designed to yield subscores, yet it is common to see total scores reported instead. One challenge of using subscores is they can lack adequate reliability due to their shortened length. However, methods originally developed for educational measurement have shown that augmenting subscores can improve reliability estimates. Augmented subscores blend the individual score with other sources of information. The present study sought to understand (a) the costs of ignoring subscores in favor of total scores and (b) the extent to which augmentation can help alleviate challenges encountered when using subscores. Data were simulated to examine when subscores should be preferred to total scores and the magnitude of improvement from using augmented subscores over non-augmented subscores. Results suggested that when a scale is designed to yield subscores, there is practical benefit to using them. In situations where subscore reliability is low, we recommend using augmentation.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241266293"},"PeriodicalIF":3.5,"publicationDate":"2024-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141874018","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-07-29DOI: 10.1177/10731911241266306
Thomas B McGuckian, Jade Laracas, Nadine Roseboom, Sophie Eichler, Szymon Kardas, Stefan Piantella, Michael H Cole, Ross Eldridge, Jonathan Duckworth, Bert Steenbergen, Dido Green, Peter H Wilson
{"title":"Portable Touchscreen Assessment of Motor Skill: A Registered Report of the Reliability and Validity of EDNA MoTap.","authors":"Thomas B McGuckian, Jade Laracas, Nadine Roseboom, Sophie Eichler, Szymon Kardas, Stefan Piantella, Michael H Cole, Ross Eldridge, Jonathan Duckworth, Bert Steenbergen, Dido Green, Peter H Wilson","doi":"10.1177/10731911241266306","DOIUrl":"https://doi.org/10.1177/10731911241266306","url":null,"abstract":"<p><p>Portable and flexible administration of manual dexterity assessments is necessary to monitor recovery from brain injury and the effects of interventions across clinic and home settings, especially when in-person testing is not possible or convenient. This paper aims to assess the concurrent validity and test-retest reliability of a new suite of touchscreen-based manual dexterity tests (called <i>EDNA</i>™<i>MoTap</i>) that are designed for portable and efficient administration. A minimum sample of 49 healthy young adults will be conveniently recruited. The <i>EDNA</i>™<i>MoTap</i> tasks will be assessed for concurrent validity against standardized tools (the Box and Block Test [BBT] and the Purdue Pegboard Test) and for test-retest reliability over a 1- to 2-week interval. Correlation coefficients of <i>r</i> > .6 will indicate acceptable validity, and intraclass correlation coefficient (ICC) values > .75 will indicate acceptable reliability for healthy adults. The sample were primarily right-handed (91%) adults aged 19 and 34 years (<i>M</i> = 24.93, <i>SD</i> = 4.21, 50% female). The <i>MoTap</i> tasks did not demonstrate acceptable validity, with tasks showing weak-to-moderate associations with the criterion assessments. Some outcomes demonstrated acceptable test-retest reliability; however, this was not consistent. Touchscreen-based assessments of dexterity remain relevant; however, there is a need for further development of the <i>EDNA</i>™<i>MoTap</i> task administration.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241266306"},"PeriodicalIF":3.5,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141791778","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Continuous Norming Approaches: A Systematic Review and Real Data Example.","authors":"Julian Urban, Vsevolod Scherrer, Anja Strobel, Franzis Preckel","doi":"10.1177/10731911241260545","DOIUrl":"10.1177/10731911241260545","url":null,"abstract":"<p><p>Norming of psychological tests is decisive for test score interpretation. However, conventional norming based on subgroups results either in biases or require very large samples to gather precise norms. Continuous norming methods, namely inferential, semi-parametric, and (simplified) parametric norming, propose to solve those issues. This article provides a systematic review of continuous norming. The review includes 121 publications with overall 189 studies. The main findings indicate that most studies used simplified parametric norming, not all studies considered essential distributional assumptions, and the evidence comparing different norming methods is inconclusive. In a real data example, using the standardization sample of the Need for Cognition-KIDS scale, we compared the precision of conventional, semi-parametric, and parametric norms. A hierarchy in terms of precision emerged with conventional norms being least precise, followed by semi-parametric norms, and parametric norms being most precise. We discuss these findings by comparing our findings and methods to previous studies.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241260545"},"PeriodicalIF":3.5,"publicationDate":"2024-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141765061","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}