AssessmentPub Date : 2024-12-23DOI: 10.1177/10731911241306370
Tapan A Patel, Morgan Robison, Jesse R Cougle
{"title":"Item Response Theory Analysis and Differential Item Functioning of the Social Appearance Anxiety Scale.","authors":"Tapan A Patel, Morgan Robison, Jesse R Cougle","doi":"10.1177/10731911241306370","DOIUrl":"https://doi.org/10.1177/10731911241306370","url":null,"abstract":"<p><p>This study examined the item- and scale-level functioning of the Social Appearance Anxiety Scale (SAAS) as well as differential functioning by gender using an item response theory (IRT) analysis. SAAS data collected from 840 college students were analyzed. A graded response model was used to analyze the 16 items comprising the SAAS. The measure was found to be unidimensional in its factor structure, and every item demonstrated high to very high ability to differentiate respondents varying in levels of the underlying trait (i.e., appearance concerns). In addition, we found evidence of differential item functioning (DIF) by gender for four items, corresponding to small effect sizes. Two of these items were related to internal experiences of appearance concerns (e.g., nervousness and discomfort when a flaw is noticed by others) that were more likely to be endorsed by women, and two of the items were related to external evaluative experiences related to appearance (e.g., missing opportunities and life being more difficult) that were more likely to be endorsed by men. Overall, the IRT and DIF results suggest that the SAAS effectively identifies appearance concerns among individuals with low to very high appearance concerns.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241306370"},"PeriodicalIF":3.5,"publicationDate":"2024-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142876050","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-14DOI: 10.1177/10731911241301475
Ashmita Ghosh, Nathaniel L Phillips, Chelsea E Sleep, Donald R Lynam, Joshua D Miller
{"title":"Examining the Structure of Personality Dysfunction Among Individuals Involved in Mental Health treatment: A Registered Report.","authors":"Ashmita Ghosh, Nathaniel L Phillips, Chelsea E Sleep, Donald R Lynam, Joshua D Miller","doi":"10.1177/10731911241301475","DOIUrl":"https://doi.org/10.1177/10731911241301475","url":null,"abstract":"<p><p>Personality dysfunction is a core element of the diagnosis of personality disorders in both main diagnostic systems (<i>Diagnostic and Statistical Manual of Mental Disorders</i> [5th ed.] Personality Disorders and <i>ICD-11</i> [<i>International Classification of Diseases</i>, 11th Revision] Personality Disorders). A recent study by Sleep et al. explored the structure of personality dysfunction (<i>N</i> = 517 undergraduates) with exploratory bass-ackward factor analyses at the item level using items from six measures of personality functioning. The present study represents a replication of the study by Sleep and colleagues in a community sample of individuals currently in or seeking psychological/psychiatric treatment. Participants were recruited from Prolific who completed items from six measures of personality dysfunction (<i>N</i> = 457). The primary factor analysis identified three lower-order factors of impairment (Negative Self-Regard, Disagreeableness, and Intimacy Problems). These dysfunction factors showed moderate to strong relations to the factors generated by Sleep et al.; however, there were important differences in the overall structure suggesting a lack of formal replication.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241301475"},"PeriodicalIF":3.5,"publicationDate":"2024-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142823622","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-10DOI: 10.1177/10731911241300002
Jeffrey S Simons, Stephen A Maisto, Raluca M Simons, Jessica A Keith, Tibor P Palfai, Kyle J Walters, Surabhi Swaminath, Kawon Kim, Patrick J Ronan
{"title":"Response Rates, Reliability, and Convergent Validity in Experience Sampling Data.","authors":"Jeffrey S Simons, Stephen A Maisto, Raluca M Simons, Jessica A Keith, Tibor P Palfai, Kyle J Walters, Surabhi Swaminath, Kawon Kim, Patrick J Ronan","doi":"10.1177/10731911241300002","DOIUrl":"https://doi.org/10.1177/10731911241300002","url":null,"abstract":"<p><p>This study examined associations of compliance rate with the reliability and convergent validity of intoxication and negative affect assessments in experience sampling method (ESM) data in three samples (Veterans, Sexual Minority Men, and College Students). Convergent validity was operationalized as within-person associations between daily aggregates of random in situ assessments and retrospective daily assessments or transdermal alcohol assessments. Measures with lower ICC require more assessments for a reliable aggregate (e.g., daily mean). In this regard, the number of completed assessments and intraclass correlation (ICC), rather than compliance with the protocol per se, determines reliability. Although convergent validity was correlated with compliance rate, the relatively weak associations reflect that there are individuals with excellent compliance yet poor convergent validity as well as individuals with poor compliance and excellent convergent validity. The pattern of results does not show a clear threshold for compliance (e.g., 80%) that differentiates good versus poor validity.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241300002"},"PeriodicalIF":3.5,"publicationDate":"2024-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142799333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-10DOI: 10.1177/10731911241298081
Meltem Ozcan, Mark H C Lai
{"title":"Exploring the Impact of Deleting (or Retaining) a Biased Item: A Procedure Based on Classification Accuracy.","authors":"Meltem Ozcan, Mark H C Lai","doi":"10.1177/10731911241298081","DOIUrl":"10.1177/10731911241298081","url":null,"abstract":"<p><p>Psychological test scores are commonly used in high-stakes settings to classify individuals. While measurement invariance across groups is necessary for valid and meaningful inferences of group differences, full measurement invariance rarely holds in practice. The classification accuracy analysis framework aims to quantify the degree and practical impact of noninvariance. However, how to best navigate the next steps remains unclear, and methods devised to account for noninvariance at the group level may be insufficient when the goal is classification. Furthermore, deleting a biased item may improve fairness but negatively affect performance, and replacing the test can be costly. We propose item-level effect size indices that allow test users to make more informed decisions by quantifying the impact of deleting (or retaining) an item on test performance and fairness, provide an illustrative example, and introduce <i>unbiasr</i>, an R package implementing the proposed methods.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241298081"},"PeriodicalIF":3.5,"publicationDate":"2024-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142799309","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-07DOI: 10.1177/10731911241299499
David K Marcus, Paul S Strand, Brian F French
{"title":"A Taxometric Analysis and External Validation of the Latent Structure of Student Risks and Needs.","authors":"David K Marcus, Paul S Strand, Brian F French","doi":"10.1177/10731911241299499","DOIUrl":"https://doi.org/10.1177/10731911241299499","url":null,"abstract":"<p><p>The present study applied taxometric analyses to the Washington Assessment of Risks and Needs of Students (WARNS)-an instrument designed to assess multiple domains of functioning related to justice system involvement arising from school disengagement-a trajectory referred to as <i>the school to prison pipeline</i>. Previous taxometric studies of constructs related to juvenile justice system involvement found dimensional rather than taxonic (dichotomous) latent structures. Participants were 5008 students from 89 Washington school districts who completed the WARNS as part of standard educational practices. The results were uniformly consistent with a dimensional latent structure. Also supporting a dimensional latent structure, dichotomized WARNS scores were significantly less strongly associated with student arrests, school suspensions, and school skip days than continuous WARNS scores. These findings support the dimensionality of risk and needs and have implications for assessments undertaken to improve school and social outcomes for at-risk youth.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241299499"},"PeriodicalIF":3.5,"publicationDate":"2024-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142791010","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-05DOI: 10.1177/10731911241298083
Frederick Anyan, Andreas Espetvedt Nordstrand, Odin Hjemdal, Line Rønning, Ann Hergatt Huffman, Laura K Noll, Christer Lunde Gjerstad, Robert E Wickham, Hans Jakob Bøe
{"title":"Development and Validation of a Brief Warzone Stressor Exposure Index.","authors":"Frederick Anyan, Andreas Espetvedt Nordstrand, Odin Hjemdal, Line Rønning, Ann Hergatt Huffman, Laura K Noll, Christer Lunde Gjerstad, Robert E Wickham, Hans Jakob Bøe","doi":"10.1177/10731911241298083","DOIUrl":"https://doi.org/10.1177/10731911241298083","url":null,"abstract":"<p><p>Existing scales mainly focus on danger-based threats of death and bodily harm to assess exposure to traumatic events in war zone. However, major provocations and transgression of deeply held values and moral beliefs, as well as witnessing the suffering of others can be as traumatic as fear-inducing danger-based events. This raises the need for scales that assess both danger- and nondanger-based events among soldiers operating in modern war zones. Norwegian military personnel deployed to Afghanistan between late 2001 and end of 2020 were invited to participate in a cross-sectional survey with a final sample size of 6,205 (males: <i>n</i> = 5,693; 91.7%; mean age = 41.93 years). We applied data reduction techniques (e.g., exploratory factor analysis, EFA, and exploratory graph analysis, EGA, through a community detection algorithm) to develop a 12-item, three-factor model (personal threat, traumatic witnessing, and moral injury) of the Warzone Stressor Exposure Index (WarZEI). Confirmatory factor analysis showed support for the factor model, with evidence of concurrent, discriminant, and incremental validity. These results indicate the WarZEI is a reliable and valid measure for assessing exposure to warzone stressors that allows for heterogeneity and the multidimensional nature of exposure to warzone stressors.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241298083"},"PeriodicalIF":3.5,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142784064","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-01Epub Date: 2024-02-07DOI: 10.1177/10731911231225191
Bronwen Perley-Robertson, Kelly M Babchishin, L Maaike Helmus
{"title":"The Effect of Missing Item Data on the Relative Predictive Accuracy of Correctional Risk Assessment Tools.","authors":"Bronwen Perley-Robertson, Kelly M Babchishin, L Maaike Helmus","doi":"10.1177/10731911231225191","DOIUrl":"10.1177/10731911231225191","url":null,"abstract":"<p><p>Missing data are pervasive in risk assessment but their impact on predictive accuracy has largely been unexplored. Common techniques for handling missing risk data include summing available items or proration; however, multiple imputation is a more defensible approach that has not been methodically tested against these simpler techniques. We compared the validity of these three missing data techniques across six conditions using STABLE-2007 (<i>N</i> = 4,286) and SARA-V2 (<i>N</i> = 455) assessments from men on community supervision in Canada. Condition 1 was the observed data (low missingness), and Conditions 2 to 6 were generated missing data conditions, whereby 1% to 50% of items per case were randomly deleted in 10% increments. Relative predictive accuracy was unaffected by missing data, and simpler techniques performed just as well as multiple imputation, but summed totals underestimated absolute risk. The current study therefore provides empirical justification for using proration when data are missing within a sample.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1643-1657"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11490059/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139696868","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-01Epub Date: 2024-02-12DOI: 10.1177/10731911241229568
Amanda M Raines, Kate E Clauss, Dustin Seidler, Nicholas P Allan, Jon D Elhai, Jennifer J Vasterling, Joseph I Constans, Kelly P Maieritsch, C Laurel Franklin
{"title":"A Bifactor Evaluation of Self-Report and Clinician-Administered Measures of PTSD in Veterans.","authors":"Amanda M Raines, Kate E Clauss, Dustin Seidler, Nicholas P Allan, Jon D Elhai, Jennifer J Vasterling, Joseph I Constans, Kelly P Maieritsch, C Laurel Franklin","doi":"10.1177/10731911241229568","DOIUrl":"10.1177/10731911241229568","url":null,"abstract":"<p><p>The PTSD Checklist for <i>DSM-5</i> (PCL-5) and the Clinician-Administered PTSD Scale for <i>DSM-5</i> (CAPS-5) are two of the most widely used and well-validated PTSD measures providing total and subscale scores that correspond with <i>DSM-5</i> PTSD symptoms. However, there is little information about the utility of subscale scores above and beyond the total score for either measure. The current study compared the proposed <i>DSM-5</i> four-factor model to a bifactor model across both measures using a sample of veterans (<i>N</i> = 1,240) presenting to a Veterans Affairs (VA) PTSD specialty clinic. The correlated factors and bifactor models for both measures evidenced marginal-to-acceptable fit and were retained for further evaluation. Bifactor specific indices suggested that both measures exhibited a strong general factor but weak lower-order factors. Structural regressions revealed that most of the lower-order factors provided little utility in predicting relevant outcomes. Although additional research is needed to make definitive statements about the utility of PCL-5 and CAPS-5 subscales, study findings point to numerous weaknesses. As such, caution should be exercised when using or interpreting subscale scores in future research.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1674-1686"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139721338","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-01Epub Date: 2024-02-21DOI: 10.1177/10731911241229575
Jone Martínez-Bacaicoa, Miguel A Sorrel, Manuel Gámez-Guadix
{"title":"Development and Validation of Technology-Facilitated Sexual Violence Perpetration and Victimization Scales Among Adults.","authors":"Jone Martínez-Bacaicoa, Miguel A Sorrel, Manuel Gámez-Guadix","doi":"10.1177/10731911241229575","DOIUrl":"10.1177/10731911241229575","url":null,"abstract":"<p><p>Technology-facilitated sexual violence (TFSV) includes different forms of digital violence, such as online gender-based violence, online gender- and sexuality-based violence, digital sexual harassment, online sexual coercion, and nonconsensual pornography. The aim of this study was to design and validate a measure to assess the perpetration and victimization of each dimension of TFSV. The relationships between the different dimensions and differences by gender and sexual orientation were also analyzed. The participants were a sample of 2,486 adults (69% women) from Spain, aged between 16 and 79 (<i>M</i> = 25.95; <i>DT</i> = 9.809) years. The Technology-Facilitated Sexual Violence Scales were found to be valid and reliable instruments, supporting our recommendation for the use of these scales. Network analysis and solution-based exploratory factor analyses showed that the dimensions of online sexual coercion and nonconsensual pornography clustered together. All the perpetration variables were related to sexism. Finally, cis women and nonheterosexual people reported higher victimization scores overall compared to cis men and heterosexuals, respectively, while cis men reported higher perpetration scores overall than cis women.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1580-1597"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139911951","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-01Epub Date: 2024-02-09DOI: 10.1177/10731911241229060
R Noah Padgett, Matthew T Lee, Renae Wilkinson, Heather Tsavaris, Tyler J VanderWeele
{"title":"Reliability and Validity of a Multidimensional Measure of Subjective Community Well-Being.","authors":"R Noah Padgett, Matthew T Lee, Renae Wilkinson, Heather Tsavaris, Tyler J VanderWeele","doi":"10.1177/10731911241229060","DOIUrl":"10.1177/10731911241229060","url":null,"abstract":"<p><p>An individual's flourishing is sustained by and dependent on their community's well-being. We provide one of the first studies of a measure of communal subjective well-being, focusing on individuals' relationships with their community. Using two samples from the Greater Columbus, Ohio region, we provide evidence of the reliability and validity of the Subjective Community Well-being (SCWB) assessment. The five domains of the SCWB are Good Relationships (α = .92), Proficient Leadership (α = .93), Healthy Practices (α = .92), Satisfying Community (α = .88), and Strong Mission (α = .81). A community-based sample (<i>N</i> = 1,435) and an online sample of Columbus residents (<i>N</i> = 692) were scored on the SCWB and compared across domains. We found evidence that the SCWB scores differentiate between active and less active community members. We discuss the appropriate uses of the SCWB as a measure of well-being and provide recommendations for research that could profitably utilize the SCWB measure to examine community well-being.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1658-1673"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139708972","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}