Assessment最新文献

{"title":"Natural Language Response Formats for Assessing Depression and Worry With Large Language Models: A Sequential Evaluation With Model Pre-Registration.","authors":"Zhuojun Gu, Katarina Kjell, H Andrew Schwartz, Oscar Kjell","doi":"10.1177/10731911251364022","DOIUrl":"10.1177/10731911251364022","url":null,"abstract":"<p><p>Large language models can transform individuals' mental health descriptions into scores that correlate with rating scales approaching theoretical upper limits. However, such analyses have combined word- and text responses with little known about their differences. We develop response formats ranging from closed-ended to open-ended: (a) select words from lists, write (b) descriptive words, (c) phrases, or (d) texts. Participants answered questions about their depression/worry using the response formats and related rating scales. Language responses were transformed into word embeddings and trained to rating scales. We compare the validity (concurrent, incremental, face, discriminant, and external validity) and reliability (prospective sample and test-retest reliability) of the response formats. Using the <i>Sequential Evaluation with Model Pre-Registration</i> design, machine-learning models were trained on a development dataset (<i>N</i> = 963), and then <i>pre-registered</i> before tested on a prospective sample (<i>N</i> = 145). The pre-registered models demonstrate strong validity and reliability, yielding high accuracy in the prospective sample (<i>r</i> <i>=</i> .60-.79). Additionally, the models demonstrated external validity to self-reported sick-leave/healthcare visits, where the text-format yielded the strongest correlations (being higher/equal to rating scales for 9 of 12 cases). The overall high validity and reliability across formats suggest the possibility of choosing formats according to clinical needs.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"927-953"},"PeriodicalIF":3.0,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13379617/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145091186","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Measurement Invariance of and Mean Differences on the Kessler Psychological Distress Scale (K6) for LGBT and Cisgender, Heterosexual Individuals.","authors":"Anna L Gilmour, Brian A Feinstein, Mark A Whisman","doi":"10.1177/10731911251376235","DOIUrl":"10.1177/10731911251376235","url":null,"abstract":"<p><p>The Kessler Psychological Distress Scale (K6) is used as a self-report measure of nonspecific psychological distress. Although research documents higher K6 scores among lesbian, gay, bisexual, and transgender (LGBT) individuals relative to cisgender, heterosexual individuals, measurement invariance of the K6 has not been established between these groups. We used multigroup confirmatory factor analysis to examine factorial invariance of the K6 between 1,765 LGBT and 20,632 cisgender, heterosexual individuals who completed the Well-Being and Basic Needs Survey. The K6 exhibited configural, weak/metric, and strong/scalar measurement invariance between groups, suggesting that it operates equivalently for both groups. We then examined differences in latent mean K6 scores between groups and differences in the percentage of individuals in each group who met a threshold for serious psychological distress (scores ≥ 13). The latent K6 mean and the percentage of individuals who met the threshold for serious psychological distress were both significantly higher for LGBT than for cisgender, heterosexual individuals.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1044-1054"},"PeriodicalIF":3.0,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145136026","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Psychometric Validation and Preliminary Clinical Correlation of an Experiential Foraging Task.","authors":"Aaron N McInnes, Christi R P Sullivan, Angus W MacDonald, Alik S Widge","doi":"10.1177/10731911251376214","DOIUrl":"10.1177/10731911251376214","url":null,"abstract":"<p><p>Measuring the function of decision-making systems reliably is a key goal to assess cognitive functions that underlie psychopathology. However, few metrics are demonstrably reliable, clinically relevant, and able to capture complex overlapping cognitive domains while quantifying heterogeneity across individuals. The WebSurf task is a reverse-translational human experiential foraging paradigm that indexes naturalistic and clinically relevant decision-making. To determine its potential clinical utility, we examined the psychometric properties and clinical correlates of behavioral parameters extracted from WebSurf in an initial exploratory experiment (<i>N</i> = 132) and a preregistered validation experiment (N = 109). Behavior was stable over repeated administrations of the task, as were individual differences. The ability to measure decision-making consistently supports WebSurf's potential utility to predict treatment response, monitor clinical change, and define neurocognitive profiles associated with psychopathology. Moreover, specific WebSurf metrics were predicted by psychiatric symptoms in a replicable manner. Mania and externalizing symptom profiles predicted variability in reward pursuit, while externalizing profiles also predicted reward evaluation. These replicable results suggest that WebSurf and similar paradigms offer promising platforms for computational psychological methods, providing reliable, clinically relevant metrics of decision-making that may enhance psychiatric assessment and personalize treatment approaches.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1068-1086"},"PeriodicalIF":3.0,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145136014","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The GRoNC: Guidelines for Reporting on Norm-Referenced and Criterion-Referenced Scores.","authors":"Marieke E Timmerman, Annelies De Bildt, Julian Urban","doi":"10.1177/10731911251371395","DOIUrl":"10.1177/10731911251371395","url":null,"abstract":"<p><p>Psychological test manuals vary widely in their reporting of the construction and interpretation of standardized scores. Consequently, the critical evaluation of norm quality and meaning is difficult for test users and reviewers. Because a specific standard for reporting on standardized scores is lacking, we developed Guidelines for Reporting on Norm-referenced and Criterion-referenced Scores (GRoNC), following a systematic approach for creating reporting guidelines (EQUATOR). The development took place in two stages: Stage 1, developing a preliminary version of the GRoNC based on a literature review; Stage 2, a Delphi process in two rounds, involving both theoretical experts (<i>n =</i> 11) and test developers (<i>n =</i> 14). The GRoNC includes a series of questions and associated explanations. It supports test developers in developing and reporting upon their standardized scores, and reviewers in evaluating a psychological test on its standardized scores. We provide recommendations on using the GRoNC and conclude by describing our expectations and plans to increase the impact of the GRoNC on reporting practice.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"954-972"},"PeriodicalIF":3.0,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13379607/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145136163","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Complementary Indicators of Knowledge Purporting and Their Validity.","authors":"Benjamin Goecke, Catherine Schittenhelm, Oliver Wilhelm","doi":"10.1177/10731911261479975","DOIUrl":"https://doi.org/10.1177/10731911261479975","url":null,"abstract":"<p><p>Overclaiming (OC)-the tendency to claim knowledge one does not possess-is predominantly assessed through self-report Overclaiming Questionnaires (OCQs). However, exclusive reliance on OCQs raises concerns about mono-method bias, limiting our understanding of knowledge purporting as a broader psychological disposition. To reduce this bias, we investigated two additional indicators of knowledge purporting and examined their convergent validity with traditional OCQs. In our study (<i>N</i> = 297), one of the new measures scored responses on fictional questions and the other captured discrepancies between self-rated knowledge and actual knowledge. Using latent variable analyses, we found modest convergent relations between the three indicators of knowledge purporting. Apart from these substantial levels of method-specific variance, we found differential relations with covariates, thereby challenging the validity and utility of any specific task class, including the predominantly used OCQs. We recommend that knowledge purporting measures must not be equated with the broader concept of knowledge purporting. While this study suggests that the concept of knowledge purporting may have some generality, it also shows that the methods used to investigate it matter more than they should. Future studies should consider the relationship between multivariate measures of knowledge purporting and further discrepancies between self-reports of knowledge and actual performance.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911261479975"},"PeriodicalIF":3.0,"publicationDate":"2026-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148860346","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Development of an AI-Enabled Remote Loneliness Assessment System for Older Adults Using Behavioral and Speech Data From IoT Sensors and Smart Speakers.","authors":"Mohamed Kamel, Tamer Nadeem, Juyoung Park, Jane Chung","doi":"10.1177/10731911261479255","DOIUrl":"10.1177/10731911261479255","url":null,"abstract":"<p><p>Loneliness is a critical risk factor for adverse health outcomes in older adults, yet remains under-detected due to social stigma, time constraints, and reliance on episodic self-report. We describe HomePal, a passive system designed to support future assessment of loneliness-relevant behavioral patterns in older adults living alone. HomePal integrates in-home sensors, smart speakers, and phone communication logs to capture mobility, environmental engagement, sedentary behavior, sleep, TV use, voice characteristics, and communication patterns over 3 months. Because loneliness overlaps conceptually and empirically with related constructs such as depression and social isolation, we emphasize a construct-driven modality selection framework in which each behavioral indicator is treated as inherently ambiguous and interpretation depends on converging evidence across modalities rather than any single channel. This article details the system's development, including participant-centered deployment procedures, methods for translating sensor data into clinically interpretable behavioral patterns, and a planned semi-supervised learning framework linking behavioral indicators to biweekly UCLA Loneliness Scale assessments alongside planned analyses of convergent and discriminant validity. Illustrative case examples demonstrate the feasibility of deriving multimodal behavioral indicators in real-world home environments. We provide a methodological foundation for passive, ecologically valid AI-based loneliness assessment in older adults.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911261479255"},"PeriodicalIF":3.0,"publicationDate":"2026-08-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13523023/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148838990","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Development and Validation of the Digital Mentalizing Questionnaire: A Multidimensional Self-Report for Online Social Networks.","authors":"Mehdi Rahmani Malek-Abad, Mohammad Reza Abedi","doi":"10.1177/10731911261477186","DOIUrl":"https://doi.org/10.1177/10731911261477186","url":null,"abstract":"<p><p>Digital interactions are increasingly central to human social life, yet existing measures of mentalizing-defined as the capacity to interpret one's own and others' mental states-are primarily designed for face-to-face contexts and fail to capture the unique cognitive-affective demands of online social networks. This research introduces the Digital Mentalizing Questionnaire (DMQ), the first multidimensional, theory-driven instrument specifically developed to assess mentalizing processes in digital environments. Across three studies (<i>N</i>₁ = 278, <i>N</i>₂ = 375, <i>N</i>₃ = 341; participants in Studies 1, 2, and 3 were predominantly female adults with mean ages of 32.95 [<i>SD</i> = 12.10] and 30.89 [<i>SD</i> = 10.68] years, respectively, and varied educational backgrounds), the DMQ demonstrated a robust five-factor structure encompassing Digital Self-Mentalizing, Digital Other-Mentalizing, Digital Emotion Regulation, Digital Anticipatory Mentalizing, and Digital Identity Integration. Exploratory factor analysis (Study 1) and confirmatory factor analysis confirmed structural validity, while internal consistency (α = .67-.86), composite reliability, and 1-month test-retest reliability (<i>r</i> = .58-.79) indicated strong psychometric stability. Measurement invariance across gender further confirmed the scale's applicability for comparative research (Study 2). Convergent validity was supported through theoretically coherent correlations with established mentalizing measures (Reflective Functioning Questionnaire, Mentalization Questionnaire, Mentalization Emotion Questionnaire, Bergen Social Media Addiction Scale) and negative associations with transdiagnostic psychopathology indicators (Study 3). The DMQ offers a validated, ecologically relevant framework for assessing digital mentalizing, bridging classical theory with contemporary online social cognition. Its application holds promise for advancing cyberpsychology research, informing digital well-being interventions, and understanding the socio-cognitive mechanisms underlying online behavior.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911261477186"},"PeriodicalIF":3.0,"publicationDate":"2026-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148811886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The Quadripartite Violence Typology: Exploring its Nomological Network Using the Angry Aggression Scale in a Community Sample of Italian Adults.","authors":"Arianna De Ciechi, Claudia Mazzeschi, Elisa Delvecchio, Richard Howard, Carlo Garofalo","doi":"10.1177/10731911261475807","DOIUrl":"https://doi.org/10.1177/10731911261475807","url":null,"abstract":"<p><p>The Quadripartite Violence Typology (QVT) conceptualizes aggression along intersecting motivational (aversive-appetitive) and self-regulatory (impulsive-controlled) dimensions, yielding four subtypes. This study aimed to expand the nomological network of the Angry Aggression Scale (AAS) within the QVT framework. A community sample of Italian adults (<i>N</i> = 1,238; <i>M</i>_age = 33.5) completed the AAS and measures of aggression, emotion dysregulation, impulsivity, psychopathy, and related constructs. Confirmatory factor analyses supported the four-factor model with partial measurement invariance across sex and adequate internal consistency. Subscales showed distinct yet theoretically coherent nomological profiles, although the impulsive/appetitive subscale demonstrated comparatively lower reliability and weaker nomological specificity. Incremental validity over aggression measures was supported. Findings should be interpreted considering the community-based nature of the sample and may not generalize to populations characterized by severe violent behavior. Overall, results support the AAS as a psychometrically valid tool for assessing motivational and self-regulatory aggression profiles beyond traditional models.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911261475807"},"PeriodicalIF":3.0,"publicationDate":"2026-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148811943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Within-Person and Between-Person Associations Between Self-Reported and Behavioral Executive Function in Women With Attention-Deficit/Hyperactivity Disorder Symptoms.","authors":"Cristina N Pinheiro, Tory Eisenlohr-Moul, Melody R Altschuler, Urveesha Nirjar, Carleigh A Litteral, Emily E Knapp, Layne E Robinson, Justin E Karr, Michelle M Martel","doi":"10.1177/10731911261477188","DOIUrl":"https://doi.org/10.1177/10731911261477188","url":null,"abstract":"<p><p>Executive functioning (EF) impairments are central to attention-deficit/hyperactivity disorder (ADHD), yet correspondence between self-reported and performance-based EF measures is often modest. This discrepancy may be particularly relevant to women, who report greater impairment despite showing similar or fewer objective deficits. This study examined the correspondence between self-reported and performance-based working memory and response inhibition in women with ADHD symptoms. Women completed repeated EF assessments, including EF self-report items and performance-based cognitive tasks designed to engage working memory and inhibitory control. Associations were analyzed at the within- and between-person levels. Performance-based response inhibition showed modest but significant correspondence with self-reported inhibition at both within- (<i>r</i> = .093, <i>p</i> < .001) and between-person (<i>r</i> = .265, <i>p</i> = .010) levels. In contrast, working memory showed no significant between-person association (<i>r</i> = .115, <i>p</i> = .274) and only modest within-person associations (<i>r</i> = .098, <i>p</i> < .001). These findings suggest greater correspondence between self-reported and performance-based measures of response inhibition than working memory. Results highlight the importance of assessing distinct EF components and integrating subjective and performance-based measures when evaluating ADHD in women. State-sensitive assessments may improve detection of context-dependent difficulties and support personalized ADHD screening and intervention.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911261477188"},"PeriodicalIF":3.0,"publicationDate":"2026-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148811879","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Angular Discrepancy and Personality Functioning Across Interpersonal Circumplex Surfaces.","authors":"Kimberly J Gilbert, Christopher J Hopwood","doi":"10.1177/10731911261477174","DOIUrl":"https://doi.org/10.1177/10731911261477174","url":null,"abstract":"<p><p>Multisurface interpersonal assessment (MSIA) compares interpersonal circumplex (IPC) profiles across surfaces such as problems, sensitivities, values, and efficacies. A core premise of MSIA is that cross-surface discrepancy, the degree to which interpersonal themes align or diverge across these surfaces, carries clinical meaning beyond the elevation of any single surface, yet this assumption has rarely been tested directly. The present study operationalized cross-surface discrepancy as the angular distance between surface peaks and examined its association with personality functioning in 1,101 community adults. Greater discrepancy between problems and efficacies (<i>r</i> = -.47) and problems and values (<i>r</i> = -.37) predicted higher levels of personality functioning and explained incremental variance beyond surface elevations (change in <i>R</i>² = .034 and .044). Follow-up analyses suggested that people whose primary problems involved being too cold had higher personality functioning if they had values and efficacies in non-cold regions of the IPC. Associations between personality functioning and problems-sensitivities discrepancy were mostly explained by shared interpersonal dysfunction, and non-problem pairs showed negligible effects. These findings offer initial evidence that people who tend to have problems being too cold have higher levels of personality functioning to the degree they value and can engage in non-cold interpersonal behaviors.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911261477174"},"PeriodicalIF":3.0,"publicationDate":"2026-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148811956","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}