AssessmentPub Date : 2024-12-01Epub Date: 2024-02-27DOI: 10.1177/10731911241234104
Julia Simner, Louisa J Rinaldi, Jamie Ward
{"title":"An Automated Online Measure for Misophonia: The <i>Sussex Misophonia Scale for Adults</i>.","authors":"Julia Simner, Louisa J Rinaldi, Jamie Ward","doi":"10.1177/10731911241234104","DOIUrl":"10.1177/10731911241234104","url":null,"abstract":"<p><p>Misophonia is a sound sensitivity disorder characterized by a strong aversion to specific sounds (e.g., chewing). Here we present the <i>Sussex Misophonia Scale for Adults</i> (<i>SMS-Adult</i>), within an online open-access portal, with automated scoring and results that can be shared ethically with users and professionals. Receiver operator characteristics show our questionnaire to be \"excellent\" and \"good-to-excellent\" at classifying misophonia, both when dividing our <i>n</i> = 501 adult participants by recruitment stream (self-declared misophonics vs. general population), and again when dividing them with by a prior measure of misophonia (as misophonics vs. non-misophonics). Factor analyses identified a five-factor structure in our 39 Likert-type items, and these were <i>Feelings/Isolation</i>, <i>Life consequences</i>, <i>Intersocial reactivity</i>, <i>Avoidance/Repulsion</i>, and <i>Pain</i>. Our measure also elicits misophonia triggers, each rated for their commonness in misophonia. We offer our open-access online tool for wider use (www.misophonia-hub.org), embedded within a well-stocked library of resources for misophonics, researchers, and clinicians.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1598-1614"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11528938/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139982285","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-01Epub Date: 2024-03-04DOI: 10.1177/10731911241234734
Tjhin Wiguna, Kusuma Minayati, Fransiska Kaligis, Sylvia Dominic Teh, Maria Krishnandita, Nabella Meriem Annisa Fitri, Raden Irawati Ismail, Adilla Hastika Fasha, Steven, Raymond Bahana
{"title":"Using the Indonesian Computer-Based Game Prototype as a Computer-Based Game Inventory for Executive Function in Children and Adolescents: A Confirmatory Factor Analysis and Concurrent Validity Study.","authors":"Tjhin Wiguna, Kusuma Minayati, Fransiska Kaligis, Sylvia Dominic Teh, Maria Krishnandita, Nabella Meriem Annisa Fitri, Raden Irawati Ismail, Adilla Hastika Fasha, Steven, Raymond Bahana","doi":"10.1177/10731911241234734","DOIUrl":"10.1177/10731911241234734","url":null,"abstract":"<p><p>Executive function influences children's learning abilities and organizes their cognitive processes, behaviors, and emotions. This cross-sectional study examined whether an Indonesian Computer-Based Game (ICbG) prototype could be used as a Computer-Based Game Inventory for Executive Function (CGIEF) in children and adolescents. The study was conducted with 200 children, adolescents, and their parents. The parents completed the Behavior Rating Inventory of Executive Functioning (BRIEF) questionnaire, and the children and adolescents completed the CGIEF. Confirmatory factor analysis (CFA) and structural equation modeling (SEM) were performed using LISREL Version 8.80. The construct of CGIEF was valid/fit with normal theory-weighted least squares = 15.75 (<i>p</i> > .05). SEM analysis showed that the theoretical construct of the CGIEF was a valid predictor of executive function. The critical <i>t</i> value of the pathway was 2.45, and normal theory-weighted least squares was 5.74 (<i>p</i> > .05). The construct reliability (CR) for CGIEF was 0.91. Concurrent validity was assessed using the Bland-Altman plot, and the coefficient of repeatability (bias/mean) was nearly zero between the <i>t</i> scores of total executive functions of the CGIEF and BRIEF. This preliminary study showed that the CGIEF can be useful as a screening tool for executive dysfunction, metacognitive deficits, and behavioral regulation problems among children and adolescents in clinical samples.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1721-1734"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140027286","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-01Epub Date: 2024-03-08DOI: 10.1177/10731911241234220
Daniel Ventus, Patrik Söderberg
{"title":"Are In-the-Moment Resilience Processes Predicted by Questionnaire-Based Measures of Resilience?","authors":"Daniel Ventus, Patrik Söderberg","doi":"10.1177/10731911241234220","DOIUrl":"10.1177/10731911241234220","url":null,"abstract":"<p><p>Research on resilience is a growing field, and resilience has been conceptualized and operationalized in multiple ways. The aim of this study was to compare the Brief Resilient Coping Scale (BRCS), a conventional measure of resilience, with within-person process indicators derived from experience sampling method (ESM). A sample of 177 teachers from southern Finland participated in the study, commencing with a startup session followed by an 8-day ESM period. Through twice-daily prompts, participants reported their immediate positive and negative affect as well as recent stressors encountered, such as workload and challenging social interactions. As expected, within-person variation in affect was predicted by stressors. However, contrary to expectations, individual differences in affective reactivity to stressors were not predicted by BRCS (β<sub>positive affect</sub> [95% CI] = -.20, [-.51, .11]; β<sub>negative affect</sub> = .33, [-.07, .69]). Item response theory analyses of the BRCS revealed problems with precision. The results call into question the validity of measuring resilience using single administrations of retrospective self-report questionnaires such as the BRCS.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1615-1625"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11484166/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140058577","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-01Epub Date: 2024-03-11DOI: 10.1177/10731911241236315
Pablo Ezequiel Flores-Kanter, Jesús M Alvarado
{"title":"The State of Open Science Practices in Psychometric Studies of Suicide: A Systematic Review.","authors":"Pablo Ezequiel Flores-Kanter, Jesús M Alvarado","doi":"10.1177/10731911241236315","DOIUrl":"10.1177/10731911241236315","url":null,"abstract":"<p><p>The adoption of open science practices (OSPs) is crucial for promoting transparency and robustness in research. We conducted a systematic review to assess the frequency and trends of OSPs in psychometric studies focusing on measures of suicidal thoughts and behavior. We analyzed publications from two international databases, examining the use of OSPs such as open access publication, preregistration, provision of open materials, and data sharing. Our findings indicate a lack of adherence to OSPs in psychometric studies of suicide. The majority of manuscripts were published under restricted access, and preregistrations were not utilized. The provision of open materials and data was rare, with limited access to instruments and analysis scripts. Open access versions (preprints/postprints) were scarce. The low adoption of OSPs in psychometric studies of suicide calls for urgent action. Embracing a culture of open science will enhance transparency, reproducibility, and the impact of research in suicide prevention efforts.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1567-1579"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140100919","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-01Epub Date: 2024-03-11DOI: 10.1177/10731911241235465
Luciano Giromini, Claudia Pignolo, Alessandro Zennaro, Martin Sellbom
{"title":"Using the MMPI-2-RF, IOP-29, IOP-M, and FIT in the In-Person and Remote Administration Formats: A Simulation Study on Feigned mTBI.","authors":"Luciano Giromini, Claudia Pignolo, Alessandro Zennaro, Martin Sellbom","doi":"10.1177/10731911241235465","DOIUrl":"10.1177/10731911241235465","url":null,"abstract":"<p><p>Our study compared the impact of administering Symptom Validity Tests (SVTs) and Performance Validity Tests (PVTs) in in-person versus remote formats and assessed different approaches to combining validity test results. Using the MMPI-2-RF, IOP-29, IOP-M, and FIT, we assessed 164 adults, with half instructed to feign mild traumatic brain injury (mTBI) and half to respond honestly. Within each subgroup, half completed the tests in person, and the other half completed them online via videoconferencing. Results from 2 ×2 analyses of variance showed no significant effects of administration format on SVT and PVT scores. When comparing feigners to controls, the MMPI-2-RF RBS exhibited the largest effect size (d = 3.05) among all examined measures. Accordingly, we conducted a series of two-step hierarchical logistic regression models by entering the MMPI-2-RF RBS first, followed by each other SVT and PVT individually. We found that the IOP-29 and IOP-M were the only measures that yielded incremental validity beyond the effects of the MMPI-2-RF RBS in predicting group membership. Taken together, these findings suggest that administering these SVTs and PVTs in-person or remotely yields similar results, and the combination of MMPI and IOP indexes might be particularly effective in identifying feigned mTBI.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1626-1642"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140100920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-01Epub Date: 2024-02-15DOI: 10.1177/10731911241229566
Tiffany Wu, Christina Weiland, Meghan McCormick, JoAnn Hsueh, Catherine Snow, Jason Sachs
{"title":"One Score to Rule Them All? Comparing the Predictive and Concurrent Validity of 30 Hearts and Flowers Scoring Approaches.","authors":"Tiffany Wu, Christina Weiland, Meghan McCormick, JoAnn Hsueh, Catherine Snow, Jason Sachs","doi":"10.1177/10731911241229566","DOIUrl":"10.1177/10731911241229566","url":null,"abstract":"<p><p>The Hearts and Flowers (H&F) task is a computerized executive functioning (EF) assessment that has been used to measure EF from early childhood to adulthood. It provides data on accuracy and reaction time (RT) across three different task blocks (hearts, flowers, and mixed). However, there is a lack of consensus in the field on how to score the task that makes it difficult to interpret findings across studies. The current study, which includes a demographically diverse population of kindergarteners from Boston Public Schools (<i>N</i> = 946), compares the predictive and concurrent validity of 30 ways of scoring H&F, each with a different combination of accuracy, RT, and task block(s). Our exploratory results provide evidence supporting the use of a <i>two-vector average</i> score based on Zelazo et al.'s approach of adding accuracy and RT scores together only after individuals pass a certain accuracy threshold. Findings have implications for scoring future tablet-based developmental assessments.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1702-1720"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139740249","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-12-01Epub Date: 2024-02-12DOI: 10.1177/10731911241229573
Pascal Schlechter, Sharon A S Neufeld
{"title":"Longitudinal and Gender Measurement Invariance of the General Health Questionnaire-12 (GHQ-12) From Adolescence to Emerging Adulthood.","authors":"Pascal Schlechter, Sharon A S Neufeld","doi":"10.1177/10731911241229573","DOIUrl":"10.1177/10731911241229573","url":null,"abstract":"<p><p>Psychological distress often onsets during adolescence, necessitating an accurate understanding of its development. Assessing change in distress is based on the seldom examined premise of longitudinal measurement invariance (MI). Thus, we used three waves of data from Next Steps, a representative cohort of young people in the UK (<i>N</i> = 13,539) to examine MI of the General Health Questionnaire-12 (GHQ-12). We examined MI across time and gender from ages 15 to 25 in four competing latent models: (a) a single-factor model, (b) a three-factor correlated model, (c) a bifactor model of \"general distress\" and two orthogonal specific factors capturing positive and negative wording, and (d) a single-factor model including error covariances of negatively phrased items. We also tested acceptability of assumptions underlying sum score models. For all factor models, residual MI was confirmed from ages 15 to 25 years and across gender. The bifactor model had the best fit. While sum score model fit was not unequivocally acceptable, most mean differences across time and gender were equivalent across sum scores and latent difference scores. Thus, GHQ-12 sum scores may be used to assess change in psychological distress in young people. However, latent scores appear more accurate, and model fit can be improved by accounting for item wording.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"1687-1701"},"PeriodicalIF":3.5,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11492552/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139721339","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-11-29DOI: 10.1177/10731911241299723
E David Klonsky
{"title":"How to Produce, Identify, and Motivate Robust Psychological Science: A Roadmap and a Response to Vize et al.","authors":"E David Klonsky","doi":"10.1177/10731911241299723","DOIUrl":"https://doi.org/10.1177/10731911241299723","url":null,"abstract":"<p><p>Some wish to mandate preregistration as a response to the replication crisis, while I and others caution that such mandates inadvertently cause harm and distract from more critical reforms. In this article, after briefly critiquing a recently published defense of preregistration mandates, I propose a three-part vision for cultivating a robust and cumulative psychological science. First, we must know how to produce robust rather than fragile findings. Key ingredients include sufficient sample sizes, valid measurement, and honesty/transparency. Second, we must know how to identify robust (and non-robust) findings. To this end, I reframe robustness checks broadly into four types: across analytic decisions, across measures, across samples, and across investigative teams. Third, we must be motivated to produce and care about robust science. This aim requires marshaling sociocultural forces to support, reward, and celebrate the production of robust findings, just as we once rewarded flashy but fragile findings. Critically, these sociocultural reinforcements must be tied as closely as possible to rigor and robustness themselves-rather than cosmetic indicators of rigor and robustness, as we have done in the past.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241299723"},"PeriodicalIF":3.5,"publicationDate":"2024-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142754457","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-11-28DOI: 10.1177/10731911241298079
Charlie C Su, Camilo J Ruggero, Craig S Neumann, David C Cicero
{"title":"Measurement Equivalence of Family Functioning and Psychosis Risk Measures in the Adolescent Brain Cognitive Development<sup>SM</sup> Study.","authors":"Charlie C Su, Camilo J Ruggero, Craig S Neumann, David C Cicero","doi":"10.1177/10731911241298079","DOIUrl":"https://doi.org/10.1177/10731911241298079","url":null,"abstract":"<p><p>Decades of research show a clear link between family factors and psychopathology. Family functioning varies across cultures, suggesting potential cultural differences in the association between family factors and psychopathology. In addition, assessing family functioning generally involves tools not systematically validated for diverse cultural backgrounds. Using the Adolescent Brain Cognitive Development<sup>SM</sup> data (<i>N</i> = 11,864), this study found: (a) full scalar invariance was tenable for the Children's Reports of Parental Behavior Inventory (CRPBI) and Prodromal Questionnaire-Brief Child Version (PQ-BC) across race/ethnicity, but not for the Family Environment Scale (FES) and Parental Monitoring Survey (PMQ); (b) the CRPBI and PMQ were significantly associated with the PQ-BC, and (c) all three family scales had equivalent relations with the PQ-BC across groups. This highlights the importance of evaluating scales for measurement invariance across race/ethnicity. Results also help to connect specific family factors to the etiology of psychosis risk among U.S. children and adolescents.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241298079"},"PeriodicalIF":3.5,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142738201","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AssessmentPub Date : 2024-11-23DOI: 10.1177/10731911241289249
Lindsay N Gabel, Thomas M Olino, Brandon L Goldstein, Daniel N Klein, Kasey Stanton, Elizabeth P Hayden
{"title":"Latent Structure and Item Functioning of Self-Referent Encoding Task Word Stimuli in Preadolescent Youth.","authors":"Lindsay N Gabel, Thomas M Olino, Brandon L Goldstein, Daniel N Klein, Kasey Stanton, Elizabeth P Hayden","doi":"10.1177/10731911241289249","DOIUrl":"https://doi.org/10.1177/10731911241289249","url":null,"abstract":"<p><p>The Self-Referent Encoding Task (SRET) can be used to measure self-concept via endorsement of trait words, a robust metric associated with depression severity. Our study is the first to investigate the structural validity and item functioning of SRET endorsement scores using confirmatory factor analysis and item response theory. Community-dwelling preadolescent youth (<i>N</i> = 508; <i>M</i><sub>age</sub> = 12.39 years, <i>SD</i><sub>age</sub> = .72) were shown a list of positive and negative trait adjectives and made binary ratings of whether words were self-descriptive. The SRET exhibited a two-factor structure, comprising positive and negative factors. Positive items were endorsed by most children and best estimated information about positive self-concepts below average levels of positivity. Conversely, negative items were unendorsed by most children and best estimated information about negative self-concepts above average levels of negativity. We identify standardized, psychometrically sound, and developmentally sensitive SRET items for assessing youth self-concept and its associations with depression risk.</p>","PeriodicalId":8577,"journal":{"name":"Assessment","volume":" ","pages":"10731911241289249"},"PeriodicalIF":3.5,"publicationDate":"2024-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142695241","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}