{"title":"Two-part sequential measurement models for distinguishing between symptom presence and symptom severity.","authors":"Scott A Baldwin, Joseph A Olsen","doi":"10.3758/s13428-025-02666-7","DOIUrl":"10.3758/s13428-025-02666-7","url":null,"abstract":"<p><p>Two common aspects of symptom measurement are 1) the occurrence or presence of symptoms, and 2) the intensity or severity of symptoms when they occur. We adopt a latent trait perspective based on item response theory (IRT), using both unidimensional and multidimensional IRT models. We demonstrate how to (a) prepare data for analysis, (b) specify, estimate, and compare models, (c) interpret model parameters, (d) compare scores from models, and (e) visualize analysis results. We develop the relevant sequential IRT model, noting its flexibility, congruence with the theorized data generating process for symptom measures, and its promise for facilitating additional research and practical applications. The sequential model is less frequently used than other IRT models for polytomous data such as the generalized partial credit or graded response models. However, estimation of the sequential model can be readily accomplished with standard latent variable modeling and IRT software for binary indicators that allows constraints on the discrimination parameters. We compare the sequential model to other modeling options. We provide discussion of future research directions.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"178"},"PeriodicalIF":4.6,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144126463","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Eye-tracking-based hidden Markov modeling for revealing within-item cognitive strategy switching.","authors":"Zhimou Wang, Peida Zhan","doi":"10.3758/s13428-025-02678-3","DOIUrl":"10.3758/s13428-025-02678-3","url":null,"abstract":"<p><p>Identifying cognitive strategies in problem-solving helps researchers understand advanced cognitive processes and their applicable contexts. Current methods typically identify strategies for each item of Raven's Advanced Progressive Matrices, capturing only between-item cognitive strategy switching (CSS). Although within-item CSS is recognized, methods to dynamically identify and reveal it are lacking. This study introduces the concept of an eye movement snippet, a basic unit for studying within-item CSS, along with a new eye-tracking process measure that quantifies the sequence length of alternatives viewed in a snippet. Combined with hidden Markov modeling, we propose a new method for dynamically identifying within-item cognitive strategies and revealing their switching. Using eye-tracking data from a matrix reasoning test, we demonstrate the value of the proposed method through a series of analyses. The results indicate that during problem-solving: (1) participants predominantly used two strategies-constructive matching and response elimination; (2) there is a high probability of switching from constructive matching to response elimination, but not vice versa; (3) more difficult items lead to more frequent strategy switching; (4) frequent strategy switching decreases time spent in the matrix area and on problem-solving planning; (5) frequent strategy switching correlates with incorrect answers for some items; and (6) frequent strategy switching increases total response time. Additionally, within-item CSS showed three distinct patterns as the test progressed, with significant differences in participants' intelligence levels and total test time among the patterns. Overall, the proposed method effectively identifies within-item cognitive strategies and their switching in matrix reasoning tasks.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"175"},"PeriodicalIF":4.6,"publicationDate":"2025-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144101204","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Julius Fenn, Florian Gouret, Michael Gorki, Lisa Reuter, Wilhelm Gros, Paul Hüttner, Andrea Kiesel
{"title":"Cognitive-affective maps extended logic: Proposing tools to collect and analyze attitudes and belief systems.","authors":"Julius Fenn, Florian Gouret, Michael Gorki, Lisa Reuter, Wilhelm Gros, Paul Hüttner, Andrea Kiesel","doi":"10.3758/s13428-025-02699-y","DOIUrl":"10.3758/s13428-025-02699-y","url":null,"abstract":"<p><p>Cognitive-affective maps extended logic is a software package that includes three tools designed for the collection and analysis of cognitive-affective maps (CAMs). CAMs are an innovative research method used to identify, visually represent, and analyze belief systems or any semantic knowledge. By instructing participants on how to draw a CAM, they can create a visual depiction of a belief system that illustrates their attitudes, thoughts, and emotional associations regarding a specific topic. CAMs can be considered as networks enabling participants to freely draw concepts and illustrate the affective (emotional) evaluations and connections between them. To simplify the creation of CAM studies, we first developed an administrative panel for researchers which enables them to set up CAM studies without any coding. Second, to draw CAMs, a tool was developed to give participants the opportunity to create a visual depiction of their own belief system regarding a specific topic. Third, the resulting data can be analyzed using the respective data analysis app, which tracks each analysis step to make the analysis process fully transparent. As a time-efficient approach, CAMs can be used to inform exploratory research questions, like the conceptualization of surveys, or be valuable as an independent method. The tools are available under a free and open-source license. Further information, code, and comprehensive documentation are available at https://drawyourminds.de .</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"174"},"PeriodicalIF":4.6,"publicationDate":"2025-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12089172/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144101151","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Extending Lawson and Robins' (2021) guideline for the evaluation of jingle and jangle fallacies.","authors":"Christian Blötner","doi":"10.3758/s13428-025-02691-6","DOIUrl":"10.3758/s13428-025-02691-6","url":null,"abstract":"<p><p>The existence of jingle fallacies (equally named constructs/measures that, in fact, assess different constructs) and jangle fallacies (differently named constructs/measures that, in fact, measure the same concept) jeopardizes psychological assessment, as both are associated with conceptual and assessment-related uncertainties. A guideline presented by Lawson and Robins Personality and Social Psychology Review, 25, 344-366, (2021) helps evaluate the intensity of respective fallacies. While the guideline is well elaborated, psychometric aspects regarding (dis)similarities of nomological networks require extensions and differentiations. I recommend two analytical advancements, namely (a) the derivation of correlation difference hypotheses for criteria with which the allegedly jingled (jangled) variables are assumed to be correlated at equal (different) levels and (b) procedures to derive cutoffs for the overall similarity of nomological networks based on the elemental approach (Kay & Arrow Social and Personality Psychology Compass, 16, e12662, 2022). Considering correlation difference tests, I further outline the importance of power analyses. These extensions help improve the evaluation of assumed jingle and jangle fallacies, arguably increasing the stability and reliability of research findings.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"177"},"PeriodicalIF":4.6,"publicationDate":"2025-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12089215/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144101198","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Parsimonious item response theory modeling with the cauchit link: Revisiting the rationale of the four-parameter logistic model.","authors":"Hyejin Shim, Wes Bonifay, Wolfgang Wiedermann","doi":"10.3758/s13428-025-02700-8","DOIUrl":"10.3758/s13428-025-02700-8","url":null,"abstract":"<p><p>Application of the four-parameter logistic model (4PLM) in item response theory (IRT) research is contentious due to the complexities of estimating the asymptotes that correspond to upper and lower asymptote effects. We introduce the cauchit IRT model (i.e., a model that utilizes a link function based on the Cauchy distribution) as a compelling parsimonious alternative to the 4PLM. Through comprehensive simulation studies and real-data analysis, we determine that the cauchit model, distinguished by its symmetric error distribution and pronounced tails, provides a streamlined solution, because the tail-pronounced symmetric error distribution captures key features of the 4PLM with only one item parameter. The 4PLM requires large sample sizes (e.g., N > 5000), medium item difficulty, and high discrimination when both upper and lower asymptote effects are present. In contrast, we show that the cauchit model works well with drastically smaller sample sizes (e.g., N = 100). Our study further discusses the versatility of the cauchit model, underscoring its adaptability, especially in small sample research situations.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"176"},"PeriodicalIF":4.6,"publicationDate":"2025-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144101208","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Evaluation of data collection and annotation approaches of driver gaze dataset.","authors":"Pavan Kumar Sharma, Pranamesh Chakraborty","doi":"10.3758/s13428-025-02679-2","DOIUrl":"10.3758/s13428-025-02679-2","url":null,"abstract":"<p><p>Driver gaze estimation is important for various driver gaze applications such as building advanced driving assistance systems and understanding driver gaze behavior. Gaze estimation in terms of gaze zone classification requires large-scale labeled data for supervised machine learning and deep learning-based models. In this study, we collected a driver gaze dataset and annotated it using three annotation approaches - manual annotation, Speak2Label, and moving pointer-based annotation. Moving pointer-based annotation was introduced as a new data annotation approach inspired by screen-based gaze data collection. For each data collection approach, ground truth labels were obtained using an eye tracker. The proposed moving pointer-based approach was found to achieve higher accuracy compared to the other two approaches. Due to the lower accuracy of manual annotation and the Speak2Label method, we performed a detailed analysis of these two annotation approaches to understand the reasons for the misclassification. A confusion matrix was also plotted to compare the manually assigned gaze labels with the ground truth labels. This was followed by misclassification analysis, two-sample t-test-based analysis to understand if head pose and pupil position of driver influence the misclassification by the annotators. In Speak2Label, misclassification was observed due to a lag between the speech and gaze time series, which can be visualized in the graph and cross-correlation analysis were done to compute the maximum lag between the two time series. Finally, we created a benchmark Eye Tracker-based Driver Gaze Dataset (ET-DGaze) that consists of the driver's face images and corresponding gaze labels obtained from the eye tracker.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"172"},"PeriodicalIF":4.6,"publicationDate":"2025-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144075760","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Alexander Porto, Nikolai Huckle, Alexander Basalyga, Julio Santiago, Alexander Kranjec
{"title":"Glyph norming: Human and computational measurements of shape angularity in writing systems.","authors":"Alexander Porto, Nikolai Huckle, Alexander Basalyga, Julio Santiago, Alexander Kranjec","doi":"10.3758/s13428-025-02682-7","DOIUrl":"10.3758/s13428-025-02682-7","url":null,"abstract":"<p><p>Writing systems are an underused source of stimuli for behavioral and computational experiments in cognitive psychology, psycholinguistics, and anthropology, despite being ecologically relevant and systematically different in shape, structure, and orientation. One possible reason that glyphs of writing systems are not commonly used in behavioral research concerns their profound complexity. However, recent developments in computer vision (i.e., geometric shape analysis) offer tools to automatically assess their visual dimensions. The current work describes an open-access database of 3,208 glyphs from diverse writing systems that have been normed by computational analyses in terms of shape angularity using an array of measurements. We further validate these norms by obtaining human judgments of angularity for a subset of 400 glyphs and show that they correlate highly with computational measures, in particular with first-order entropy of edge orientation. Additionally, we provide methods for standardized glyph generation based on Unicode ranges, a straightforward example of computational shape analysis, and a demonstration of automated transliteration of glyphs from Unicode strings using a pre-existing Python library. These procedures should facilitate the characterization of angularity of new glyphs and any other kind of visual shape by independent researchers. The present work will be helpful to scientists working across different topics in the various cognitive science subdisciplines.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"173"},"PeriodicalIF":4.6,"publicationDate":"2025-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12078408/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144075761","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Khushbu Y Patel, Laurie M Wilcox, Laurence T Maloney, Krista A Ehinger, Jaykishan Y Patel, Richard F Murray
{"title":"An equivalent illuminant analysis of lightness constancy with physical objects and in virtual reality.","authors":"Khushbu Y Patel, Laurie M Wilcox, Laurence T Maloney, Krista A Ehinger, Jaykishan Y Patel, Richard F Murray","doi":"10.3758/s13428-025-02688-1","DOIUrl":"10.3758/s13428-025-02688-1","url":null,"abstract":"<p><p>Several previous studies have found significant differences between visual perception in real and virtual environments. Given the increasing use of virtual reality (VR) in performance-critical applications such as medical training and vision research, it is important to understand these differences. Here, we compared lightness constancy in physical and VR environments using a task where viewers matched the reflectance of a fronto-parallel match patch to the reflectance of a reference patch at a range of 3D orientations relative to a light source. We used a custom-built physical apparatus and four VR conditions: (1) All-Cue (replicating the physical apparatus), (2) Reduced-Depth (no disparity or parallax), (3) Shadowless (no cast shadows), and (4) Reduced-Context (no surrounding objects). Lightness constancy was markedly better in the physical condition than in all four VR conditions. Surprisingly, viewers achieved a degree of lightness constancy even in the Reduced-Context condition, despite the absence of lighting cues. In a follow-up experiment, we re-tested the All-Cue and Reduced-Context conditions in VR with new observers, each participating in only one condition. Here, we found lower levels of constancy than in the first experiment, suggesting that experience across multiple experimental settings and possibly exposure to the physical apparatus during instructions had enhanced performance. We conclude that even when robust lighting and shape cues are available, lightness constancy is substantially better in real environments than in virtual environments. We consider possible explanations for this finding, such as the imperfect models of materials and lighting that are used for rendering in real-time VR.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"170"},"PeriodicalIF":4.6,"publicationDate":"2025-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143964707","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Myrte Schoenmakers, Melisa Saygin, Magdalena Sikora, Thomas Vaessen, Matthijs Noordzij, Eco de Geus
{"title":"Stress in action wearables database: A database of noninvasive wearable monitors with systematic technical, reliability, validity, and usability information.","authors":"Myrte Schoenmakers, Melisa Saygin, Magdalena Sikora, Thomas Vaessen, Matthijs Noordzij, Eco de Geus","doi":"10.3758/s13428-025-02685-4","DOIUrl":"10.3758/s13428-025-02685-4","url":null,"abstract":"<p><p>Ambulatory wearable monitoring of human physiology is increasingly utilized in the fields of psychology, movement sciences, and medicine. With the rapid growth of available consumer- and research-oriented wearables, researchers are faced with a multitude of devices to choose from. It is unfeasible timewise for researchers to determine all relevant technical specifications, available signals, signal sampling details, and (raw) data availability, and conduct a search of studies regarding the reliability, validity, and usability of wearables. Thus, selection of wearables for a given study proves highly challenging and will often be unsystematic and uninformed. The 10-year research program Stress in Action initiated a publicly accessible database of wearable ambulatory monitoring devices. We outline the genesis and final structure of the first version of the Stress in Action Wearables Database (SiA-WD) and a summary of the characteristics of the wearables it currently contains. Furthermore, one short-term (2 days) and one long-term (3 months) scenario from the field of stress research are provided with walkthroughs of how the SiA-WD can help select the optimal wearable for a specific research project. Insights gathered include the scarceness of studies testing wearable user-friendliness, inconsistencies in reported validity statistics, and imprecise manufacturer documentation on recorded physiological data such as sampling rate (or window) of signals and parameter extraction. The SiA-WD is the first open-access database to simultaneously include physiological sampling information and technical specifications along with a systematic reliability, validity, and usability search. It will be iteratively expanded to facilitate informed and time-efficient wearable selection. For access to the database, see the following: https://osf.io/umgvp/ .</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"171"},"PeriodicalIF":4.6,"publicationDate":"2025-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12075381/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143966592","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xingyu Zhao, Liping Cui, Yunlin Sun, Lei Wang, Ke Wu, Qiangyan Che, Junyu Mao, Liuzhenxiong Yu, Pingping Liu, Panpan Hu, Kai Wang, Fengqiong Yu, Rong Ye
{"title":"Validating the Chinese version of the Apathy Motivation Index and network analysis of apathy subtypes in a healthy Chinese sample.","authors":"Xingyu Zhao, Liping Cui, Yunlin Sun, Lei Wang, Ke Wu, Qiangyan Che, Junyu Mao, Liuzhenxiong Yu, Pingping Liu, Panpan Hu, Kai Wang, Fengqiong Yu, Rong Ye","doi":"10.3758/s13428-025-02686-3","DOIUrl":"10.3758/s13428-025-02686-3","url":null,"abstract":"<p><p>Apathy is a neuropsychiatric syndrome associated with various negative outcomes in patients with motivational disorders, commonly examined in multiple dimensions including cognitive, behavioral, and emotional domains. While there are some tools to measure apathy in China, there is a lack of appropriate instruments specifically designed to assess social motivation for a more comprehensive definition of apathy. Moreover, there is limited research on the complex interrelations among the intrinsic domains of apathy. Therefore, we developed the Chinese version of the Apathy Motivation Index (AMI) and assessed its reliability and validity in a sample of 758 participants. Network analysis was employed to explore the relationships among different domains of apathy. The Chinese version of the AMI classifies apathy into three domains, namely, behavioral activation, social motivation, and emotional sensitivity, which is consistent with the original scale; it also has good reliability and validity, making it suitable for measuring apathy and motivation in both healthy and patient populations. Additionally, network analysis revealed that apathy within the behavioral activation domain critically contributes to the overall measurement of apathy, while the social motivation dimension may serve as a bridge connecting other dimensions. Our study offers a reliable instrument to investigate apathy in Chinese-speaking individuals and could provide new insights for a better understanding of apathy in neuropsychiatric disorders.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"168"},"PeriodicalIF":4.6,"publicationDate":"2025-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12069496/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143963816","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}