{"title":"Evaluation of data collection and annotation approaches of driver gaze dataset.","authors":"Pavan Kumar Sharma, Pranamesh Chakraborty","doi":"10.3758/s13428-025-02679-2","DOIUrl":"https://doi.org/10.3758/s13428-025-02679-2","url":null,"abstract":"<p><p>Driver gaze estimation is important for various driver gaze applications such as building advanced driving assistance systems and understanding driver gaze behavior. Gaze estimation in terms of gaze zone classification requires large-scale labeled data for supervised machine learning and deep learning-based models. In this study, we collected a driver gaze dataset and annotated it using three annotation approaches - manual annotation, Speak2Label, and moving pointer-based annotation. Moving pointer-based annotation was introduced as a new data annotation approach inspired by screen-based gaze data collection. For each data collection approach, ground truth labels were obtained using an eye tracker. The proposed moving pointer-based approach was found to achieve higher accuracy compared to the other two approaches. Due to the lower accuracy of manual annotation and the Speak2Label method, we performed a detailed analysis of these two annotation approaches to understand the reasons for the misclassification. A confusion matrix was also plotted to compare the manually assigned gaze labels with the ground truth labels. This was followed by misclassification analysis, two-sample t-test-based analysis to understand if head pose and pupil position of driver influence the misclassification by the annotators. In Speak2Label, misclassification was observed due to a lag between the speech and gaze time series, which can be visualized in the graph and cross-correlation analysis were done to compute the maximum lag between the two time series. Finally, we created a benchmark Eye Tracker-based Driver Gaze Dataset (ET-DGaze) that consists of the driver's face images and corresponding gaze labels obtained from the eye tracker.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"172"},"PeriodicalIF":4.6,"publicationDate":"2025-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144075760","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Alexander Porto, Nikolai Huckle, Alexander Basalyga, Julio Santiago, Alexander Kranjec
{"title":"Glyph norming: Human and computational measurements of shape angularity in writing systems.","authors":"Alexander Porto, Nikolai Huckle, Alexander Basalyga, Julio Santiago, Alexander Kranjec","doi":"10.3758/s13428-025-02682-7","DOIUrl":"https://doi.org/10.3758/s13428-025-02682-7","url":null,"abstract":"<p><p>Writing systems are an underused source of stimuli for behavioral and computational experiments in cognitive psychology, psycholinguistics, and anthropology, despite being ecologically relevant and systematically different in shape, structure, and orientation. One possible reason that glyphs of writing systems are not commonly used in behavioral research concerns their profound complexity. However, recent developments in computer vision (i.e., geometric shape analysis) offer tools to automatically assess their visual dimensions. The current work describes an open-access database of 3,208 glyphs from diverse writing systems that have been normed by computational analyses in terms of shape angularity using an array of measurements. We further validate these norms by obtaining human judgments of angularity for a subset of 400 glyphs and show that they correlate highly with computational measures, in particular with first-order entropy of edge orientation. Additionally, we provide methods for standardized glyph generation based on Unicode ranges, a straightforward example of computational shape analysis, and a demonstration of automated transliteration of glyphs from Unicode strings using a pre-existing Python library. These procedures should facilitate the characterization of angularity of new glyphs and any other kind of visual shape by independent researchers. The present work will be helpful to scientists working across different topics in the various cognitive science subdisciplines.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"173"},"PeriodicalIF":4.6,"publicationDate":"2025-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12078408/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144075761","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Khushbu Y Patel, Laurie M Wilcox, Laurence T Maloney, Krista A Ehinger, Jaykishan Y Patel, Richard F Murray
{"title":"An equivalent illuminant analysis of lightness constancy with physical objects and in virtual reality.","authors":"Khushbu Y Patel, Laurie M Wilcox, Laurence T Maloney, Krista A Ehinger, Jaykishan Y Patel, Richard F Murray","doi":"10.3758/s13428-025-02688-1","DOIUrl":"https://doi.org/10.3758/s13428-025-02688-1","url":null,"abstract":"<p><p>Several previous studies have found significant differences between visual perception in real and virtual environments. Given the increasing use of virtual reality (VR) in performance-critical applications such as medical training and vision research, it is important to understand these differences. Here, we compared lightness constancy in physical and VR environments using a task where viewers matched the reflectance of a fronto-parallel match patch to the reflectance of a reference patch at a range of 3D orientations relative to a light source. We used a custom-built physical apparatus and four VR conditions: (1) All-Cue (replicating the physical apparatus), (2) Reduced-Depth (no disparity or parallax), (3) Shadowless (no cast shadows), and (4) Reduced-Context (no surrounding objects). Lightness constancy was markedly better in the physical condition than in all four VR conditions. Surprisingly, viewers achieved a degree of lightness constancy even in the Reduced-Context condition, despite the absence of lighting cues. In a follow-up experiment, we re-tested the All-Cue and Reduced-Context conditions in VR with new observers, each participating in only one condition. Here, we found lower levels of constancy than in the first experiment, suggesting that experience across multiple experimental settings and possibly exposure to the physical apparatus during instructions had enhanced performance. We conclude that even when robust lighting and shape cues are available, lightness constancy is substantially better in real environments than in virtual environments. We consider possible explanations for this finding, such as the imperfect models of materials and lighting that are used for rendering in real-time VR.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"170"},"PeriodicalIF":4.6,"publicationDate":"2025-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143964707","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Myrte Schoenmakers, Melisa Saygin, Magdalena Sikora, Thomas Vaessen, Matthijs Noordzij, Eco de Geus
{"title":"Stress in action wearables database: A database of noninvasive wearable monitors with systematic technical, reliability, validity, and usability information.","authors":"Myrte Schoenmakers, Melisa Saygin, Magdalena Sikora, Thomas Vaessen, Matthijs Noordzij, Eco de Geus","doi":"10.3758/s13428-025-02685-4","DOIUrl":"10.3758/s13428-025-02685-4","url":null,"abstract":"<p><p>Ambulatory wearable monitoring of human physiology is increasingly utilized in the fields of psychology, movement sciences, and medicine. With the rapid growth of available consumer- and research-oriented wearables, researchers are faced with a multitude of devices to choose from. It is unfeasible timewise for researchers to determine all relevant technical specifications, available signals, signal sampling details, and (raw) data availability, and conduct a search of studies regarding the reliability, validity, and usability of wearables. Thus, selection of wearables for a given study proves highly challenging and will often be unsystematic and uninformed. The 10-year research program Stress in Action initiated a publicly accessible database of wearable ambulatory monitoring devices. We outline the genesis and final structure of the first version of the Stress in Action Wearables Database (SiA-WD) and a summary of the characteristics of the wearables it currently contains. Furthermore, one short-term (2 days) and one long-term (3 months) scenario from the field of stress research are provided with walkthroughs of how the SiA-WD can help select the optimal wearable for a specific research project. Insights gathered include the scarceness of studies testing wearable user-friendliness, inconsistencies in reported validity statistics, and imprecise manufacturer documentation on recorded physiological data such as sampling rate (or window) of signals and parameter extraction. The SiA-WD is the first open-access database to simultaneously include physiological sampling information and technical specifications along with a systematic reliability, validity, and usability search. It will be iteratively expanded to facilitate informed and time-efficient wearable selection. For access to the database, see the following: https://osf.io/umgvp/ .</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"171"},"PeriodicalIF":4.6,"publicationDate":"2025-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12075381/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143966592","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xingyu Zhao, Liping Cui, Yunlin Sun, Lei Wang, Ke Wu, Qiangyan Che, Junyu Mao, Liuzhenxiong Yu, Pingping Liu, Panpan Hu, Kai Wang, Fengqiong Yu, Rong Ye
{"title":"Validating the Chinese version of the Apathy Motivation Index and network analysis of apathy subtypes in a healthy Chinese sample.","authors":"Xingyu Zhao, Liping Cui, Yunlin Sun, Lei Wang, Ke Wu, Qiangyan Che, Junyu Mao, Liuzhenxiong Yu, Pingping Liu, Panpan Hu, Kai Wang, Fengqiong Yu, Rong Ye","doi":"10.3758/s13428-025-02686-3","DOIUrl":"10.3758/s13428-025-02686-3","url":null,"abstract":"<p><p>Apathy is a neuropsychiatric syndrome associated with various negative outcomes in patients with motivational disorders, commonly examined in multiple dimensions including cognitive, behavioral, and emotional domains. While there are some tools to measure apathy in China, there is a lack of appropriate instruments specifically designed to assess social motivation for a more comprehensive definition of apathy. Moreover, there is limited research on the complex interrelations among the intrinsic domains of apathy. Therefore, we developed the Chinese version of the Apathy Motivation Index (AMI) and assessed its reliability and validity in a sample of 758 participants. Network analysis was employed to explore the relationships among different domains of apathy. The Chinese version of the AMI classifies apathy into three domains, namely, behavioral activation, social motivation, and emotional sensitivity, which is consistent with the original scale; it also has good reliability and validity, making it suitable for measuring apathy and motivation in both healthy and patient populations. Additionally, network analysis revealed that apathy within the behavioral activation domain critically contributes to the overall measurement of apathy, while the social motivation dimension may serve as a bridge connecting other dimensions. Our study offers a reliable instrument to investigate apathy in Chinese-speaking individuals and could provide new insights for a better understanding of apathy in neuropsychiatric disorders.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"168"},"PeriodicalIF":4.6,"publicationDate":"2025-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12069496/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143963816","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Vladimir Huerta-Chavez, Luis A Llamas-Alonso, Armando Quetzalcóatl Angulo-Chavira
{"title":"Mexican Spanish adaptation for the Affective Norms for English Words (ANEW).","authors":"Vladimir Huerta-Chavez, Luis A Llamas-Alonso, Armando Quetzalcóatl Angulo-Chavira","doi":"10.3758/s13428-025-02703-5","DOIUrl":"10.3758/s13428-025-02703-5","url":null,"abstract":"<p><p>This study adapts the Affective Norms for English Words (ANEW) dataset for Mexican Spanish, validating emotional dimensions in culturally relevant contexts. A total of 753 participants rated 1,028 translated words on valence, arousal, and dominance using the Self-Assessment Manikin (SAM) scale. The adaptation ensured linguistic equivalence through iterative translation and consensus processes, selecting region-specific terms verified with the Corpus XXI of the Royal Spanish Academy. Split-half correlations confirmed high internal consistency across dimensions, demonstrating stable and reliable ratings within the Mexican sample. Cross-linguistic analyses revealed strong correlations between Mexican Spanish and norms for European Portuguese and Spanish, with moderate correlations to English norms, highlighting cultural and linguistic influences on emotional word ratings. Gender differences further provided insights into demographic factors affecting emotional word processing. These findings underscore the need for culturally specific adaptations in research, ensuring that affective norms align with regional language use and emotional perception. This study offers a methodological framework applicable to other linguistic and cultural contexts, enhancing the precision of cross-cultural research in affective science.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"169"},"PeriodicalIF":4.6,"publicationDate":"2025-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12069142/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143969452","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Feature-based behavior coding for efficient exploratory analysis using pose estimation.","authors":"Eigo Nishimura","doi":"10.3758/s13428-025-02702-6","DOIUrl":"https://doi.org/10.3758/s13428-025-02702-6","url":null,"abstract":"<p><p>This paper introduces feature-based behavior coding (FBBC), an efficient method for exploratory analysis in behavioral research using pose estimation techniques. FBBC addresses the challenges of traditional behavioral coding methods, particularly in the exploratory stages of research when coding schemes are not yet well defined. By leveraging keypoint detection and dimensionality reduction, FBBC transforms video data into interpretable feature time series, enabling researchers to analyze diverse postural patterns more efficiently. Also presented is Behavior Senpai, an open-source software implementation of FBBC that integrates automated feature extraction with human insight. A case study demonstrates FBBC's ability to classify complex postures by combining multiple features and manual clustering. While the current iteration focuses on instantaneous posture classification, the framework shows potential for expansion to action classification. FBBC offers increased flexibility in developing coding schemes and reduces the time-consuming nature of repetitive observations. This approach represents a considerable advancement in behavioral research, bridging traditional methods with modern machine-learning techniques. As FBBC is adopted and refined, it will contribute to more comprehensive and insightful behavioral analyses across the psychological and behavioral sciences.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"167"},"PeriodicalIF":4.6,"publicationDate":"2025-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12064611/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143957403","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Chipola: A Chinese Podcast Lexical Database for capturing spoken language nuances and predicting behavioral data.","authors":"Ning Zhao, Lei Lei","doi":"10.3758/s13428-025-02697-0","DOIUrl":"https://doi.org/10.3758/s13428-025-02697-0","url":null,"abstract":"<p><p>This study introduces Chipola, a Chinese Podcast Lexical Database derived from a large-scale collection of Chinese podcast transcripts. Due to the spoken nature of podcasts, such a podcast lexical database can accurately capture the nuances of spoken language in Chinese. Chipola was developed based on a corpus that comprises 31.2 million word tokens and 41.7 million character tokens, featuring a vocabulary of 88,085 unique words and 4,613 unique characters. Lexical variables such as frequency, context diversity, and part-of-speech information are also included. Findings of interest are as follows. First, Chipola captures the spoken Chinese features, such as the core spoken vocabulary. Second, it outperforms other lexical databases in predicting third-party behavioral data. Third, its rich text-level information enables educators to simulate Chinese lexical input on daily podcast listening, which provides pedagogical insights for the overall effects of language exposure. To summarize, Chipola presents an innovative and valuable resource with significant implications and applications in areas such as psychology and language education.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"166"},"PeriodicalIF":4.6,"publicationDate":"2025-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143975879","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A multiverse analysis of cleaning and analyzing procedures of eye movement data during reading.","authors":"Hayward J Godwin, Charlotte E Lee, Denis Drieghe","doi":"10.3758/s13428-025-02689-0","DOIUrl":"https://doi.org/10.3758/s13428-025-02689-0","url":null,"abstract":"<p><p>Eye movements during reading experiments involve careful cleaning of raw data into a processed format that can then be analyzed. Through the process of cleaning and analyzing these datasets, there are many decisions that researchers make. As a result, there is a wide range of possible approaches that can be taken when analyzing datasets from reading and eye movement experiments. At present, little is known regarding the consequences of these decisions and in a worst-case scenario, specific approaches to cleaning and analyzing these datasets could \"create\" effects that would otherwise not be present in the datasets. Here, we addressed these issues by conducting a multiverse analysis of a range of reasonable and defensible analyses that researchers in this field might conduct. We examined a total of 1,890 different data cleaning and analytic pipelines to explore how different decisions researchers make when cleaning and analyzing their data influence perhaps the most well-known effect in eye movements and reading research: the word frequency effect. More specifically, the impact on the size of the word frequency effect during sentence reading (Lee et al. Journal of Experimental Psychology: Learning, Memory, and Cognition, 2025) was explored. The frequency effect was found to be extremely robust and present in almost all cases, but the magnitude varied substantially, with 36% of the size of the effect being due to specific choices made during data cleaning and analysis. Recommendations for further work and greater transparency in the field are set out based on our findings.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"164"},"PeriodicalIF":4.6,"publicationDate":"2025-05-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12058810/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143961191","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Debora de Chiusole, Luca Stefanutti, Andrea Brancaccio
{"title":"Extracting preference relations from data: Clustering with transitive centroids.","authors":"Debora de Chiusole, Luca Stefanutti, Andrea Brancaccio","doi":"10.3758/s13428-025-02674-7","DOIUrl":"https://doi.org/10.3758/s13428-025-02674-7","url":null,"abstract":"<p><p>A clustering algorithm, named k-orders, is proposed to extract transitive relations from a data set. The k-orders algorithm differs from the original k-modes only in the adjustment step. Two adjustment procedures, named transitive centroid adjustment (TCA) and greedy TCA, are proposed that can be used to find clusters with transitive centroids. The proposed clustering approach finds application, especially in studies on preference, where this last may be heterogeneous across individuals, although transitive. The set of cluster centroids extracted by the algorithm from a data set can then be empirically tested via the estimation of a latent class model. The performance of the two versions of k-orders were compared to one another and with the canonical k-modes, in simulation studies. Results show that when centroids are transitive relations, both versions of k-orders outperform k-modes. Moreover, in experimental designs in which two-component options are considered, the TCA algorithm performs better than the greedy TCA. An empirical application was also carried out for exemplifying how k-orders can be useful for studying individual preferences.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 6","pages":"165"},"PeriodicalIF":4.6,"publicationDate":"2025-05-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12058892/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143964777","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}