Hayward J Godwin, Haden Dewis, Peter T Darch, Michael C Hout, Daniel Ernst, Philippa Broadbent, Megan Papesh, Jeremy M Wolfe
{"title":"A sharing practices review of the visual search and eye movements literature reveals recommendations for our field and others.","authors":"Hayward J Godwin, Haden Dewis, Peter T Darch, Michael C Hout, Daniel Ernst, Philippa Broadbent, Megan Papesh, Jeremy M Wolfe","doi":"10.3758/s13428-025-02759-3","DOIUrl":"10.3758/s13428-025-02759-3","url":null,"abstract":"<p><p>The sharing of research outputs is an important endeavor, one that is increasingly required by funders and publishers alike. Here, we catalogued and examined data sharing practices, using our own field of visual search and eye movement behavior as an example. To find outputs from scientific research, we conducted two searches: a Literature Search and a repository search. Overall, we found that researchers in our field generally shared outputs that enabled others to analytically reproduce published results. It was rare for researchers to share outputs that enabled direct replications of their work, and it was also rare for researchers to share raw data that would enable secondary data analyses. Comparing the results of our two searches of the literature, we found that a lack of metadata substantially reduced the rates at which outputs could be found and used. Based on our findings, we present a set of recommendations summarized in our 'Find It - Access It - Reuse It' scorecard. The scorecard is intended to assist researchers in sharing outputs in a manner that will enable others to better find, access, and understand them - and this includes researchers in other fields beyond our own.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 9","pages":"235"},"PeriodicalIF":3.9,"publicationDate":"2025-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12296990/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144726977","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A novel method for modeling tonic and phasic pupil dynamics in humans.","authors":"Matthias Mittner, Josephine Maria Groot","doi":"10.3758/s13428-025-02755-7","DOIUrl":"10.3758/s13428-025-02755-7","url":null,"abstract":"<p><p>The human pupil is a widely used physiological metric in psychology and neuroscience. Changes in pupil diameter (PD) are thought to reflect changes in locus coeruleus-norepinephrine (LC/NE) activity, which is associated with cognitive and behavioral optimization. Here, we present a novel algorithm to decompose the pupil signal into its tonic and phasic components. We evaluate the utility and validity of the algorithms using both artificially generated data and an existing dataset from a fast-paced finger-tapping task. Results show that the novel algorithm outperforms traditional approaches on simulated data. We further demonstrate that our algorithm provides more conclusive evidence for relationships between mind wandering reports and pupil predictors compared to traditional window-averaging. Finally, we demonstrate that the novel and traditional estimates contain distinct information regarding neuroimaging correlates and task performance.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 9","pages":"233"},"PeriodicalIF":3.9,"publicationDate":"2025-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12296849/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144726976","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Digital pathways beyond Western-centric participants.","authors":"Edmond Awad","doi":"10.3758/s13428-025-02751-x","DOIUrl":"10.3758/s13428-025-02751-x","url":null,"abstract":"<p><p>In 2010, Henrich and colleagues published a seminal article in which they noted that (1) studies in social and behavioural sciences oversample from Western, educated, industrialised, rich, and democratic (WEIRD) individuals, and (2) WEIRD subjects are particularly unusual compared to the rest of the world population with respect to several factors. Despite the positive reception of this article, not much has changed in the years to follow. For instance, reviews of recent papers in leading psychology journals reveal that only a small proportion of the studied samples originate from non-Western countries. This sampling bias cannot be excused for lack of means. The digital age has opened several opportunities to facilitate and support social science research with subjects from non-WEIRD backgrounds. In this article, I provide an overview of such tools and comment on the advantages and disadvantages of each.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"229"},"PeriodicalIF":4.6,"publicationDate":"2025-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12274141/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144666973","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ulf-Dietrich Reips, Annika T Overlander, Matthias Bannert
{"title":"Dropout analysis: A method for data from Internet-based research and dropR, an R-based web app and package to analyze and visualize dropout.","authors":"Ulf-Dietrich Reips, Annika T Overlander, Matthias Bannert","doi":"10.3758/s13428-025-02730-2","DOIUrl":"10.3758/s13428-025-02730-2","url":null,"abstract":"<p><p>With Internet-based research, non-response such as lack of responses to particular items and dropout have become interesting dependent variables due to highly voluntary participation and large numbers of participants (Reips, 2000, 2002b). In this article, we develop and discuss the methodology of using and analyzing dropout in Internet-based research, and we present dropR, an R package and web service (web application) to analyze and visualize dropout. The web app was written in R using Shiny, a free software environment for statistical computing and graphics. Among other features, dropR turns input from datasets into accessible and publication-ready visual displays of dropout curves. It calculates parameters relevant to dropout analysis, such as chi-square values and odds ratios for points of difference, initial drop, and percent remaining in stable states. It provides Kaplan-Meier survival statistics and tests survival curve differences. With automated inferential components, it identifies critical points in dropout and critical differences between dropout curves for different experimental conditions (Kolmogorov-Smirnov and rho-family statistics) and produces related statistical copy. Requiring no programming knowledge, dropR is provided as a free web application at https://dropr.eu and for programmers as an R package (under a cost free general public license, GPL-3, https://cran.r-project.org/web/licenses/GPL-3 ) from researchers for researchers. All code and materials are openly available on GitHub ( https://github.com/iscience-kn/dropR ).</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"231"},"PeriodicalIF":4.6,"publicationDate":"2025-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12274255/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144666974","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Rethinking causal inference for recurring exposures: The incremental propensity score approach with lavaan.","authors":"Wen Wei Loh, Dongning Ren, Yves Rosseel","doi":"10.3758/s13428-025-02735-x","DOIUrl":"10.3758/s13428-025-02735-x","url":null,"abstract":"<p><p>Scholars are often interested in evaluating the causal effects of a recurring exposure (e.g., family violence) on behavioral and psychological outcomes. However, causal inference of recurring exposures is challenging. Conventional analytic approaches target causal quantities lacking practical relevance, such as mandating everyone to uniformly always be exposed or unexposed to family violence. Estimation further relies on everyone having a non-zero probability of being either exposed or unexposed at each occurrence, which is frequently unrealistic when past exposures perfectly predict future exposures. In this paper, we introduce a novel approach from the causal inference literature for drawing causal conclusions about recurring exposures: the incremental propensity score intervention (IPSI). IPSI frames causal questions more realistically by assessing how changing the propensity of a recurring exposure may influence an outcome. To facilitate the adoption of IPSI for recurring exposures, we develop an estimation procedure using lavaan, a widely used structural equation modeling software in R. We demonstrate the application of IPSI with a real-world dataset investigating the impact of recurring family violence on adolescent depression. IPSI requires fewer assumptions than existing approaches while offering more meaningful insights into the causal effects of recurring exposures.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"230"},"PeriodicalIF":4.6,"publicationDate":"2025-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12274147/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144666975","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Automatic temporal analysis of speech: A quick and objective pipeline for the assessment of overt stuttering.","authors":"Vishruta Yawatkar, Ho Ming Chow, Evan Usler","doi":"10.3758/s13428-025-02733-z","DOIUrl":"10.3758/s13428-025-02733-z","url":null,"abstract":"<p><p>Fluency disorders, such as developmental stuttering, have been characterized by behavior such as blocks, repetitions, and prolongations in speech. Accurate measurement of overt stuttering behavior can aid in diagnostic evaluation and the determination of optimal treatment for this disorder. This study proposes a method - Automatic Temporal Analysis of Speech (ATAS) - for the assessment of speech fluency based on the detection and quantification of discrete pauses and vocal events. Our ATAS metrics include speech rate, total pause time, pause count, mean pause duration, mean vocal duration, pause duration variability, and vocal duration variability. We used oral reading audio samples from a total of 35 English-speaking participants: 17 from adults who stutter (AWS) and 18 from adults who do not stutter (AWNS). AWS, in general, exhibited more pausing or hesitancy in speech compared to AWNS, as evidenced by slower speech rate, greater total pause time, higher pause count, and longer mean duration of pause events. Numerous pause and vocal metrics acquired from ATAS were correlated with a canonical measure of stuttering frequency percent syllables stuttered, suggesting that automatically detected temporal metrics of pause and vocal events within continuous speech are highly associated with overt stuttering behavior. ATAS metrics generally predicted the status of each participant as either an AWS or AWNS grouping with accuracies considerably higher than random guessing using random forest and LSTM classifiers. This pipeline may provide an alternative and complementary method that speech-language pathologists and other health professionals can use in the assessment of fluency disorders.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"228"},"PeriodicalIF":4.6,"publicationDate":"2025-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12274223/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144666972","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A novel reaction time assessment in virtual reality: Advantages over computerized tests.","authors":"Topaz Loushy Kay, Ella Been, Chaim G Pick","doi":"10.3758/s13428-025-02752-w","DOIUrl":"10.3758/s13428-025-02752-w","url":null,"abstract":"<p><p>Reaction time (RT) is a fundamental cognitive function impacting daily life and sports activities. Despite the increasing use of virtual reality (VR) for cognitive assessments, its efficacy for RT assessments remains uncertain. We aimed to develop and validate a novel RT test in VR, and to explore the potential contributions of VR technology to RT assessment. Forty-eight participants completed a computerized RT test (COM-RT) and a novel RT test in VR (VR-RT). The latter replicated the COM-RT test, assessing simple and choice RTs. Additionally, it introduced more complex conditions: reaching to touch static stimuli in known or unknown locations or moving stimuli. Correlations and differences between the tests and tasks were examined. Moderate-to-strong linear correlations were found between the tests for the simple (r ≥ 0.642) and choice (r ≥ 0.736) tasks, and the difference between them (r ≥ 0.677) (p < 0.001). However, RTs were significantly longer in the VR-RT test compared with the COM-RT test (p < 0.001). Significant differences were found among the RT-VR tasks (p < 0.001): reaching to touch stimuli involved longer RTs compared with pressing a button, and RT was even longer when stimuli appeared in unexpected locations. Moving stimuli were associated with shorter RT. Additionally, movement velocity was significantly higher when reaching for dynamic versus static stimuli in known or unknown locations (p < 0.001). VR is valid for RT measurement, yet its outcomes should be interpreted within its framework rather than in comparison to computer assessments. Furthermore, VR offers additional possibilities, such as using lifelike stimuli and measuring kinematics.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"227"},"PeriodicalIF":4.6,"publicationDate":"2025-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12267386/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144648356","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Developing fine-grained sense-aware lexical sophistication indices based on the CEFR levels of word senses.","authors":"Nan Hu, Xiaofei Lu, Renfen Hu","doi":"10.3758/s13428-025-02741-z","DOIUrl":"https://doi.org/10.3758/s13428-025-02741-z","url":null,"abstract":"<p><p>Lexical sophistication has garnered attention across diverse research domains in which language production and text complexity are relevant areas of study. Nevertheless, among the myriad existing lexical sophistication measures, the vast majority do not systematically differentiate different senses of polysemous words but rather treat all senses of a polysemous word as equally sophisticated. To address this limitation, the current study introduces a system that automatically assigns the words in a text to CEFR (i.e., the Common European Framework of Reference for Languages) levels based on their senses used in context, using the English Vocabulary Profile as a reference. We further propose a set of fine-grained sense-aware lexical sophistication indices based on the CEFR levels of word senses and evaluate the extent to which these indices can predict holistic scores of second language (L2) English writing quality using 1,236 exam scripts from the CLC-FCE dataset (Yannakoudakis et al., 2011). The results show that these fine-grained sense-aware indices are more strongly correlated with scores than existing lexical sophistication measures, with three significant predictors explaining 11.8% of the variance in holistic scores. A regression model that combines the new indices with existing ones achieves substantially greater predictive power than models built with either set of indices alone. We discuss the potential implications of our findings for future research in L2 lexical sophistication.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"226"},"PeriodicalIF":4.6,"publicationDate":"2025-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144648357","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Elif İkbal Eskioğlu, N Evra Günhan Şenol, Talat Bulut
{"title":"Action and object picture naming in Turkish: A psycholinguistic database.","authors":"Elif İkbal Eskioğlu, N Evra Günhan Şenol, Talat Bulut","doi":"10.3758/s13428-025-02764-6","DOIUrl":"https://doi.org/10.3758/s13428-025-02764-6","url":null,"abstract":"<p><p>Naming is a complex cognitive process that is incorporated into various models of speech and language processing. The picture-naming task is commonly employed to study naming processes. Investigation of cognitive processes in a reliable manner requires normative databases. The primary aim of the present study was to create a normative database for action and object picture naming in Turkish-speaking young, healthy adults, incorporating naming latencies and various relevant measures that may affect naming performance. In addition, the current study examined the effects of word category (action, object), lemma frequency, age of acquisition, name agreement (H index), word length, visual complexity, and conceptual complexity on naming latencies. Forty healthy adults between 18 and 38 years of age who were all native speakers of Turkish participated in the study. The participants were asked to name 62 action and 198 object pictures selected from the International Picture-Naming Project. The study resulted in the creation of a picture-naming database for Turkish, which provides naming latencies and name agreement scores along with various other relevant variables and their correlation matrix. Also, a linear mixed-effects model showed that name agreement (H index) and age of acquisition had a significant effect on naming latencies, highlighting the importance of these factors for picture naming in Turkish. The database can be used in future research in Turkish to consider naming difficulty associated with each action and object picture, to match stimuli on relevant measures, and/or to control for these measures as covariates in statistical models.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"225"},"PeriodicalIF":4.6,"publicationDate":"2025-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144641641","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xi Cheng, Chi-Shing Tse, Yuen-Lai Chan, Kai Yan Lau, Yen Na Yum
{"title":"Unveiling the intensity-ambiguity relationships among affective and lexico-semantic variables in Chinese characters and the character-word relationships in Chinese two-character words.","authors":"Xi Cheng, Chi-Shing Tse, Yuen-Lai Chan, Kai Yan Lau, Yen Na Yum","doi":"10.3758/s13428-025-02753-9","DOIUrl":"10.3758/s13428-025-02753-9","url":null,"abstract":"<p><p>Understanding the lexical characteristics of Chinese characters is crucial given their extensive usage and unique logographic structure. In this study, we normed affective ratings (valence and arousal) for 3971 Chinese characters. We investigated the relationships between intensity (mean rating) and ambiguity (rating variability) of these affective variables, alongside additional lexico-semantic variables from Su et al., Behavior Research Methods, 55(6), 2989-3008, (2022). Drawing on lexical data from 25,281 two-character words available in the Chinese Lexicon Project (Tse et al., Behavior Research Methods, 49(4), 1503-1519, 2017, Behavior Research Methods, 55(8), 4382-4402, 2023; Chan & Tse, Behavior Research Methods, 56(7), 7574-7601, 2024), we further explored cross-level relationships between character-level and word-level variables. Multiple regression analyses controlling for various lexical variables revealed several noteworthy patterns. First, we identified a quadratic valence-arousal relationship, such that characters with extreme valence ratings (either highly positive or highly negative) elicited higher arousal compared to neutral characters. This relationship was moderated by arousal ambiguity, partially consistent with previous findings (Brainerd et al. Journal of Experimental Psychology: General, 150(8), 1476-1499, 2021a), Second, we observed consistent quadratic intensity-ambiguity relationships across all variables, supporting the quadratic law proposed by Brainerd et al. Journal of Memory and Language, 121, 104286, (2021b). Finally, significant positive associations occurred between character-level variables and their corresponding word-level variables for both the first and second characters. The strength of these cross-level relationships varied across affective and lexico-semantic variables and may further be influenced by semantic transparency. Overall, our findings advance the understanding of affective and semantic features of Chinese characters and offer insights into the cross-level integration of characters' and words' lexical characteristics. The data reported in this paper are available at: https://osf.io/kh4yx .</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"224"},"PeriodicalIF":4.6,"publicationDate":"2025-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12263727/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144641642","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}