{"title":"The UCI Phonotactic Calculator: An online tool for computing phonotactic metrics.","authors":"Connor Mayer, Arya Kondur, Megha Sundara","doi":"10.3758/s13428-025-02725-z","DOIUrl":"https://doi.org/10.3758/s13428-025-02725-z","url":null,"abstract":"<p><p>This paper presents the UCI Phonotactic Calculator (UCIPC), a new online tool for quantifying the occurrence of segments and segment sequences in a corpus. This tool has several advantages compared to existing tools: it allows users to supply their own training data, meaning it can be applied to any language for which a corpus is available; it computes a wider range of metrics than most existing tools; and it provides an accessible point-and-click interface that allows researchers with more modest technical backgrounds to take advantage of phonotactic models. After describing the metrics implemented by the calculator and how to use it, we present the results of a proof-of-concept study comparing how well different types of metrics implemented by the UCIPC predict human responses from eight published nonce word acceptability judgment studies across four different languages. These results suggest that metrics that take into account the relative position of sounds and include word boundaries are better at predicting human responses than those that are based on the absolute position of sounds and do not include word boundaries. We close by discussing the usefulness of tools like the UCIPC in experimental design and analysis and outline several areas of future research that this tool will help support.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"218"},"PeriodicalIF":4.6,"publicationDate":"2025-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144558859","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A toolbox for generating multidimensional 3D objects with fine-controlled feature space: Quaddle 2.0.","authors":"Xuan Wen, Leo Malchin, Thilo Womelsdorf","doi":"10.3758/s13428-025-02736-w","DOIUrl":"https://doi.org/10.3758/s13428-025-02736-w","url":null,"abstract":"<p><p>Multidimensional 3D-rendered objects are an important component of vision research and video-gaming applications, but it has remained challenging to parametrically control and efficiently generate those objects. Here, we describe a toolbox for controlling and efficiently generating 3D-rendered objects composed of 10 separate visual feature dimensions that can be fine-adjusted using Python scripts. The toolbox defines objects as multidimensional feature vectors with primary dimensions (object body related features), secondary dimensions (head related features), and accessory dimensions (including arms, ears, or beaks). The toolbox interfaces with the freely available Blender software to create objects. The toolbox makes it possible to gradually morph features of multiple feature dimensions, determine the desired feature similarity among objects, and automatize the generation of multiple objects in 3D object and 2D image formats. We document the use of multidimensional objects in a sequence learning task that embeds objects in a 3D-rendered augmented reality environment controlled by the gaming engine Unity. Together, the toolbox features enable the efficient generation of multidimensional objects with fine control of low-level features and higher-level object similarity useful for visual cognitive research and immersive visual environments.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"219"},"PeriodicalIF":4.6,"publicationDate":"2025-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144558858","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Christopher D Erb, Samara Morrison, Alexandra Nicholson-Brown
{"title":"Moving beyond button presses to enhance the reliability of congruency tasks.","authors":"Christopher D Erb, Samara Morrison, Alexandra Nicholson-Brown","doi":"10.3758/s13428-025-02740-0","DOIUrl":"10.3758/s13428-025-02740-0","url":null,"abstract":"<p><p>Developmental and individual differences in conflict processing are commonly assessed with button-press measures of response time and accuracy in congruency tasks such as the Eriksen flanker task. However, when the reliability of response time and accuracy congruency effects are reported, the measures frequently fall short of the reliability levels needed to draw firm conclusions. In Study 1, we re-analyzed data from nine hand-tracking experiments. We found that reaching behavior generated high congruency effect reliabilities across different age groups (children, young adults, and older adults) in arrow versions of the flanker task, with split-half reliabilities often above .85 in response time, initiation time, movement time, or movement curvature. Adult performance of the Stroop task revealed congruency effect reliabilities ranging from .76 in movement curvature to .89 in initiation time. In contrast, the Simon task revealed a good reliability estimate in movement curvature for children (.84) and acceptable estimates in response time (.72), movement time (.76), and curvature (.75) for adults. Study 2 tested the reliability of a release-and-press version of the arrow flanker task using a keyboard in one condition and a touchscreen in another condition (N = 51). The keyboard condition generated high congruency effect reliability estimates in response time (.91), initiation time (.94), and movement time (.88), while the touchscreen condition generated high-reliability estimates in response time (.85) and initiation time (.94), and a lower estimate for movement time (.78). These results indicate that the reliability of congruency tasks can be enhanced by moving beyond traditional button-press measures of performance.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"215"},"PeriodicalIF":4.6,"publicationDate":"2025-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144551831","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jonas M B Haslbeck, Alberto Jover Martínez, Anne J Roefs, Eiko I Fried, Lotte H J M Lemmens, Esmee Groot, Peter A Edelsbrunner
{"title":"Comparing Likert and visual analogue scales in ecological momentary assessment.","authors":"Jonas M B Haslbeck, Alberto Jover Martínez, Anne J Roefs, Eiko I Fried, Lotte H J M Lemmens, Esmee Groot, Peter A Edelsbrunner","doi":"10.3758/s13428-025-02706-2","DOIUrl":"10.3758/s13428-025-02706-2","url":null,"abstract":"<p><p>Measuring subjective experiences in ecological momentary assessment (EMA) studies has become pervasive in psychological science. A design choice that has to be made in all of these studies is which response scale to use. However, to date there is little guidance on this choice in the context of EMA. As a first step towards understanding the effects of different response scales, we experimentally vary the response scale and assess whether the resulting time series of subjective experiences are systematically different. We conducted a between-person experiment comparing a seven-point Likert scale ( <math><mrow><mi>n</mi> <mo>=</mo> <mn>63</mn></mrow> </math> ) with a Visual Analogue Scale (VAS; <math><mrow><mi>n</mi> <mo>=</mo> <mn>56</mn></mrow> </math> ) in an EMA study measuring affective states over 14 days. Using Bayesian multilevel models, we found that the VAS resulted in moderately higher within-person item means, lag-0 correlations, lag-1 autocorrelations, as well as lower within-person skewnesses and response frequencies of exact zeros. We found the largest difference in correlations with external criteria related to psychopathology, where correlations for the VAS were much higher. We did not observe reliable differences in within-person item variances, root mean squared successive differences, missing data, duration of measurements, and ratings about the experiences with the EMA survey. Apart from higher within-person means and higher correlations with external criteria in the VAS group, the differences were relatively small. While more research on response scales in EMA is needed, based on our results we conclude that the VAS should be preferred in studies aiming at capturing affective states relating to general psychopathology, as well as for items whose variation occurs close to scale limits. We conclude by discussing how our findings may contribute to a larger research agenda that addresses the fit of different response scales for different research aims.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"217"},"PeriodicalIF":4.6,"publicationDate":"2025-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144551830","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Roy S Hessels, Diederick C Niehorster, Marcus Nyström, Richard Andersson, Gijs A Holleman, Ignace T C Hooge
{"title":"The fundamentals of eye tracking part 5: The importance of piloting.","authors":"Roy S Hessels, Diederick C Niehorster, Marcus Nyström, Richard Andersson, Gijs A Holleman, Ignace T C Hooge","doi":"10.3758/s13428-025-02737-9","DOIUrl":"10.3758/s13428-025-02737-9","url":null,"abstract":"<p><p>The goal of this article is to demonstrate the importance of pilot studies in empirical eye-tracking research. First, we show what can go wrong when proper pilot experiments are omitted for all phases of an eye-tracking study, from testing an experiment, conducting the data collection, to building, revising, and interpreting the data analysis. Second, we describe a series of eye-tracking studies as a case study, and elaborate on all the pilot experiments that were conducted. We highlight what was learned from each pilot experiment when conceiving, designing, and conducting the research. Finally, we give practical advice for eye-tracking researchers on planning and conducting pilot experiments. This advice can be summarized as (1) take enough time, (2) be problem-oriented, (3) pilots are of an iterative nature, (4) many questions are empirical, and (5) apply the four-eyes principle. We envision that the present article helps early career researchers discover, and more established researchers rediscover, the utility of pilot experiments.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"216"},"PeriodicalIF":4.6,"publicationDate":"2025-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144551832","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A cognitive diagnosis model for disengaged behaviors.","authors":"Benjamin Lugu, Wenjing Guo, Wenchao Ma","doi":"10.3758/s13428-025-02734-y","DOIUrl":"https://doi.org/10.3758/s13428-025-02734-y","url":null,"abstract":"<p><p>Cognitive diagnosis assessments are frequently used for formative purposes. Due to the low-stakes nature of these assessments, students may exhibit disengaged behaviors, such as rapid guessing and item omissions. Most existing studies in cognitive diagnosis models assume that item responses are reflections of students' proficiency without considering their engagement levels. This study proposes a disengaged behavior cognitive diagnosis model (DB-CDM) that accounts for both disengaged and engaged behaviors simultaneously. We examined the performance of the DB-CDM through simulation and empirical studies. The simulation showed that the item parameters of the DB-CDM were recovered well, especially when the sample size was large and the proportion of disengaged students was small. The DB-CDM can also accurately identify disengaged students, even under some unfavorable conditions involving a large number of disengaged students. By comparing DB-CDM with the compensatory reparameterized unified model in terms of attribute classifications, we observed that the DB-CDM yielded similar if not higher attribute classifications. In the real data analysis, we found that engaged students had a lower probability of omission and guessing and a higher probability of exhibiting solution behavior compared to disengaged students. This paper provides some initial evidence to support the use of DB-CDM when disengaged behaviors occur.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"213"},"PeriodicalIF":4.6,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144537950","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Arthur R Pijpaert, H H L M Jeroen Goossens, Bob W van Dijk, L J Bert Roetman, Ruth M A van Nispen, Laurentius J René van Rijn
{"title":"A validation study on the accuracy and precision of gaze and vergence using stereoscopic eye-tracking technology.","authors":"Arthur R Pijpaert, H H L M Jeroen Goossens, Bob W van Dijk, L J Bert Roetman, Ruth M A van Nispen, Laurentius J René van Rijn","doi":"10.3758/s13428-025-02731-1","DOIUrl":"10.3758/s13428-025-02731-1","url":null,"abstract":"<p><p>Binocular video-based eye-tracking allows for gaze and vergence measurements, but the accuracy and precision of vergence are barely addressed. Here, we investigate the accuracy and precision of both gaze and vergence measurements using a stereoscopic eye-tracking system. Previous studies have evaluated stereoscopic eye-trackers for gaze eccentricities up to 16°. We validated a custom-built stereoscopic eye-tracker with two cameras and two infrared light sources for gaze eccentricities up to 21°. Additionally, we studied the impact of fixation distance and pupil size on vergence accuracy. Participants with normal binocular vision (N = 8) performed fixation tasks, enabling the assessment of both gaze and vergence errors. The stereoscopic system provided gaze estimates with a mean absolute error (MAE) of less than 1° within the central visual field. However, the accuracy decreased for peripheral angles larger than 14°. We found a MAE of 0.89 ± 0.58° in measuring vergence and a strong linear association between target vergence and measured vergence, with a slope of 0.99 ± 0.05. In contrast to previous studies using single-camera eye-trackers, we found no systematic influence of pupil size on the vergence measurements. Although there was high agreement between estimated and ground truth vergence in the central field, the system did struggle to maintain accuracy at larger eccentricities. This limitation arises primarily from the loss of reliable glints rather than technical constraints, indicating the need for alternative approaches to enhance accuracy in wider fields of view.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"214"},"PeriodicalIF":4.6,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12213999/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144537951","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Matthew D Zelko, Stephen R Robinson, Elisa L Hill-Yardin, Helen Nasser
{"title":"Resolving anxiety-like behaviour inconsistencies in the elevated plus maze by tracking exploration depth and timing.","authors":"Matthew D Zelko, Stephen R Robinson, Elisa L Hill-Yardin, Helen Nasser","doi":"10.3758/s13428-025-02738-8","DOIUrl":"10.3758/s13428-025-02738-8","url":null,"abstract":"<p><p>The anxiety-like behaviour provoked by the elevated plus maze is primarily measured by the degree to which a rodent explores or avoids the risker, unenclosed arms. Measures such as arm entries and total time spent within the arm are conventionally used, but their analysis often produces inconsistent inferences about the level of anxiety-like behaviour being observed. This inconsistency occurs because the measures do not correlate with one another, raising the question of how validly they capture both the exploratory and avoidance motivations that typify anxiety-like behaviour. Given this inconsistency, we propose a new measure, Novel Exploration Growth, that captures avoidance and exploratory behaviours within the maze. The growth of novel exploration tracks the first visit to discrete areas of the maze over time. The absolute amount of novel exploration, combined with the phasic nature of the exploration, reveals behavioural phenotypes with both avoidance and exploration quantified in a single time series. By addressing both motivations evoked by the maze through a single coherent measure, we provide a superior estimation of anxiety-like behaviour and resolve inconsistencies that arise when applying conventional measures alone.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"210"},"PeriodicalIF":4.6,"publicationDate":"2025-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12209025/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144526310","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Arryn Robbins, Michael C Hout, Ashley Ercolino, Joseph Schmidt, Hayward J Godwin, Justin MacDonald
{"title":"The Pictures by Category and Similarity (PiCS) database: A multidimensional scaling database of 1200 images across 20 categories.","authors":"Arryn Robbins, Michael C Hout, Ashley Ercolino, Joseph Schmidt, Hayward J Godwin, Justin MacDonald","doi":"10.3758/s13428-025-02732-0","DOIUrl":"10.3758/s13428-025-02732-0","url":null,"abstract":"<p><p>Visual similarity is an essential concept in vision science, and the methods used to quantify similarity have recently expanded in the areas of human-derived ratings and computer vision methodologies. Researchers who want to manipulate similarity between images (e.g., in a visual search, categorization, or memory task) often use the aforementioned methods, which require substantial, additional data collection prior to the primary task of interest. To alleviate this problem, we have developed an openly available database that uses multidimensional scaling (MDS) to model the similarity among 1200 items spread across 20 object categories, thereby allowing researchers to utilize similarity ratings within and between categories. In this article, we document the development of this database, including (1) collecting similarity ratings using the spatial arrangement method across two sites, (2) our computational approach with MDS, and (3) validation of the MDS space by comparing SpAM-derived distances to direct similarity ratings. The database and similarity data provided between items (and across categories) will be useful to researchers wanting to manipulate or control similarity in their studies.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"212"},"PeriodicalIF":4.6,"publicationDate":"2025-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12208956/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144526311","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Japanese LDA model for automatic clustering analysis of semantic verbal fluency tests.","authors":"Masahiro Yoshihara, Yoshihiro Itaguchi","doi":"10.3758/s13428-025-02696-1","DOIUrl":"10.3758/s13428-025-02696-1","url":null,"abstract":"<p><p>In the semantic variant of verbal fluency tests (VFTs), clustering analysis has become popular for examining the semantic structure. While the computational psycholinguistics approach has recently drawn attention to increasing the reproducibility of clustering analysis, such an approach is not available in all languages. To make the computational approach available in the Japanese language, we constructed a Japanese latent Dirichlet allocation (LDA) model. Our LDA model enables researchers and clinicians to objectively quantify the associative relationships of words, thereby making it possible to automatically detect semantic clusters. We conducted the semantic VFT with healthy young Japanese adults to examine the validity of our LDA model. We performed clustering analyses using the computational approach with our LDA model and the conventional manual approach with human coders. The results showed that the LDA model identified semantic clusters, as did the human coders. In addition, we demonstrated for the first time that response intervals within a cluster were significantly shorter than those outside of clusters, regardless of the clustering approaches. This indicates that both approaches reflect a broadly accepted assumption that closer semantic relations require less processing time. However, LDA-based clustering produced, on average, larger clusters than human-based clustering did, indicating that the LDA model captured semantic relationships between words that human coders would not recognize. Taken together, the present results demonstrated the validity of our LDA model. We hope that our LDA model fosters the use of the computational linguistic approach in semantic VFTs with Japanese participants.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 8","pages":"209"},"PeriodicalIF":4.6,"publicationDate":"2025-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12209035/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144526308","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}