Behavior Research Methods最新文献

筛选
英文 中文
MEYELens: An affordable, open-source, 3D-printable eyewear platform for pupillometry and gaze tracking. MEYELens:一个经济实惠的、开源的、3d打印的眼镜平台,用于瞳孔测量和视线跟踪。
IF 5 2区 心理学
Behavior Research Methods Pub Date : 2026-08-21 DOI: 10.3758/s13428-026-03157-z
Giacomo Vecchieschi, Letizia Ingenito, Alessandro Benedetto, Caterina Luciani, Fabio Carrara, Giovanni Cioni, Andrea Guzzetta, Tommaso Pizzorusso, Laura Baroncelli, Raffaele M Mazziotti
{"title":"MEYELens: An affordable, open-source, 3D-printable eyewear platform for pupillometry and gaze tracking.","authors":"Giacomo Vecchieschi, Letizia Ingenito, Alessandro Benedetto, Caterina Luciani, Fabio Carrara, Giovanni Cioni, Andrea Guzzetta, Tommaso Pizzorusso, Laura Baroncelli, Raffaele M Mazziotti","doi":"10.3758/s13428-026-03157-z","DOIUrl":"10.3758/s13428-026-03157-z","url":null,"abstract":"<p><p>Pupillometry and gaze tracking provide sensitive, noninvasive indices of autonomic function and cognitive state and are increasingly employed in neuroscience and clinical research. However, commonly used systems remain costly and often constrain hardware customization and workflow transparency. MEYELens is presented as an open-source, fully 3D-printable wearable system for low-cost pupillometry and gaze tracking using readily available components. The design is modular and mechanically adjustable to accommodate different users and experimental requirements. An open pipeline is provided for data acquisition and for both offline and online analysis. Feasibility is demonstrated across frequency-based and task-evoked pupillary paradigms, and gaze mapping is shown to operate in both screen-based and naturalistic settings. By combining affordability, modular hardware, and open software, MEYELens reduces barriers to reliable eye-based measurement and supports methodological development in resource-constrained research contexts.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 10","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13498615/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148787634","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
ValuesML: A new multilingual dataset for values detection in news and political manifestos. ValuesML:一个新的多语言数据集,用于新闻和政治宣言中的价值观检测。
IF 5 2区 心理学
Behavior Research Methods Pub Date : 2026-08-20 DOI: 10.3758/s13428-026-03092-z
Mario Scharfbillig, Theresa Reitis-Münstermann, Nicolas Stefanovitch, Johannes Kiesel, Paula Schulze Brock, Joanne Sneddon, Emmanuel Cartier, Murat Ardag, Sharon Arieli, Ella Daniel, Henrik Dobewall, Johannes Karl, Anna Krasteva, Thomas Peter Oeschger, Georgios Petasis, Luana Russo, Antonella Seddone, Aurelia Tamo-Larrieux, Hester van Herk, Nazan Avcı, Giuliano Bobba, Pierre Chiron, Ahmet Çoymak, Maria Dagioglou, Dora Katsamori, Ingmar Leijen, Berna Öney, Ricarda Scholz-Kuhn, Emilia Zankina, Sandrine Astor, Petra Auer, Livia Aulino, Anat Bardi, Fiorella Battaglia, Constanze Beierlein, Maya Benish-Weisman, Christina Christodoulou, Patricia R Collins, Irene Coppola, Mafalda Dâmaso, Meike Morren, Einat Elizarov, Naama Erlich, Peculiar Ezeigwe-Ephraim, Ronald Fischer, Maria Cristina Gaeta, Lucilla Gatt, Noam Gerera, Sjoukje Goldman, Frederic Gonthier, Stefanie Habermann, Mina Hristova, Demet Islambay Yapali, Luigi Izzo, Panos Kapetanakis, Reşit Kışlıoğlu, Chaya Koleva, Roberta Koleva, Joshua Lake, Mael Mesplou, Vanina Ninova, Elif Sandal Önal, Shani Oppenheim-Weller, Duygu Ozturk, Ioannis Elissaios Paparrigopoulos, Vladimir Ponizovskiy, Tim Reeskens, Maria Francesca Romano, Torven Schalk, Alina Starovolsky-Shitrit, Oscar Smallenbroek, Ömer Topuz, Christin-Melanie Vauclair, Giuseppe Di Vetta, Sheng Ye
{"title":"ValuesML: A new multilingual dataset for values detection in news and political manifestos.","authors":"Mario Scharfbillig, Theresa Reitis-Münstermann, Nicolas Stefanovitch, Johannes Kiesel, Paula Schulze Brock, Joanne Sneddon, Emmanuel Cartier, Murat Ardag, Sharon Arieli, Ella Daniel, Henrik Dobewall, Johannes Karl, Anna Krasteva, Thomas Peter Oeschger, Georgios Petasis, Luana Russo, Antonella Seddone, Aurelia Tamo-Larrieux, Hester van Herk, Nazan Avcı, Giuliano Bobba, Pierre Chiron, Ahmet Çoymak, Maria Dagioglou, Dora Katsamori, Ingmar Leijen, Berna Öney, Ricarda Scholz-Kuhn, Emilia Zankina, Sandrine Astor, Petra Auer, Livia Aulino, Anat Bardi, Fiorella Battaglia, Constanze Beierlein, Maya Benish-Weisman, Christina Christodoulou, Patricia R Collins, Irene Coppola, Mafalda Dâmaso, Meike Morren, Einat Elizarov, Naama Erlich, Peculiar Ezeigwe-Ephraim, Ronald Fischer, Maria Cristina Gaeta, Lucilla Gatt, Noam Gerera, Sjoukje Goldman, Frederic Gonthier, Stefanie Habermann, Mina Hristova, Demet Islambay Yapali, Luigi Izzo, Panos Kapetanakis, Reşit Kışlıoğlu, Chaya Koleva, Roberta Koleva, Joshua Lake, Mael Mesplou, Vanina Ninova, Elif Sandal Önal, Shani Oppenheim-Weller, Duygu Ozturk, Ioannis Elissaios Paparrigopoulos, Vladimir Ponizovskiy, Tim Reeskens, Maria Francesca Romano, Torven Schalk, Alina Starovolsky-Shitrit, Oscar Smallenbroek, Ömer Topuz, Christin-Melanie Vauclair, Giuseppe Di Vetta, Sheng Ye","doi":"10.3758/s13428-026-03092-z","DOIUrl":"https://doi.org/10.3758/s13428-026-03092-z","url":null,"abstract":"<p><p>Values are important building blocks of political ideologies and are frequently invoked in political debates. Yet, because values are abstract, understanding how they are expressed in real-world discourse, and how this varies across contexts, remains a challenge. In this paper, we introduce a large-scale, expert-annotated dataset of value expression in political text, comprising news articles and political manifestos across nine languages. The dataset is grounded in the refined theory of human values (Schwartz et al., 2012) and was developed through an iterative process of annotation guideline development, annotator training, and expert curation. Value annotations capture both the type of value expressed and its evaluative framing, distinguishing whether values are expressed as attained or constrained. The final dataset comprises 2648 texts and 74,231 sentences across nine languages. This resource enables systematic, cross-linguistic analysis of value expression in political communication and provides a benchmark for developing and evaluating computational models of value detection.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 10","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13493494/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148787712","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Addressing demand artifacts in psychological research (and beyond). 在心理学研究(及其他领域)中处理需求工件。
IF 5 2区 心理学
Behavior Research Methods Pub Date : 2026-08-19 DOI: 10.3758/s13428-026-03155-1
Olivier Corneille, Chloé Fournier Bernard, Peter Lush
{"title":"Addressing demand artifacts in psychological research (and beyond).","authors":"Olivier Corneille, Chloé Fournier Bernard, Peter Lush","doi":"10.3758/s13428-026-03155-1","DOIUrl":"https://doi.org/10.3758/s13428-026-03155-1","url":null,"abstract":"<p><p>Demand artifacts stem from participants' beliefs about treatment effects and motivations to respond in accordance with these beliefs. These artifacts typically build on subtle cues that exert extraneous influences unbeknownst to researchers, through processes that are not part of their stated theory. Demand artifacts threaten the internal and external validity of studies, and they have been supported across a wide range of psychological domains (e.g., clinical, cognitive, and social psychology, psychology of perception) and beyond (e.g., consumer research, experimental economics, psychosomatic medicine, neurosciences). This article reviews prominent methods used to address them. Our discussion is structured around Corneille and Lush's (2023) framework of demand effects, which distinguishes between participants' hypothesis formation, motivation, and implementation strategies. We conclude this review by discussing three fundamental questions of broad interest: when should we care about demand artifacts, what is the best approach for addressing them, and how can we usefully build on demand artifacts?</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 9","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148787499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
High-fidelity avatars for behavior and cognition research in virtual environments: An accessible construction method for scientists. 用于虚拟环境中行为和认知研究的高保真化身:一种可供科学家使用的构建方法。
IF 5 2区 心理学
Behavior Research Methods Pub Date : 2026-08-19 DOI: 10.3758/s13428-026-03139-1
Rachael L Taylor, Lisa Huerta, A Mike Burton, Markus Bindemann
{"title":"High-fidelity avatars for behavior and cognition research in virtual environments: An accessible construction method for scientists.","authors":"Rachael L Taylor, Lisa Huerta, A Mike Burton, Markus Bindemann","doi":"10.3758/s13428-026-03139-1","DOIUrl":"https://doi.org/10.3758/s13428-026-03139-1","url":null,"abstract":"<p><p>Virtual reality is increasingly employed in behavioral research, providing immersive environments that combine high levels of experimental control with ecological validity. Within virtual reality, humans are represented by digital characters - or avatars - whose realism and behavioral fidelity are crucial for studying social cognition. This study introduces an accessible method for constructing avatars with facial animations of eye gaze and expression that can be used by behavioral scientists. In two pre-registered experiments, we validate the use of these avatars for psychological research. In Experiment 1, we demonstrate that observers orient attention in response to avatar eye gaze, replicating the classic gaze-cueing effect. In Experiment 2, we show that participants can recognize avatar facial expressions with accuracy and confusion patterns comparable to those reported for human faces. These findings establish our construction pipeline as a user-friendly approach for generating high-fidelity avatars, equipping researchers with tools to investigate social and cognitive processes in controlled yet ecologically valid virtual environments. We provide access to an extensive manual for constructing avatars, along with a video example demonstrating the procedure step-by-step. Using a relatively inexpensive hand-held scanner, this enables behavioral scientists to create avatars with accurate facial animation for experiments in virtual environments.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 9","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13490262/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148787509","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Unity Playback System: A tool for visualizing behavioral data in 3D Unity virtual environments. Unity回放系统:一个在3D Unity虚拟环境中可视化行为数据的工具。
IF 5 2区 心理学
Behavior Research Methods Pub Date : 2026-08-18 DOI: 10.3758/s13428-026-03136-4
Xavier J Marshall, Nathaniel V Powell, Brett R Fajen
{"title":"The Unity Playback System: A tool for visualizing behavioral data in 3D Unity virtual environments.","authors":"Xavier J Marshall, Nathaniel V Powell, Brett R Fajen","doi":"10.3758/s13428-026-03136-4","DOIUrl":"https://doi.org/10.3758/s13428-026-03136-4","url":null,"abstract":"<p><p>The use of virtual environments, display technology, and eye tracking in behavioral studies has become more widespread in recent years as a result of drops in hardware cost and improvements in hardware mobility. Some studies of human behavior are conducted in 3D virtual environments created using tools such as the Unity game engine and open-source Unity Experiment Framework. However, the raw data from eye trackers, motion capture systems, and input devices (e.g., computer mouse, game controller, steering wheel/foot pedal system) are often noisy and difficult to validate and interpret without visualization. Such visualizations are best implemented in the context of the original environment, but manual implementation to verify experimental results can significantly stall data analysis. To address these issues, we created a generic experimental playback system for Unity that is capable of replaying the frame-by-frame state of the environment without leaving the engine. This GUI-based tool, which we call the Unity Playback System (UPBS) includes options for creating customized visualizations of the behavior of human subjects from different perspectives. We demonstrate the utility of this tool in the context of a simple virtual block stacking task as well as a more complex visually guided steering task, and we discuss how it can facilitate the analysis of gaze data collected in 3D virtual environments.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 9","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148787701","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Spatial Similarity Task: A cross-species approach to spatial memory. 空间相似性任务:空间记忆的跨物种方法。
IF 5 2区 心理学
Behavior Research Methods Pub Date : 2026-08-18 DOI: 10.3758/s13428-026-03127-5
Mia Borzello, William Supian, Andrea A Chiba
{"title":"The Spatial Similarity Task: A cross-species approach to spatial memory.","authors":"Mia Borzello, William Supian, Andrea A Chiba","doi":"10.3758/s13428-026-03127-5","DOIUrl":"https://doi.org/10.3758/s13428-026-03127-5","url":null,"abstract":"<p><p>Memory serves as the cornerstone of cognitive function and specifically enables the critical ability to disambiguate and encode similar experiences as distinct memories. Mnemonic discrimination of near spaces and places is a process crucially underpinned by a computational feature of the hippocampus, pattern separation. Whereas this refined aspect of spatial memory has been addressed in abundance in the rodent literature, fewer spatial tasks are designed to specifically query memory for spatial similarities in human subjects. To address this, we introduce an open-source virtual maze suite developed on the Unity platform, freely available for researchers to use, modify, and extend. The suite is designed to bridge the behavioral translation gap by assessing mnemonic discrimination in humans through a spatial delayed match-to-sample task, carefully modeled after rodent spatial memory tasks. Rather than relying on fully immersive systems, the suite leverages desktop-based virtual navigation to combine parametric control of experimental conditions with the ability to collect each participant's exploratory data. The pilot experiments are presented to validate the final suite design, alongside providing representative results from a subset of participants. Mnemonic discrimination was measured by parametric manipulation of spatial distances, resulting in a spatial distance memory function in which participants made more errors in remembering the correct location amongst similar or adjacent locations relative to distant locations. Given the prevalence of spatial memory deficits in age-related cognitive decline and neurological and psychiatric conditions, and the widespread use of spatial tasks in rodent models of these disorders, the Spatial Similarity Task (SST) suite offers a translationally grounded tool with direct potential for customization towards clinical application.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 9","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13486031/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148787652","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Linking signal integrity to probabilistic models of behavioral dynamics. 将信号完整性与行为动力学的概率模型联系起来。
IF 5 2区 心理学
Behavior Research Methods Pub Date : 2026-08-18 DOI: 10.3758/s13428-026-03132-8
Reza Sayfoori, Hung Cao
{"title":"Linking signal integrity to probabilistic models of behavioral dynamics.","authors":"Reza Sayfoori, Hung Cao","doi":"10.3758/s13428-026-03132-8","DOIUrl":"https://doi.org/10.3758/s13428-026-03132-8","url":null,"abstract":"<p><p>Quantitative analysis of rodent behavior in naturalistic settings is crucial for neuroscience, yet traditional methods often lack precision or scalability. While ultra-wideband (UWB) sensor tracking provides centimeter-level localization, standard metrics like root mean square error (RMSE) fail to capture the probabilistic and sequential nature of behavior. We introduce a probabilistic, information-theoretic framework that leverages high-resolution UWB sensor trajectories to address this gap. By integrating Shannon entropy to quantify uncertainty, Bernoulli modeling to assess accuracy thresholds, and first-order Markov chains to characterize state dynamics, our approach derives interpretable behavioral markers directly linked to signal quality. Empirical evaluation in an open-field arena demonstrated robust tracking under line-of-sight (LoS; RMSE: 20 mm) and non-line-of-sight (NLoS; RMSE: 35 mm) conditions. Crucially, we show that physical-layer impairments propagate to behavioral metrics: NLoS conditions increased entropy from 1.15 to 1.78 bits, reduced the probability of achieving sub-20 mm accuracy from 63.2% to 27.7%, and decreased state persistence, indicating greater behavioral fragmentation. By treating UWB signals as a probabilistic information source, our computationally efficient framework establishes a methodological bridge between engineering performance and neuroscience, enabling scalable, reproducible, and low-bias behavioral quantification suitable for preclinical research in complex environments.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 9","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13486021/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148787698","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Variable-length fully Bayesian adaptive testing and associated stopping criteria. 变长全贝叶斯自适应测试及相关停止准则。
IF 5 2区 心理学
Behavior Research Methods Pub Date : 2026-08-17 DOI: 10.3758/s13428-026-03148-0
Luping Niu, Seung W Choi
{"title":"Variable-length fully Bayesian adaptive testing and associated stopping criteria.","authors":"Luping Niu, Seung W Choi","doi":"10.3758/s13428-026-03148-0","DOIUrl":"https://doi.org/10.3758/s13428-026-03148-0","url":null,"abstract":"<p><p>Many computerized adaptive testing (CAT) systems treat item parameters as if they were known without error, relying on point estimates obtained during item pool calibration. This practice can underestimate uncertainty in ability estimates and affect when a variable-length CAT terminates. A fully Bayesian (FB) CAT algorithm addresses this issue by explicitly incorporating item parameter uncertainty into both ability estimation and item selection. This study investigated the performance of FB CAT in a variable-length setting and compared it with conventional CAT under three stopping rules: a standard error (SE) rule, a change-in- <math><mi>θ</mi></math> (CIT) rule, and a combined CIT+SE rule. Simulation studies were conducted across a range of calibration sample sizes and item pool sizes. Results showed that the FB algorithm generally improved estimation accuracy and produced interval coverage rates closer to nominal levels, especially when the calibration sample size was small. The combined CIT+SE rule reduced unnecessarily long tests that can arise when using only the SE rule, particularly at <math><mi>θ</mi></math> levels for which the remaining item pool provides limited additional information to further reduce SE. Overall, the findings indicate that FB variable-length CAT can enhance uncertainty quantification, and that the combined CIT+SE rule offers a practical balance between measurement precision and testing efficiency.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 9","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148787663","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Off-task behavior negatively impacts performance. 任务外行为会对工作表现产生负面影响。
IF 5 2区 心理学
Behavior Research Methods Pub Date : 2026-08-17 DOI: 10.3758/s13428-026-03149-z
Daniel J Peterson, Joshua L Fiechter, Riley Filister, Sara D Davis
{"title":"Off-task behavior negatively impacts performance.","authors":"Daniel J Peterson, Joshua L Fiechter, Riley Filister, Sara D Davis","doi":"10.3758/s13428-026-03149-z","DOIUrl":"https://doi.org/10.3758/s13428-026-03149-z","url":null,"abstract":"<p><p>Remote data collection has become more common in psychological research on human participants due to the large, diverse participant pool available at relatively inexpensive costs. This shift, however, comes at the expense of the oversight and carefully controlled setting found in the laboratory. The present study examined the off-task behavior of participants hired through Amazon's Mechanical Turk (MTurk) and its impact on memory performance across two pre-registered experiments. In Experiment 1, we found roughly one third of participants went off task during the encoding portions of a memory study and that this off-task behavior predicted poorer performance on the memory test. In Experiment 2, we replicated this outcome and further demonstrated that an explicit warning to stay on task reduced page switching but did not reduce the proportion of time spent off task. These results suggest the ease of remote data collection comes at a cost: a small but sizable minority of MTurk participants voluntarily navigate away from their study tasks, which negatively impacts performance. Further research is necessary to better understand how researchers might mitigate such behavior.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 9","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148787641","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Designing vocabulary multiple-choice tests for exploring word frequency effects in distributional semantics. 设计词汇选择题以探索分布语义中的词频效应。
IF 5 2区 心理学
Behavior Research Methods Pub Date : 2026-08-14 DOI: 10.3758/s13428-026-03143-5
Joseph P Levy, John A Bullinaria
{"title":"Designing vocabulary multiple-choice tests for exploring word frequency effects in distributional semantics.","authors":"Joseph P Levy, John A Bullinaria","doi":"10.3758/s13428-026-03143-5","DOIUrl":"https://doi.org/10.3758/s13428-026-03143-5","url":null,"abstract":"<p><p>The representation of word meanings by positions in a vector space is now widely used across a range of psychological models and technological applications. There exist many different approaches for creating such vectors, with distributional semantic vectors (DSVs) often produced directly or indirectly from word co-occurrence statistics derived from large corpora of natural language. One of the most widely used methods for testing and comparing their performance is the vocabulary multiple-choice question (VMCQ) test, in which the best synonym of each tested word has to be identified from among a set of distractor words. By manipulating the details of the questions, they can also be used to explore finer-grained aspects of performance, in particular the effect of word frequency. Many such tests have already been created for testing human linguistic ability, and they are easily applied to DSVs by basing the choice on simple vector distances. This paper demonstrates that, while the general VMCQ approach is useful for testing DSVs, designing VMCQs specifically for DSVs provides better results than using existing tests created for humans. To do that, an improved VMCQ scoring method is first developed that provides considerably more statistically reliable results, and that allows a series of new evaluation methods to be introduced that enable improved explorations of the effect of word frequency on DSVs and VMCQs. These eventually lead to the identification of an improved general VMCQ approach for exploring frequency effects in DSVs, which is successfully tested on a representative set of nine previously published DSVs.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 9","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148757599","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书