Behavior Research Methods最新文献

{"title":"From review to synthesis: A step-by-step methodological guide to systematic reviews and multilevel meta-analyses.","authors":"Meilan Hu, Paye Shin Koh, Xun Ci Soh, Andree Hartanto, Nadyanna M Majeed","doi":"10.3758/s13428-026-02961-x","DOIUrl":"10.3758/s13428-026-02961-x","url":null,"abstract":"<p><p>We provide a step-by-step guide on conducting a quantitative systematic review (i.e., meta-analysis) using the open-source programming language R, as well as conducting a multilevel meta-analysis, in contexts where effect sizes are non-independent (e.g., multiple studies from the same lab). Quantitative systematic reviews offer researchers a method for synthesizing large bodies of literature, helping clarify inconsistent findings, identify research gaps, and refine theoretical models. However, existing tutorials often assume prior knowledge and/or experience, often overlooking foundational concepts. To address this gap, a comprehensive walkthrough of the systematic review process is presented, covering pre-registration, literature search and retrieval, screening, risk of bias assessment, and data extraction following the PRISMA framework. We then present detailed guidance on how to conduct both traditional and multilevel meta-analyses in R. Specifically, the tutorial explains how to estimate overall meta-analytic effect sizes when effect sizes are independent (traditional meta-analysis) and when effect sizes are nested within labs (multilevel meta-analysis). Procedures for assessing heterogeneity, testing for publication bias, and conducting moderation analyses are also covered. To accompany this tutorial, we supplement annotated R scripts and R notebooks to support transparency, reproducibility, and accessibility for researchers of all levels of experience.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 7","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-06-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13272617/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148257137","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Psychometric functions for temporal discrimination: Duration or log duration?","authors":"Miguel A García-Pérez, Rocío Alcalá-Quintana","doi":"10.3758/s13428-026-03075-0","DOIUrl":"10.3758/s13428-026-03075-0","url":null,"abstract":"<p><p>Duration discrimination data collected with single-presentation tasks (e.g., bisection or temporal generalization tasks) or dual-presentation tasks (e.g., greater-less or same-different tasks) are usually analyzed by fitting psychometric functions. The independent variable in these functions is test duration measured in seconds or milliseconds. In contrast, the independent variable is log stimulus magnitude in psychometric functions for discrimination in other sensory modalities, most often because of the applicability of Weber's law. We report a study aimed at determining empirically whether duration discrimination data are best described by psychometric functions of duration or log duration. We first conducted a simulation study to identify the design (type of task, number of test durations, number of trials, etc.) with which the generating psychometric function (of duration or log duration) fit the data substantially better than the impostor function. Based on these results, we conducted an empirical study with the same-different task that adaptively administered 1,200 trials over 11 test durations around the standard duration. We collected 45 datasets and fitted both types of psychometric function in each case. By the loglikelihood-ratio statistic, psychometric functions of duration fitted the data better in only 7 of 45 cases (15.6%), in agreement with simulation results obtained when data were generated by psychometric functions of log duration. Analysis of data from 69 published papers (totaling 17,000+ psychometric functions) also indicated better fit of psychometric functions of log duration in the expected proportion given the typically small numbers of trials per function.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 7","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13263295/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148222854","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Self-reported expressibility predicts communicative success: Open dataset, validation, and simulation.","authors":"Aleksandra Ćwiek, Susanne Fuchs, Wim Pouw, Šárka Kadavá","doi":"10.3758/s13428-026-03071-4","DOIUrl":"10.3758/s13428-026-03071-4","url":null,"abstract":"<p><p>Referential communication experiments, in which participants negotiate meaning without conventional language, have provided insights into the origins of language and the modalities that accompanied its early forms. However, these experiments are resource-intensive, limiting sample sizes and the diversity of stimuli. This study provides an empirical validation of expressibility ratings - participants' subjective judgments about their ability to communicate concepts through different modalities - as an efficient alternative to laboratory-based production experiments. We collected expressibility ratings for 207 concepts across three modalities: gesture-only, vocalization-only, and combined gesture-vocalization. These ratings were empirically validated against a production experiment in which participants attempted to communicate 84 selected concepts. We measured communicative success using binary accuracy (correct/incorrect) and continuous semantic similarity between guesses and targets. Results strongly support the empirical validity of expressibility ratings. Higher expressibility ratings reliably predicted greater guessability (both measures) and required fewer corrective attempts when feedback was provided. Feedback improved exact matches but not semantic similarity. Modality comparisons revealed that gesture-only and combined modalities performed equivalently and both substantially better than vocalization-only. To further showcase the utility of the ratings, we created robust simulations to investigate potential bias in concept selection for stimuli. The analysis examined varying semantic domains and stimulus and participant numbers, finding no systematic bias toward gestural superiority, suggesting robust modality differences. The strong correspondence between expressibility ratings and actual communicative success demonstrates that humans have intuitions of their nonlinguistic communicative abilities. These findings establish expressibility ratings as a methodologically efficient tool for studying modality affordances, enabling larger-scale investigations with enhanced statistical power and broader conceptual coverage.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 7","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13263253/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148222844","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The Person-Reported Outcome of Conversational Success (PROCS): Tool development and psychometric validation.","authors":"Camille J Wynn, Samantha Budge, Carolyn R Baylor, Tyson S Barrett, Stephanie A Borrie","doi":"10.3758/s13428-026-03063-4","DOIUrl":"10.3758/s13428-026-03063-4","url":null,"abstract":"<p><p>Despite the centrality of successful conversation to well-being, psychometrically developed and validated tools to measure this construct are lacking. The purpose of this study was to develop and validate the Person-Reported Outcome of Conversational Success (PROCS), a measure of conversational success. We define success as the degree to which an interlocutor evaluates a conversation as beneficial, worthwhile, and/or satisfactory. In phase one of development, an initial draft of the PROCS was created based on a literature review, expert input, and established frameworks in communication research. In phase two, cognitive interviews were conducted with 39 participants to assess the measure's content, format, and usability and further refine the measure. In phase three, 50 participants completed the PROCS in live embodied conversations to assess the measure's practical effectiveness and usability. Finally, in phase four, psychometric validation was completed using data from 817 participants who completed the PROCS based on recently recalled conversations. The final version of the PROCS can be used to quantify the success of a single conversation. Careful planning of the initial draft of the PROCS coupled with input from participants from a diverse set of user groups across multiple phases of development, ensures the measure's validity, clarity, usability, and versatility. The PROCS is a valuable tool for assessing conversational success, with applications in both research and clinical practice.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 7","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-06-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13253778/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148216252","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Automatic quantification of lexical ambiguity using large-scale word association data.","authors":"Ignacio Iglesias, Blair C Armstrong, Julieta Laurino, Laura Kaczer, Álvaro Cabana","doi":"10.3758/s13428-026-03050-9","DOIUrl":"10.3758/s13428-026-03050-9","url":null,"abstract":"<p><p>Most words in a language are lexically ambiguous and are associated with multiple meanings that vary in their frequency and relatedness. Although ambiguity is a fundamental property of language, there are extensive issues with existing measures of this construct. For instance, dictionary-based classifications and subjective ratings of meaning number and frequency struggle to capture the graded nature of ambiguity and, by proxy, its impact on cognition and performance in experimental tasks. It is also difficult to scale subjective measures to the full lexicon. We introduce a novel, automated framework to measure lexical ambiguity based on word association data from the Small World of Words (SWOW) project. We apply community detection algorithms to association graphs to quantify both the number and distribution of semantic communities for each word. This in turn allows us to derive graded representations of meaning frequency and relatedness. To better understand our new metrics, we compare them to previously published subjective norms, and establish their validity by showing that they predict lexical decision performance in English and Rioplatense Spanish. Furthermore, our results reveal cross-linguistic differences in lexical ambiguity-Spanish is less ambiguous than English overall-which we hypothesize is due to typological differences between the languages. Our validated framework contributes novel insights for computational and psycholinguistic models of semantic processing, and offers a scalable, automated, and language-independent framework for quantifying different facets of lexical ambiguity. We provide all of our code and ambiguity measures for approximately 7,000 words in both languages to facilitate their use by other researchers.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 7","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-06-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148216299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Multi-method validation of the new computerized test of fluid intelligence MatriKS.","authors":"Debora de Chiusole, Ottavia M Epifania, Pasquale Anselmi, Andrea Brancaccio, Noemi Mazzoni, Matilde Spinoso, Matteo Orsoni, Sara Giovagnoli, Irene Pierluigi, Alice Bacherini, Mariagrazia Benassi, Giulia Balboni, Luca Stefanutti","doi":"10.3758/s13428-026-03049-2","DOIUrl":"10.3758/s13428-026-03049-2","url":null,"abstract":"<p><p>This paper introduces MatriKS, a new computerized tool for the assessment of fluid intelligence based on Raven-like matrices. Based on knowledge structure theory (KST), a mathematical framework initially designed for efficient assessment and personalized learning, MatriKS is the first large-scale application of KST to fluid intelligence assessment. The validation results for MatriKS, suitable for Italian individuals aged 4 to 11 ( <math><mrow><mi>N</mi> <mo>=</mo> <mn>568</mn></mrow> </math> ), are presented. A multi-method approach incorporating classical test theory (CTT), item response theory (IRT), and KST was employed. Each of the three approaches, with its own assumptions and models, highlights structural properties of the data that are not captured by the other two. Nevertheless, the three approaches provide an acceptable modeling of the data supporting the adequate functioning of MatriKS. The study concludes by exploring the methodological and practical benefits of using KST for constructing tests and estimating individual cognitive profiles.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 7","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13246548/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148203883","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Reassessing cumulative self-paced reading (SPR): Testing three variants shows cumulative SPR can be more useful than standard non-cumulative SPR for sentence-processing research, depending on presentation format.","authors":"Hiroki Fujita","doi":"10.3758/s13428-026-03044-7","DOIUrl":"10.3758/s13428-026-03044-7","url":null,"abstract":"<p><p>Self-paced reading (SPR) is widely used to investigate real-time sentence processing. In SPR, sentences can be presented either cumulatively, with previously presented words remaining visible, or non-cumulatively, with previous words disappearing. However, most prior research has avoided cumulative presentation, largely due to concerns that it allows readers to reveal multiple words through rapid key presses and then read them, thereby undermining the interpretability of reading times. As a result, cumulative SPR is widely assumed to be unsuitable for research on real-time sentence processing. The present study examines this assumption by comparing three cumulative SPR variants-ahead-visible cumulative SPR (AVC-SPR), non-ahead-visible cumulative SPR (NAVC-SPR), and partially cumulative SPR (PC-SPR)-with standard non-cumulative SPR (NC-SPR). In AVC-SPR, the positions of upcoming words are visually indicated; in NAVC-SPR, upcoming positions are not indicated; and in PC-SPR, upcoming positions are likewise not indicated, and accumulation is capped so that only a limited number of words remain visible. The four tasks were compared in terms of their sensitivity to detecting garden-path and number-mismatch effects. Clear effects were observed in all four tasks, with NAVC-SPR yielding the largest effect sizes. Power analyses further indicated that NAVC-SPR generally offers the highest prospective power to detect these effects. PC-SPR showed effect sizes similar to or larger than those in NC-SPR, and AVC-SPR was the least reliable task. Together, these findings challenge the assumption that cumulative presentation is unsuitable for studying real-time sentence processing and suggest that NAVC-SPR and PC-SPR are viable alternatives to NC-SPR. All cumulative SPR tasks, together with an R script for automated stimulus formatting, are openly available to facilitate their adoption.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 7","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13246519/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148203886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Publisher Correction: Enhancing propensity score analysis with data missing not at random: Introducing dual-forest proximity imputation.","authors":"Yongseok Lee, Walter L Leite","doi":"10.3758/s13428-026-03094-x","DOIUrl":"10.3758/s13428-026-03094-x","url":null,"abstract":"","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 7","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13246514/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148197379","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Virtual reality skinner box: A step-by-step guide with Unity and Spatial.io.","authors":"Laurent Avila-Chauvet, Diana Mejía-Cruz, Agustin Robles-Morua, Ivan Humberto Uribe Morales, Yancarlo Lizandro Ojeda-Aguilar","doi":"10.3758/s13428-026-03067-0","DOIUrl":"10.3758/s13428-026-03067-0","url":null,"abstract":"<p><p>Virtual reality (VR) and immersive virtual reality (iVR) enable users to experience computer-generated, three-dimensional environments that can replicate real-world settings or create entirely fictional ones. Despite growing interest in the use of immersive technologies in research, designing and programming virtual environments, particularly without professional support, can be especially challenging due to technical complexity, cost, and the need for programming skills. To address these challenges and support researchers and students interested in developing experimental tasks in VR and iVR, this tutorial introduces the Spatial.io platform for virtual environment deployment, along with the Spatial Creator Toolkit for Unity. A detailed, step-by-step guide is provided for setting up a virtual operant conditioning chamber compatible with head-mounted displays (HMDs), mobile devices, and web browsers. The tutorial covers key development stages, including account setup, Unity project configuration, 3D model integration, incorporation of preconfigured Spatial components, and implementation of task logic using C#. By reducing technical barriers, this resource aims to promote the broader adoption of immersive virtual technologies in behavioral research.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 7","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148197327","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"New methodological and software tools for probing moderation in intrinsically nonlinear models.","authors":"Haley E Yaremych, Kristopher J Preacher","doi":"10.3758/s13428-026-03053-6","DOIUrl":"10.3758/s13428-026-03053-6","url":null,"abstract":"<p><p>When modeling psychological processes and relationships, intrinsically nonlinear models often enhance researchers' ability to draw useful theoretical and substantive conclusions. In addition, psychological theories frequently suggest that such processes and relationships are moderated; therefore, it is often important to test for, probe, and plot moderation. However, extant methods for assessing and visualizing moderation are largely restricted to linear models. Therefore, the goal of this paper is to develop novel analytical and software tools that enable researchers to specify and examine moderated parameters within intrinsically nonlinear models. First, methods for testing, plotting, and probing moderation are expanded in novel ways for use in nonlinear models; specifically, we present conceptual and mathematical extensions of the Johnson-Neyman (JN) technique. The JN technique is currently used to probe moderation of simple slopes within the linear modeling framework; our extensions enable its application to any moderated parameter of an intrinsically nonlinear model. Additionally, we introduce a Shiny application called CurveBuilder, which unifies the process of choosing, specifying, fitting, and visualizing intrinsically nonlinear models that may include moderated parameters and/or random effects. The application provides a code-free environment for users to complete all steps of the analysis process, including uploading data, visually choosing start values, specifying models, plotting results, and probing moderation with the extended JN technique. CurveBuilder examples are reviewed, and opportunities for future work in this area are discussed.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 7","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148197369","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}