Behavior Research Methods最新文献

A tutorial on selecting, translating, and reporting variance priors in Bayesian multilevel models. 在贝叶斯多层模型中选择、翻译和报告方差先验的教程。

IF 5 2区心理学

Behavior Research Methods Pub Date : 2026-10-19 DOI: 10.3758/s13428-026-03201-y

Liu Liu

{"title":"A tutorial on selecting, translating, and reporting variance priors in Bayesian multilevel models.","authors":"Liu Liu","doi":"10.3758/s13428-026-03201-y","DOIUrl":"https://doi.org/10.3758/s13428-026-03201-y","url":null,"abstract":"Bayesian multilevel models are increasingly used in psychological, educational, and behavioral research, yet applied guidance on specifying priors for scalar variance components remains limited. This tutorial provides a practical workflow for identifying target variance components, selecting benchmark values, calibrating priors on variance and standard-deviation scales, translating them into software-compatible prior specifications, evaluating their implications through prior predictive checks, posterior comparison, sensitivity analysis, and transparent reporting. We review several commonly used prior families, including gamma, inverse-gamma, half-t, and half-Cauchy distributions, and clarify how their parameterizations relate across variance, precision (the reciprocal of variance), and standard-deviation formulations. The tutorial focuses on helping researchers align prior choice with substantive knowledge, model parameterization, software constraints, and sensitivity goals. As a worked example, we use a two-level analysis of TIMSS 2019 data to show how benchmark information from a non-overlapping reference sample can be calibrated into alternative variance-prior specifications and then evaluated in a smaller worked example sample. The empirical illustration is used as a pedagogical example to demonstrate the workflow and its associated checking procedures. We emphasize practical safeguards, including prior-density inspection, prior predictive checking, posterior comparison, convergence assessment, sensitivity analysis, and transparent reporting of prior assumptions. The tutorial concludes by summarizing practical, literature-grounded considerations for documenting prior rationale, implementation decisions, and robustness checks in Bayesian multilevel applications.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 11","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149223260","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Introducing GABLE: Lightweight infrastructure for longitudinal experiments using Google Apps Script. GABLE：使用谷歌Apps Script进行纵向实验的轻量级基础设施。

IF 5 2区心理学

Behavior Research Methods Pub Date : 2026-10-19 DOI: 10.3758/s13428-026-03205-8

Ibrahim Berber, Ilke Kas, Tarun Sepuri, Brooke N Macnamara, M Cenk Çavuşoğlu, Amy L Wilson-Delfosse, Elizabeth A Krupinski, Philip J Smith, Soumya Ray

引用次数: 0

Combined eye tracking and electroencephalography during referential selection in dyadic interaction. 二元相互作用中参考选择的眼动追踪和脑电图联合研究。

IF 5 2区心理学

Behavior Research Methods Pub Date : 2026-10-19 DOI: 10.3758/s13428-026-03172-0

Ingmar Brilmayer, Philip Georgis, Petra B Schumacher

{"title":"Combined eye tracking and electroencephalography during referential selection in dyadic interaction.","authors":"Ingmar Brilmayer, Philip Georgis, Petra B Schumacher","doi":"10.3758/s13428-026-03172-0","DOIUrl":"https://doi.org/10.3758/s13428-026-03172-0","url":null,"abstract":"Understanding language in real-world interaction requires methods that integrate auditory, visual, and neural signals. We present a proof-of-concept study combining mobile electroencephalography (EEG) and eye tracking to investigate referential selection during dyadic communication. Using a simplified version of the director task, pairs of participants engaged in naturalistic object-movement instructions while EEG and gaze data were recorded and synchronized via LabStreamingLayer, allowing us to calculate overlap-corrected, regression-based event-related potentials (rERPs) time-locked to spoken nouns and to participants' fixations, focusing on the N400/P300 (300-500 ms) and later (500-800 ms) time windows. Our results show that gaze behavior and fixation-related potentials provide crucial information for interpreting language-related ERPs: Targets competing with occluded referents elicited a stronger posterior positivity consistent with greater attentional demands. Fixation timing systematically modulated neural responses. Contrary to predictions, competitors received little visual attention, indicating that participants prioritized task-relevant information. These findings highlight the potential of multimodal data integration for understanding attentional and predictive mechanisms in real-world communication. Importantly, we show that established analytic techniques, such as artifact subspace reconstruction, independent component analysis, and linear deconvolution for ERP calculation, apply to noisy, naturalistic datasets. In addition, we provide a subsampling sensitivity approach to test the stability of the effects across different sample sizes. This study provides a methodological framework linking gaze and neural activity during interactive language processing. All preprocessing and analysis scripts, along with example datasets, are openly available on OSF ( https://osf.io/5ds4z ; a modified and optimized Python implementation is also available on GitHub: https://github.com/XlinCLab/DGAME ).","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 11","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149223274","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Human-in-the-loop LLM-assisted thematic analysis: A validated, reproducible tutorial for large-scale qualitative research. 人在循环法学硕士辅助专题分析：大规模定性研究的验证，可复制的教程。

IF 5 2区心理学

Behavior Research Methods Pub Date : 2026-10-19 DOI: 10.3758/s13428-026-03207-6

Mandana Jafarian

{"title":"Human-in-the-loop LLM-assisted thematic analysis: A validated, reproducible tutorial for large-scale qualitative research.","authors":"Mandana Jafarian","doi":"10.3758/s13428-026-03207-6","DOIUrl":"https://doi.org/10.3758/s13428-026-03207-6","url":null,"abstract":"Large language models (LLMs) are increasingly used to support qualitative research, yet clear methodological frameworks for integrating them into thematic analysis remain limited. A central challenge is how to scale qualitative coding with LLM assistance while preserving methodological rigor and reproducibility. This tutorial presents a structured, human-in-the-loop workflow for conducting large-scale thematic analysis with LLM support. Grounded in inductive and hybrid approaches to thematic analysis (Braun & Clarke, 2006), the workflow proceeds in three phases. First, researchers conduct manual thematic analysis on a subset of data to establish an initial codebook and assess relevance. Second, the same subset is analyzed using an LLM to iteratively refine prompts and evaluate alignment between human and model outputs. Third, the validated approach is applied to the full corpus using a modular four-step pipeline: key-idea extraction, chunk-level thematic coding, theme consolidation, and clustering, with iterative human verification through random sampling of outputs. We demonstrate the workflow using 2,952 publicly available Reddit posts. Structured prompt design and JSON-formatted outputs enable traceability between themes and source data and support reproducible analysis. Prompt engineering is treated as an iterative analytic process rather than a one-time instruction. Under controlled conditions, human and LLM coding showed high agreement (Cohen's κ = 0.91). All prompts, code, and reproducibility materials are openly available via an Open Science Framework repository. By providing detailed implementation guidance, embedded validation procedures, and safeguards against common failure modes such as hallucination and overgeneralization, this tutorial offers a practical and extensible framework for integrating LLMs into qualitative research across domains.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 11","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149223318","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A topic-based framework for interpretable and sparse semantic representations. 用于可解释和稀疏语义表示的基于主题的框架。

IF 5 2区心理学

Behavior Research Methods Pub Date : 2026-10-16 DOI: 10.3758/s13428-026-03187-7

Ming Song, Qing Cai

{"title":"A topic-based framework for interpretable and sparse semantic representations.","authors":"Ming Song, Qing Cai","doi":"10.3758/s13428-026-03187-7","DOIUrl":"https://doi.org/10.3758/s13428-026-03187-7","url":null,"abstract":"In computational approaches to language, semantic representations produced by modern deep learning systems are often encoded as high-dimensional latent vectors that are difficult to interpret. By contrast, cognitive science has emphasized the need for semantic representations with interpretable and cognitively meaningful structures. Although researchers have explored concept representations using corpus-driven distributed embeddings and various feature-based paradigms, a scalable and interpretable framework that can represent linguistic materials across different levels of granularity remains an open methodological challenge. Recent advances in pretrained language models have led to topic modeling methods that leverage these models, such as BERTopic, which uses sentence-level embeddings to derive clusters corresponding to human-interpretable topics. Building on this line of work, the present study introduces a framework, SISTR, for representing Semantics as Interpretable and Sparse Topic-based Representations. The framework extracts interpretable topics from the corpus and models the semantics of linguistic materials via their relations to the derived topics. This framework is designed to accommodate linguistic materials across different levels and languages. We evaluated the interpretability of the resulting topic dimensions through behavioral experiments. We applied this framework to word association tasks and semantic judgments, comparing model predictions with human behavioral data. The results suggest that SISTR achieves competitive performance to existing semantic representation methods while providing sparse and interpretable semantic representations. Overall, SISTR provides a reusable semantic coordinate system that offers an interpretable bridge between linguistic data and cognitive theories of semantic representation.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 11","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149206637","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Identifying hidden cognate effects in L2 lexical retrieval tasks: A tutorial for stimulus design. 识别二语词汇检索任务中的隐性同源效应：刺激设计指南。

IF 5 2区心理学

Behavior Research Methods Pub Date : 2026-10-16 DOI: 10.3758/s13428-026-03210-x

Kelly Kendro, Alexander J Holmberg

{"title":"Identifying hidden cognate effects in L2 lexical retrieval tasks: A tutorial for stimulus design.","authors":"Kelly Kendro, Alexander J Holmberg","doi":"10.3758/s13428-026-03210-x","DOIUrl":"https://doi.org/10.3758/s13428-026-03210-x","url":null,"abstract":"Psycholinguistic research involving multilingual participants often examines the extent to which processing of one language is related to processing of another, especially during semantic priming. When choosing crosslinguistic task items in second language (L2) vocabulary research, researchers often control for dimensions such as orthographic or phonetic overlap that may lead to a task advantage that does not represent semantic priming effects from the L2 during lexical retrieval. Prior research shows that cognates may facilitate lexical retrieval across a bilingual's languages by activating both lexical representations of a task item (e.g., Sánchez-Casas et al., 1992; Van Assche et al., 2009). However, the cognate status of words that are semantically related to a target have not been fully considered as potential confounds, even though these pairs may trigger semantic activation that similarly facilitates recognition. In this paper, we detail seven steps researchers can take when evaluating crosslinguistic target pairs to avoid compromising their paradigm due to activation of cognate synonyms. This approach allows language researchers to screen stimuli for several confounding dimensions including semantic similarity, orthographic similarity, and etymological relatedness, ultimately strengthening the validity of crosslinguistic vocabulary tasks to better elicit and evaluate lexical activation in multilinguals. We conclude by showcasing our method to evaluate a sample set of English-Spanish items and provide code for researchers to evaluate their own crosslinguistic stimuli pairs.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 11","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149190860","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Decisions under uncertainty: A statistical framework for evaluating practical relevance in interval-based hypothesis testing. 不确定性下的决策：基于区间的假设检验中评估实际相关性的统计框架。

IF 5 2区心理学

Behavior Research Methods Pub Date : 2026-10-15 DOI: 10.3758/s13428-026-03204-9

Paul Riesthuis, Robert A Cribbie, Victoria Celio, Nataly Beribisky

{"title":"Decisions under uncertainty: A statistical framework for evaluating practical relevance in interval-based hypothesis testing.","authors":"Paul Riesthuis, Robert A Cribbie, Victoria Celio, Nataly Beribisky","doi":"10.3758/s13428-026-03204-9","DOIUrl":"https://doi.org/10.3758/s13428-026-03204-9","url":null,"abstract":"Psychological researchers are increasingly encouraged to move beyond a narrow focus on detecting statistically significant effects that differ from zero. To interpret findings more meaningfully, best practices emphasize evaluating effect magnitude to determine whether it is practically meaningful or negligible. This requires specifying a smallest effect size of interest and conducting interval-based hypothesis tests. Although these approaches improve current practice by explicitly accounting for effect sizes, interval-based hypothesis tests can yield inconclusive results, leaving uncertainty about whether an effect is practically relevant or negligible. In this article, we first explain what interval-based hypothesis testing is and highlight challenges posed by inconclusive outcomes. We then propose a set of complementary tools implemented in an accompanying Web application ( https://paulriesthuis.github.io/SESOI-Decisions/ ) to support more informed decision-making under such uncertainty and help assess the practical relevance of results. These tools aim to help researchers draw more nuanced statistical and practical decisions and improve the interpretation of results obtained from interval-based hypothesis testing.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 11","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149190863","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Accounting for response styles in rating data using IRT and IRTree models: A tutorial in R with applications to self-reported metacognitive competence. 使用IRT和IRTree模型解释评分数据中的反应风格：R语言教程，应用于自我报告的元认知能力。

IF 5 2区心理学

Behavior Research Methods Pub Date : 2026-10-14 DOI: 10.3758/s13428-026-03181-z

Thorsten Meiser, Esther Ulitzsch, Mirka Henninger

{"title":"Accounting for response styles in rating data using IRT and IRTree models: A tutorial in R with applications to self-reported metacognitive competence.","authors":"Thorsten Meiser, Esther Ulitzsch, Mirka Henninger","doi":"10.3758/s13428-026-03181-z","DOIUrl":"10.3758/s13428-026-03181-z","url":null,"abstract":"Response styles refer to individual differences in the use of the item response format irrespective of item content. They include tendencies to favor or avoid midpoint or extreme response categories, which can distort the measurement of latent constructs. This tutorial provides an overview of IRT and IRTree models that accommodate response style factors, allowing researchers to analyze response-style effects and adjust latent-trait estimates for potential bias. In particular, we give a practical guide to using IRT and IRTree models for response styles and illustrate the workflow of model implementation, estimation, and interpretation with an empirical data set on self-reported metacognitive competence (Double, 2025). Throughout the tutorial, IRT and IRTree models are specified with standard R tools, and parameter estimation is accomplished in the common framework of multidimensional IRT with the R package mirt (Chalmers, 2012; Chalmers et al., 2025). The empirical results demonstrate that IRT and IRTree models can disentangle substantive traits and response styles, and that model-based estimates of substantive traits are adjusted accordingly. More specifically, both model classes reveal pronounced correlations among latent trait dimensions and among response style factors, but only small correlations between traits and response styles. In addition, the model-based trait estimates show the expected patterns of amplification and shrinkage after adjusting for midscale and extreme response style. The tutorial concludes with a discussion of recent developments in psychometric modeling.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 11","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13669044/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149178825","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Engagement begins at recruitment: Comparing videoconference verification to passive online screening for participant retention and study engagement. 参与从招聘开始：比较视频会议验证与被动在线筛选的参与者留存率和学习参与度。

IF 5 2区心理学

Behavior Research Methods Pub Date : 2026-10-14 DOI: 10.3758/s13428-026-03194-8

Andrea L Howard, Johanna Peetz

{"title":"Engagement begins at recruitment: Comparing videoconference verification to passive online screening for participant retention and study engagement.","authors":"Andrea L Howard, Johanna Peetz","doi":"10.3758/s13428-026-03194-8","DOIUrl":"https://doi.org/10.3758/s13428-026-03194-8","url":null,"abstract":"Researchers who conduct studies online increasingly struggle with fraudulent respondents, programmable bots, inattention or carelessness, and ineligible impostors. This study tested whether participants in a longitudinal intervention study who were recruited using videoconference eligibility verification-meeting participants one by one on Zoom to verify their identities-were more engaged in the study tasks and showed better longitudinal retention. Using existing data from a sample of Canadian young adult women (N = 1257), we compared participants who were screened via videoconference to participants who were passively screened (i.e., possessed valid e-mail addresses) and participants who were pre-screened members of a commercial participant platform (Prolific.com) on seven measures of retention and six measures of engagement with study tasks. Results showed that videoconference-verified participants had better rates of study initiation and retention, with over 90% completing all study waves. However, we found no meaningful differences between recruitment streams as a function of time to survey completion, engagement with the study's intervention activities, or honest responding. Videoconference eligibility verification may be a practical tool for recruiting participants likely to remain enrolled in longitudinal research and limit attrition.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 11","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149179091","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Real-time assessment of temperature sensitivity, pain processing, and pain behavior across the lifespan: Integrating stimulus data, contact force, and subjective ratings. 温度敏感性、疼痛处理和疼痛行为的实时评估：整合刺激数据、接触力和主观评分。

IF 5 2区心理学

Behavior Research Methods Pub Date : 2026-10-14 DOI: 10.3758/s13428-026-03192-w

Heinz-Jürgen Steinhoff, Besim Prenaj, Sebastian L Kübel, Annekatrin Steinhoff

{"title":"Real-time assessment of temperature sensitivity, pain processing, and pain behavior across the lifespan: Integrating stimulus data, contact force, and subjective ratings.","authors":"Heinz-Jürgen Steinhoff, Besim Prenaj, Sebastian L Kübel, Annekatrin Steinhoff","doi":"10.3758/s13428-026-03192-w","DOIUrl":"10.3758/s13428-026-03192-w","url":null,"abstract":"Assessments of temperature sensitivity and pain processing play an important role in psychological and psychiatry research, including with adolescent participants and across the lifespan. To ensure the validity and comparability of findings, experimental settings must be well tolerated and easily manageable for participants of all age groups and reliably monitored by the experimenter. These settings should promote reproducible procedures and support computer-assisted data acquisition and analysis to enable robust, efficient scientific evaluation. We present CAREST (Controlling and Recording Experiments in Sensitivity to Temperature), a PsychoPy-based tool for real-time assessment of temperature sensitivity, pain sensation, and pain response behavior via thermal induction. CAREST controls and communicates with a cold/hot plate and provides a touchscreen slider to assess pain sensation on a visual analog scale (VAS). The plate is placed on a platform with load cells to measure hand-plate contact force, providing an objective assessment of thermal contact between hand and plate surface during the experiment and participants' approach versus avoidance tendencies in response to pain. CAREST continuously and synchronously records timestamped values of plate surface temperature, participants' VAS ratings, and hand-plate contact force, enabling computation of several established and novel measures of pain sensitivity and related behavioral factors within a single experimental setting. In a pilot study with 94 participants, we examined heat and cold pain thresholds, intensities, tolerances, and hand-plate contact forces. The results highlight substantial heterogeneity in pain response behavior, with one out of five participants differing markedly from the modest average tendency toward pain avoidance.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"58 11","pages":""},"PeriodicalIF":5.0,"publicationDate":"2026-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13669072/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149179196","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0