Behavior Research Methods最新文献

Testing for group differences in multilevel vector autoregressive models.

IF 4.6 2区心理学

Behavior Research Methods Pub Date : 2025-02-20 DOI: 10.3758/s13428-024-02541-x

Jonas M B Haslbeck, Sacha Epskamp, Lourens J Waldorp

引用次数: 0

Jiwar: A database and calculator for word neighborhood measures in 40 languages.

IF 4.6 2区心理学

Behavior Research Methods Pub Date : 2025-02-19 DOI: 10.3758/s13428-025-02612-7

Alaa Alzahrani

{"title":"Jiwar: A database and calculator for word neighborhood measures in 40 languages.","authors":"Alaa Alzahrani","doi":"10.3758/s13428-025-02612-7","DOIUrl":"10.3758/s13428-025-02612-7","url":null,"abstract":"The majority of neighborhood calculators are restricted to one language. The limited availability of multilingual neighborhood calculators could pose challenges for conducting psycholinguistic research on low-resource languages. Therefore, this study introduced Jiwar, a database and calculator for neighborhood information across three levels (orthographic, phonological, and phonographic) across 40 languages. The database contains information for 24 linguistic and neighborhood measures, while the Python-based calculator allows users to compute more than 46 neighborhood measures for words and nonwords. This study further examined the Jiwar calculator's instrument reliability and validity. Correlations with previous datasets across several languages suggested the strong reliability of two key Jiwar measures. Multiple-linear regression models revealed that a subset of Jiwar measures significantly predicted behavioral results in lexical decision and visual naming tasks, indicating the validity of the Jiwar calculator. Jiwar is an open-source, Python-based tool that is designed to expand to more languages and functions.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 3","pages":"98"},"PeriodicalIF":4.6,"publicationDate":"2025-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11839700/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143456748","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Distribution-free Bayesian analyses with the DFBA statistical package.

IF 4.6 2区心理学

Behavior Research Methods Pub Date : 2025-02-19 DOI: 10.3758/s13428-025-02605-6

Richard A Chechile, Daniel H Barch

{"title":"Distribution-free Bayesian analyses with the DFBA statistical package.","authors":"Richard A Chechile, Daniel H Barch","doi":"10.3758/s13428-025-02605-6","DOIUrl":"10.3758/s13428-025-02605-6","url":null,"abstract":"Nonparametric (or distribution-free) statistics have been widely used in psychological research because behavioral data can be messy and inconsistent with the Gaussian model for measurement error. Distribution-free procedures only use categorical or rank information, so they avoid the problems of outliers and violations of distributional assumptions. Yet frequentist nonparametric procedures are still subject to the limitation of relative frequency theory, which stems from the founding assumption that population parameters cannot be represented by probability distributions. Bayesian statistical methods, by contrast, allow for prior and posterior probability distributions for population parameters, so they rigorously provide experimental scientists with a probability representation of the population parameters of interest. The Bayesian counterpart for a set of distribution-free statistical methods is a relatively recent development. This paper is a detailed discussion of the DFBA package of R functions, which is designed for doing distribution-free Bayesian analyses for the common nonparametric procedures. Included in the package are functions that enable the user to explore the relative power for computer-based data that can be sampled from nine different probability models. The distribution-free procedures have almost the same power as the t test when the data are normally distributed, but for eight other alternative probability models, the distribution-free Bayesian procedures have greater power than the frequentist t.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 3","pages":"99"},"PeriodicalIF":4.6,"publicationDate":"2025-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11839880/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143456745","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Survey measures of metacognitive monitoring are often false.

IF 4.6 2区心理学

Behavior Research Methods Pub Date : 2025-02-18 DOI: 10.3758/s13428-025-02621-6

Kit S Double

{"title":"Survey measures of metacognitive monitoring are often false.","authors":"Kit S Double","doi":"10.3758/s13428-025-02621-6","DOIUrl":"10.3758/s13428-025-02621-6","url":null,"abstract":"Metacognitive monitoring is an extremely important ability that predicts a wide range of outcomes. However, do people have insight into their own metacognitive monitoring capacity? This study measured participants' perceived metacognitive monitoring abilities using a novel psychometrically validated questionnaire (Study 1) and then examined how well survey responses aligned with online measures of metacognitive monitoring (resolution, discrimination, sensitivity, efficiency) taken from confidence ratings participants made while performing a perceptual decision-making task and Raven's Progressive Matrices (Study 2). We found a negative correlation between the questionnaire responses and many of the online measures of metacognitive monitoring - those who reported being better at metacognitive monitoring, in fact tended to be worse according to the online metacognitive ratings. This occurred because, in general, high self-perceptions of monitoring ability were, in fact, related to higher confidence and lower cognitive performance. These findings suggest that we may have inaccurate insights into our own metacognitive monitoring capacity and questionnaire-based measures of metacognitive abilities may be problematic as they may represent unrealistic self-perceptions.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 3","pages":"97"},"PeriodicalIF":4.6,"publicationDate":"2025-02-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11836092/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143447830","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Open-access network science: Investigating phonological similarity networks based on the SUBTLEX-US lexicon.

IF 4.6 2区心理学

Behavior Research Methods Pub Date : 2025-02-18 DOI: 10.3758/s13428-025-02610-9

John Alderete, Sarbjot Mann, Paul Tupper

{"title":"Open-access network science: Investigating phonological similarity networks based on the SUBTLEX-US lexicon.","authors":"John Alderete, Sarbjot Mann, Paul Tupper","doi":"10.3758/s13428-025-02610-9","DOIUrl":"10.3758/s13428-025-02610-9","url":null,"abstract":"Network science tools are becoming increasingly important to psycholinguistics, but few open-access data sets exist for exploring network properties of even well-studied languages like English. We constructed several phonological similarity networks (neighbors differ in exactly one consonant or vowel phoneme) using words from a lexicon based on the SUBTLEX-US English corpus, distinguishing networks by size and word representation (i.e., lemma vs. word form). The resulting networks are shown to exhibit many familiar characteristics, including small-world properties, broad degree distributions, and robustness to node removal, regardless of network size and word representation. We also validated the SUBTLEX phonological networks by showing that they exhibit contrasts in degree and clustering coefficient comparable to the same contrasts found in prior studies and exhibit familiar trends after extraction of a backbone network of nodes important to network centrality. The data release ( https://github.com/aldo-git-bit/phonological-similarity-networks-SUBTLEX ) includes 17 adjacency lists that can be further explored using the networkX package in Python, a package of files for building new adjacency lists from scratch, and several scripts that allow users to analyze and extend these results.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 3","pages":"96"},"PeriodicalIF":4.6,"publicationDate":"2025-02-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11836074/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143447828","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

PREVIC: An adaptive parent report measure of expressive vocabulary in children between 3 and 8 years of age.

IF 4.6 2区心理学

Behavior Research Methods Pub Date : 2025-02-17 DOI: 10.3758/s13428-025-02615-4

Manuel Bohn, Julia Prein, Jonas Engicht, Daniel Haun, Natalia Gagarina, Tobias Koch

{"title":"PREVIC: An adaptive parent report measure of expressive vocabulary in children between 3 and 8 years of age.","authors":"Manuel Bohn, Julia Prein, Jonas Engicht, Daniel Haun, Natalia Gagarina, Tobias Koch","doi":"10.3758/s13428-025-02615-4","DOIUrl":"10.3758/s13428-025-02615-4","url":null,"abstract":"Parent report measures have proven to be a valuable research tool for studying early language development. Caregivers are given a list of words and are asked which of them their child has already used. However, most available measures are not suited for children beyond infancy, come with substantial licensing costs or lack a clear psychometric foundation. Here, we present the PREVIC (Parent Report of Expressive Vocabulary in Children), an open-access, high-quality vocabulary checklist for German-speaking children between 3 and 8 years of age. The PREVIC was constructed leveraging the advantages of item response theory: we designed a large initial item pool of 379 words and collected data from 1190 caregivers of children between 3 and 8 years of age. Based on these data, we computed a range of fit indices for each item (word) and used an automated item selection algorithm to compile a final pool that contains items that (a) vary in difficulty and (b) fit the Rasch (one-parameter logistic) model. The resulting task is highly reliable and shows convergent validity. The IRT-based construction allowed us to design an adaptive version of the task that substantially reduces the task duration while retaining measurement precision. The task - including the adaptive version - was implemented as a website and is freely accessible online ( https://ccp-odc.eva.mpg.de/previc-demo/ ). The PREVIC fills an important gap in the toolkit of researchers interested in language development and provides an ideal starting point for developing converging measures in other languages.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 3","pages":"95"},"PeriodicalIF":4.6,"publicationDate":"2025-02-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11832670/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143439808","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Development and evaluation of Dona, a privacy-preserving donation platform for messaging data from WhatsApp, Facebook, and Instagram.

IF 4.6 2区心理学

Behavior Research Methods Pub Date : 2025-02-14 DOI: 10.3758/s13428-024-02593-z

Olya Hakobyan, Paul-Julius Hillmann, Florian Martin, Erwin Böttinger, Hanna Drimalla

{"title":"Development and evaluation of Dona, a privacy-preserving donation platform for messaging data from WhatsApp, Facebook, and Instagram.","authors":"Olya Hakobyan, Paul-Julius Hillmann, Florian Martin, Erwin Böttinger, Hanna Drimalla","doi":"10.3758/s13428-024-02593-z","DOIUrl":"10.3758/s13428-024-02593-z","url":null,"abstract":"Social interactions are a fundamental aspect of human life, yet, their objective and naturalistic measurement remains challenging for scientific research. This challenge can be addressed using digital communication data. To this end, we have developed Dona, an open-source platform for donating messaging data from WhatsApp, Facebook, and Instagram. Given the highly sensitive nature of messaging data, we ensure participant privacy through rigorous data minimization. Dona removes all sensitive information on the user side prior to donation, retaining only de-identified meta-data such as message length and timestamps. This paper presents an overview of the platform, a deployment guide, and example use cases. In addition, we evaluate the informativeness of minimized messaging data for studying social interactions with two approaches. First, we conducted a user study in which 85 participants donated their data, received visualizations of their messaging behavior and evaluated the informativeness of this visual feedback. Second, we performed a quantitative analysis using over 1500 donated chats to confirm whether minimized messaging data captures known aspects of human interactions, such as interaction balance, heterogeneity, and burstiness. The results demonstrate that minimized, de-identified messaging data reflects informative interaction features as assessed by both self-reports and objective metrics. In conclusion, Dona is a donation platform well suited for sensitive contexts in which researchers aim to balance participant privacy with the acquisition of objective and informative data on social interactions.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 3","pages":"94"},"PeriodicalIF":4.6,"publicationDate":"2025-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11828832/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143413295","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Reliability representativeness: How well does coefficient alpha summarize reliability across the score distribution?

IF 4.6 2区心理学

Behavior Research Methods Pub Date : 2025-02-10 DOI: 10.3758/s13428-025-02611-8

Daniel McNeish, Denis Dumas

{"title":"Reliability representativeness: How well does coefficient alpha summarize reliability across the score distribution?","authors":"Daniel McNeish, Denis Dumas","doi":"10.3758/s13428-025-02611-8","DOIUrl":"https://doi.org/10.3758/s13428-025-02611-8","url":null,"abstract":"Scale scores in psychology studies are commonly accompanied by a reliability coefficient like alpha. Coefficient alpha is an index that summarizes reliability across the entire score distribution, implying equal precision for all scores. However, an underappreciated fact is that reliability can be conditional such that scores in certain parts of the score distribution may be more reliable than others. This conditional perspective of reliability is common in item response theory (IRT), but psychologists are generally not well versed in IRT. Correspondingly, the representativeness of a single summary index like alpha across the entire score distribution can be unclear but is rarely considered. If conditional reliability is fairly homogeneous across the score distribution, coefficient alpha may be sufficiently representative and a useful summary. But, if conditional reliability is heterogeneous across the score distribution, alpha may be unrepresentative and may not align with the reliability of a typical score in the data or with a particularly important score like a cut point where decisions are made. This paper proposes a method, R package, and Shiny application to quantify the potential differences between coefficient alpha and conditional reliability across the score distribution. The goal is to facilitate comparisons between conditional reliability and reliability summary indices so that psychologists can contextualize the reliability of their scores more clearly and comprehensively.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 3","pages":"93"},"PeriodicalIF":4.6,"publicationDate":"2025-02-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143389901","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Correction: A large-scale database of Mandarin Chinese word associations from the Small World of Words Project.

IF 4.6 2区心理学

Behavior Research Methods Pub Date : 2025-02-07 DOI: 10.3758/s13428-025-02603-8

Bing Li, Ziyi Ding, Simon De Deyne, Qing Cai

引用次数: 0

To interact or not to interact: The pros and cons of including interactions in linear regression models.

IF 4.6 2区心理学

Behavior Research Methods Pub Date : 2025-02-07 DOI: 10.3758/s13428-025-02613-6

Aljoscha Rimpler, Henk A L Kiers, Don van Ravenzwaaij

{"title":"To interact or not to interact: The pros and cons of including interactions in linear regression models.","authors":"Aljoscha Rimpler, Henk A L Kiers, Don van Ravenzwaaij","doi":"10.3758/s13428-025-02613-6","DOIUrl":"10.3758/s13428-025-02613-6","url":null,"abstract":"Interaction effects are very common in the psychological literature. However, interaction effects are typically very small and often fail to replicate. In this study, we conducted a simulation comparing the generalizability and estimability of two linear regression models: one correctly specified to account for interaction effects and one misspecified including simple effects only. We manipulated noise levels, predictor variable correlations, and different sets of regression weights, resulting in 9216 different conditions. From each dataset, we drew 1000 samples of N = 25, 50, 100, 250, 500, and 1000, resulting in a total of 55,296,000 analyses for each model. Our results show that misspecification can drastically bias regression estimates, sometimes leading to zero or reversed simple effects. Furthermore, we found that when models are generalized to the entire population, the difference between the explained variance in the sample and in the population is often smaller for the misspecified model than for the correctly specified model. However, the comparison between models shows that the correctly specified model explains the data at the population level better overall. These results emphasize the importance of theory in modeling choices and show that it is important to provide a rationale for why interactions are included or excluded in an analysis.","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 3","pages":"92"},"PeriodicalIF":4.6,"publicationDate":"2025-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11805792/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143370354","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0