{"title":"The wisdom of the crowd with partial rankings: A Bayesian approach implementing the Thurstone model in JAGS.","authors":"Lauren E Montgomery, Nora Bradford, Michael D Lee","doi":"10.3758/s13428-024-02479-0","DOIUrl":"10.3758/s13428-024-02479-0","url":null,"abstract":"<p><p>We develop a Bayesian method for aggregating partial ranking data using the Thurstone model. Our implementation is a JAGS graphical model that allows each individual to rank any subset of items, and provides an inference about the latent true ranking of the items and the relative expertise of each individual. We demonstrate the method by analyzing data from new experiments that collected partial ranking data. In one experiment, participants were assigned subsets of items to rank; in the other experiment, participants could choose how many and which items they ranked. We show that our method works effectively for both sorts of partial ranking in applications to US city populations and the chronology of US presidents. We discuss the potential of the method for studying the wisdom of the crowd and other research problems that require aggregating incomplete or partial rankings.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141854612","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Julia F Christensen, Andrés Fernández, Rebecca A Smith, Georgios Michalareas, Sina H N Yazdi, Fahima Farahi, Eva-Madeleine Schmidt, Nasimeh Bahmanian, Gemma Roig
{"title":"EMOKINE: A software package and computational framework for scaling up the creation of highly controlled emotional full-body movement datasets.","authors":"Julia F Christensen, Andrés Fernández, Rebecca A Smith, Georgios Michalareas, Sina H N Yazdi, Fahima Farahi, Eva-Madeleine Schmidt, Nasimeh Bahmanian, Gemma Roig","doi":"10.3758/s13428-024-02433-0","DOIUrl":"10.3758/s13428-024-02433-0","url":null,"abstract":"<p><p>EMOKINE is a software package and dataset creation suite for emotional full-body movement research in experimental psychology, affective neuroscience, and computer vision. A computational framework, comprehensive instructions, a pilot dataset, observer ratings, and kinematic feature extraction code are provided to facilitate future dataset creations at scale. In addition, the EMOKINE framework outlines how complex sequences of movements may advance emotion research. Traditionally, often emotional-'action'-based stimuli are used in such research, like hand-waving or walking motions. Here instead, a pilot dataset is provided with short dance choreographies, repeated several times by a dancer who expressed different emotional intentions at each repetition: anger, contentment, fear, joy, neutrality, and sadness. The dataset was simultaneously filmed professionally, and recorded using XSENS® motion capture technology (17 sensors, 240 frames/second). Thirty-two statistics from 12 kinematic features were extracted offline, for the first time in one single dataset: speed, acceleration, angular speed, angular acceleration, limb contraction, distance to center of mass, quantity of motion, dimensionless jerk (integral), head angle (with regards to vertical axis and to back), and space (convex hull 2D and 3D). Average, median absolute deviation (MAD), and maximum value were computed as applicable. The EMOKINE software is appliable to other motion-capture systems and is openly available on the Zenodo Repository. Releases on GitHub include: (i) the code to extract the 32 statistics, (ii) a rigging plugin for Python for MVNX file-conversion to Blender format (MVNX=output file XSENS® system), and (iii) a Python-script-powered custom software to assist with blurring faces; latter two under GPLv3 licenses.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11525441/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141449505","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Marília Prada, David Guedes, Margarida Vaz Garrido, Magda Saraiva
{"title":"Normative ratings for the Kitchen and Food Sounds (KFS) database.","authors":"Marília Prada, David Guedes, Margarida Vaz Garrido, Magda Saraiva","doi":"10.3758/s13428-024-02402-7","DOIUrl":"10.3758/s13428-024-02402-7","url":null,"abstract":"<p><p>Sounds are important sensory cues for food perception and acceptance. We developed and validated a large-scale database of kitchen and food sounds (180 stimuli) capturing different stages of preparing, cooking, serving, and/or consuming foods and beverages and sounds of packaging, kitchen utensils, and appliances. Each sound was evaluated across nine subjective evaluative dimensions (random order), including stimuli-related properties (e.g., valence, arousal) and food-related items (e.g., healthfulness, appetizingness) by a subsample of 51 to 64 participants (Mdn = 54; N = 332; 69.6% women, M<sub>age</sub> = 27.46 years, SD = 10.20). Participants also identified each sound and rated how confident they were in such identification. Results show that, overall, participants could correctly identify the sound or at least recognize the general sound categories. The stimuli of the KFS database varied across different levels (low, moderate, high) of the evaluative dimensions under analysis, indicating good adequacy to a broad range of research purposes. The correlation analysis showed a high degree of association between evaluative dimensions. The sociodemographic characteristics of the sample had a limited influence on the stimuli evaluation. Still, some aspects related to food and cooking were associated with how the sounds are evaluated, suggesting that participants' proficiency in the kitchen should be considered when planning studies with food sounds. Given its broad range of stimulus categories and evaluative dimensions, the KFS database (freely available at OSF ) is suitable for different research domains, from fundamental (e.g., cognitive psychology, basic sensory science) to more applied research (e.g., marketing, consumer science).</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11362198/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140317702","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J M Rutkowska, T Ghilardi, S V Vacaru, J E van Schaik, M Meyer, S Hunnius, R Oostenveld
{"title":"Optimal processing of surface facial EMG to identify emotional expressions: A data-driven approach.","authors":"J M Rutkowska, T Ghilardi, S V Vacaru, J E van Schaik, M Meyer, S Hunnius, R Oostenveld","doi":"10.3758/s13428-024-02421-4","DOIUrl":"10.3758/s13428-024-02421-4","url":null,"abstract":"<p><p>Surface facial electromyography (EMG) is commonly used to detect emotions from subtle facial expressions. Although there are established procedures for collecting EMG data and some aspects of their processing, there is little agreement among researchers about the optimal way to process the EMG signal, so that the study-unrelated variability (noise) is removed, and the emotion-related variability is best detected. The aim of the current paper was to establish an optimal processing pipeline for EMG data for identifying emotional expressions in facial muscles. We identified the most common processing steps from existing literature and created 72 processing pipelines that represented all the different processing choices. We applied these pipelines to a previously published dataset from a facial mimicry experiment, where 100 adult participants observed happy and sad facial expressions, whilst the activity of their facial muscles, zygomaticus major and corrugator supercilii, was recorded with EMG. We used a resampling approach and subsets of the original data to investigate the effect and robustness of different processing choices on the performance of a logistic regression model that predicted the mimicked emotion (happy/sad) from the EMG signal. In addition, we used a random forest model to identify the most important processing steps for the sensitivity of the logistic regression model. Three processing steps were found to be most impactful: baseline correction, standardisation within muscles, and standardisation within subjects. The chosen feature of interest and the signal averaging had little influence on the sensitivity to the effect. We recommend an optimal processing pipeline, share our code and data, and provide a step-by-step walkthrough for researchers.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11362446/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141074521","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Casey Becker, Russell Conduit, Philippe A Chouinard, Robin Laycock
{"title":"Can deepfakes be used to study emotion perception? A comparison of dynamic face stimuli.","authors":"Casey Becker, Russell Conduit, Philippe A Chouinard, Robin Laycock","doi":"10.3758/s13428-024-02443-y","DOIUrl":"10.3758/s13428-024-02443-y","url":null,"abstract":"<p><p>Video recordings accurately capture facial expression movements; however, they are difficult for face perception researchers to standardise and manipulate. For this reason, dynamic morphs of photographs are often used, despite their lack of naturalistic facial motion. This study aimed to investigate how humans perceive emotions from faces using real videos and two different approaches to artificially generating dynamic expressions - dynamic morphs, and AI-synthesised deepfakes. Our participants perceived dynamic morphed expressions as less intense when compared with videos (all emotions) and deepfakes (fearful, happy, sad). Videos and deepfakes were perceived similarly. Additionally, they perceived morphed happiness and sadness, but not morphed anger or fear, as less genuine than other formats. Our findings support previous research indicating that social responses to morphed emotions are not representative of those to video recordings. The findings also suggest that deepfakes may offer a more suitable standardized stimulus type compared to morphs. Additionally, qualitative data were collected from participants and analysed using ChatGPT, a large language model. ChatGPT successfully identified themes in the data consistent with those identified by an independent human researcher. According to this analysis, our participants perceived dynamic morphs as less natural compared with videos and deepfakes. That participants perceived deepfakes and videos similarly suggests that deepfakes effectively replicate natural facial movements, making them a promising alternative for face perception research. The study contributes to the growing body of research exploring the usefulness of generative artificial intelligence for advancing the study of human perception.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11362322/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141247131","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Best practices for your confirmatory factor analysis: A JASP and lavaan tutorial.","authors":"Pablo Rogers","doi":"10.3758/s13428-024-02375-7","DOIUrl":"10.3758/s13428-024-02375-7","url":null,"abstract":"<p><p>Confirmatory factor analysis (CFA) is a fundamental method for evaluating the internal structural validity of measurement instruments. In most CFA applications, the measurement model serves as a means to an end rather than an end in itself. To select the appropriate model, prior validity evidence is crucial, and items are typically assessed on an ordinal scale, which has been used in the applied social sciences. However, textbooks on structural equation modeling (SEM) often overlook this specific case, focusing on applications estimable using maximum likelihood (ML) instead. Unfortunately, several popular commercial SEM software packages lack suitable solutions for handling this 'typical CFA', leading to confusion and suboptimal decision-making when conducting CFA in this context. This article conceptually contributes to this ongoing discussion by presenting a set of guidelines for conducting a typical CFA, drawing from recent empirical research. We provide a practical contribution by introducing and developing a tutorial example within the JASP and lavaan software platforms. Supplementary materials such as videos, files, and scripts are freely available.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140118638","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Massimo Grassi, Andrea Felline, Niccolò Orlandi, Mattia Toffanin, Gnana Prakash Goli, Hurcan Andrei Senyuva, Mauro Migliardi, Giulio Contemori
{"title":"PSYCHOACOUSTICS-WEB: A free online tool for the estimation of auditory thresholds.","authors":"Massimo Grassi, Andrea Felline, Niccolò Orlandi, Mattia Toffanin, Gnana Prakash Goli, Hurcan Andrei Senyuva, Mauro Migliardi, Giulio Contemori","doi":"10.3758/s13428-024-02430-3","DOIUrl":"10.3758/s13428-024-02430-3","url":null,"abstract":"<p><p>PSYCHOACOUSTICS-WEB is an online tool written in JavaScript and PHP that enables the estimation of auditory sensory thresholds via adaptive threshold tracking. The toolbox implements the transformed up-down methods proposed by Levitt (Journal of the Acoustical Society of America, 49, 467-477, (1971) for a set of classic psychoacoustical tasks: frequency, intensity, and duration discrimination of pure tones; duration discrimination and gap detection of noise; and amplitude modulation detection with noise carriers. The toolbox can be used through a common web browser; it works with both fixed and mobile devices, and requires no programming skills. PSYCHOACOUSTICS-WEB is suitable for laboratory, classroom, and online testing and is designed for two main types of users: an occasional user and, above all, an experimenter using the toolbox for their own research. This latter user can create a personal account, customise existing experiments, and share them in the form of direct links to further users (e.g., the participants of a hypothetical experiment). Finally, because data storage is centralised, the toolbox offers the potential for creating a database of auditory skills.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11362506/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140848885","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Exploration of the MCMC Wald test with linear regression.","authors":"Michael P Woller, Craig K Enders","doi":"10.3758/s13428-024-02426-z","DOIUrl":"10.3758/s13428-024-02426-z","url":null,"abstract":"<p><p>Recently, Asparouhov and Muthén Structural Equation Modeling: A Multidisciplinary Journal, 28, 1-14, (2021a, 2021b) proposed a variant of the Wald test that uses Markov chain Monte Carlo machinery to generate a chi-square test statistic for frequentist inference. Because the test's composition does not rely on analytic expressions for sampling variation and covariation, it potentially provides a way to get honest significance tests in cases where the likelihood-based test statistic's assumptions break down (e.g., in small samples). The goal of this study is to use simulation to compare the new MCM Wald test to its maximum likelihood counterparts, with respect to both their type I error rate and power. Our simulation examined the test statistics across different levels of sample size, effect size, and degrees of freedom (test complexity). An additional goal was to assess the robustness of the MCMC Wald test with nonnormal data. The simulation results uniformly demonstrated that the MCMC Wald test was superior to the maximum likelihood test statistic, especially with small samples (e.g., sample sizes less than 150) and complex models (e.g., models with five or more predictors). This conclusion held for nonnormal data as well. Lastly, we provide a brief application to a real data example.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141417596","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Camille Pluchot, Hans Adriaensen, Céline Parias, Didier Dubreuil, Cécile Arnould, Elodie Chaillou, Scott A Love
{"title":"Sheep (Ovis aries) training protocol for voluntary awake and unrestrained structural brain MRI acquisitions.","authors":"Camille Pluchot, Hans Adriaensen, Céline Parias, Didier Dubreuil, Cécile Arnould, Elodie Chaillou, Scott A Love","doi":"10.3758/s13428-024-02449-6","DOIUrl":"10.3758/s13428-024-02449-6","url":null,"abstract":"<p><p>Magnetic resonance imaging (MRI) is a non-invasive technique that requires the participant to be completely motionless. To date, MRI in awake and unrestrained animals has only been achieved with humans and dogs. For other species, alternative techniques such as anesthesia, restraint and/or sedation have been necessary. Anatomical and functional MRI studies with sheep have only been conducted under general anesthesia. This ensures the absence of movement and allows relatively long MRI experiments but it removes the non-invasive nature of the MRI technique (i.e., IV injections, intubation). Anesthesia can also be detrimental to health, disrupt neurovascular coupling, and does not permit the study of higher-level cognition. Here, we present a proof-of-concept that sheep can be trained to perform a series of tasks, enabling them to voluntarily participate in MRI sessions without anesthesia or restraint. We describe a step-by-step training protocol based on positive reinforcement (food and praise) that could be used as a basis for future neuroimaging research in sheep. This protocol details the two successive phases required for sheep to successfully achieve MRI acquisitions of their brain. By providing structural brain MRI images from six out of ten sheep, we demonstrate the feasibility of our training protocol. This innovative training protocol paves the way for the possibility of conducting animal welfare-friendly functional MRI studies with sheep to investigate ovine cognition.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11362526/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141436570","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Improving the DSM-5 approach to cognitive impairment: Developmental prosopagnosia reveals the need for tailored diagnoses.","authors":"Edwin J Burns","doi":"10.3758/s13428-024-02459-4","DOIUrl":"10.3758/s13428-024-02459-4","url":null,"abstract":"<p><p>The Diagnostic Statistical Manual of Mental Disorders (DSM-5) recommends diagnosing neurocognitive disorders (i.e., cognitive impairment) when a patient scores beyond - 1 SD below neurotypical norms on two tests. I review how this approach will fail due to cognitive tests' power limitations, validity issues, imperfect reliabilities, and biases, before summarizing their resulting negative consequences. As a proof of concept, I use developmental prosopagnosia, a condition characterized by difficulties recognizing faces, to show the DSM-5 only diagnoses 62-70% (n1 = 61, n2 = 165) versus 100% (n1 = 61) through symptoms alone. Pooling the DSM-5 missed cases confirmed the presence of group-level impairments on objective tests, which were further evidenced through meta-analyses, thus validating their highly atypical symptoms. These findings support a paradigm shift towards bespoke diagnostic approaches for distinct cognitive impairments, including a symptom-based method when validated effective. I reject dogmatic adherence to the DSM-5 approach to neurocognitive disorders, and underscore the importance of a data driven, transdiagnostic approach to understanding patients' subjective cognitive impairments. This will ultimately benefit patients, their families, clinicians, and scientific progress.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11362378/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141557940","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}