Affective sciencePub Date : 2023-08-08DOI: 10.1007/s42761-023-00191-4
Jin Hyun Cheong, Eshin Jolly, Tiankang Xie, Sophie Byrne, Matthew Kenney, Luke J. Chang
{"title":"Py-Feat: Python Facial Expression Analysis Toolbox","authors":"Jin Hyun Cheong, Eshin Jolly, Tiankang Xie, Sophie Byrne, Matthew Kenney, Luke J. Chang","doi":"10.1007/s42761-023-00191-4","DOIUrl":"10.1007/s42761-023-00191-4","url":null,"abstract":"<div><p>Studying facial expressions is a notoriously difficult endeavor. Recent advances in the field of affective computing have yielded impressive progress in automatically detecting facial expressions from pictures and videos. However, much of this work has yet to be widely disseminated in social science domains such as psychology. Current state-of-the-art models require considerable domain expertise that is not traditionally incorporated into social science training programs. Furthermore, there is a notable absence of user-friendly and open-source software that provides a comprehensive set of tools and functions that support facial expression research. In this paper, we introduce Py-Feat, an open-source Python toolbox that provides support for detecting, preprocessing, analyzing, and visualizing facial expression data. Py-Feat makes it easy for domain experts to disseminate and benchmark computer vision models and also for end users to quickly process, analyze, and visualize face expression data. We hope this platform will facilitate increased use of facial expression data in human behavior research.\u0000</p></div>","PeriodicalId":72119,"journal":{"name":"Affective science","volume":"4 4","pages":"781 - 796"},"PeriodicalIF":2.1,"publicationDate":"2023-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10751270/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90913016","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Affective sciencePub Date : 2023-08-07DOI: 10.1007/s42761-023-00202-4
Maia L. Rocklin, Anna Angelina Garròn Torres, Byron Reeves, Thomas N. Robinson, Nilam Ram
{"title":"The Affective Dynamics of Everyday Digital Life: Opening Computational Possibility","authors":"Maia L. Rocklin, Anna Angelina Garròn Torres, Byron Reeves, Thomas N. Robinson, Nilam Ram","doi":"10.1007/s42761-023-00202-4","DOIUrl":"10.1007/s42761-023-00202-4","url":null,"abstract":"<div><p>Up to now, there was no way to observe and track the affective impacts of the massive amount of complex visual stimuli that people encounter “in the wild” during their many hours of digital life. In this paper, we propose and illustrate how recent advances in AI—trained ensembles of deep neural networks—can be deployed on new data streams that are long sequences of screenshots of study participants’ smartphones obtained unobtrusively during everyday life. We obtained affective valence and arousal ratings of hundreds of images drawn from existing picture repositories often used in psychological studies, and a new screenshot repository chronicling individuals’ everyday digital life from both <i>N</i> = 832 adults and an affect computation model (Parry & Vuong, 2021). Results and analysis suggest that (a) our sample rates images similarly to other samples used in psychological studies, (b) the affect computation model is able to assign valence and arousal ratings similarly to humans, and (c) the resulting computational pipeline can be deployed at scale to obtain detailed maps of the affective space individuals travel through on their smartphones. Leveraging innovative methods for tracking the emotional content individuals encounter on their smartphones, we open the possibility for large-scale studies of how the affective dynamics of everyday digital life shape individuals’ moment-to-moment experiences and well-being.</p></div>","PeriodicalId":72119,"journal":{"name":"Affective science","volume":"4 3","pages":"529 - 540"},"PeriodicalIF":0.0,"publicationDate":"2023-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s42761-023-00202-4.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41156793","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Affective sciencePub Date : 2023-08-07DOI: 10.1007/s42761-023-00200-6
Christine D. Wilson-Mendenhall, Kevin J. Holmes
{"title":"Lab Meets World: the Case for Use-Inspired Basic Research in Affective Science","authors":"Christine D. Wilson-Mendenhall, Kevin J. Holmes","doi":"10.1007/s42761-023-00200-6","DOIUrl":"10.1007/s42761-023-00200-6","url":null,"abstract":"<div><p>We join others in envisioning a future for affective science that addresses society’s most pressing needs. To move toward this vision, we consider a research paradigm that emerged in other disciplines: use-inspired basic research. This paradigm transcends the traditional basic-applied dichotomy, which pits the basic goal of fundamental scientific <i>understanding</i> against the applied goal of <i>use</i> in solving social problems. In reality, these goals are complementary, and use-inspired basic research advances them simultaneously. Here, we build a case for use-inspired basic research—how it differs from traditional basic science and why affective scientists should engage in it. We first examine how use-inspired basic research challenges problematic assumptions of a strict basic-applied dichotomy. We then discuss how it is consistent with advances in affective science that recognize context specificity as the norm and consider ethical issues of use being a complementary goal. Following this theoretical discussion, we differentiate the implementation of use-inspired basic research from that of traditional basic science. We draw on examples from recent research to illustrate differences: social problems as a starting point, stakeholder and community engagement, and integration of research and service. In conclusion, we invite affective scientists to embrace the “lab meets world” perspective of use-inspired basic research as a promising pathway to real-world impact.</p></div>","PeriodicalId":72119,"journal":{"name":"Affective science","volume":"4 3","pages":"591 - 599"},"PeriodicalIF":0.0,"publicationDate":"2023-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s42761-023-00200-6.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41167622","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Affective sciencePub Date : 2023-08-04DOI: 10.1007/s42761-023-00198-x
Christian Keysers, Valeria Gazzola
{"title":"Vicarious Emotions of Fear and Pain in Rodents","authors":"Christian Keysers, Valeria Gazzola","doi":"10.1007/s42761-023-00198-x","DOIUrl":"10.1007/s42761-023-00198-x","url":null,"abstract":"<div><p>Affective empathy, the ability to share the emotions of others, is an important contributor to the richness of our emotional experiences. Here, we review evidence that rodents show signs of fear and pain when they witness the fear and pain of others. This emotional contagion creates a vicarious emotion in the witness that mirrors some level of detail of the emotion of the demonstrator, including its valence and the vicinity of threats, and depends on brain regions such as the cingulate, amygdala, and insula that are also at the core of human empathy. Although it remains impossible to directly know how witnessing the distress of others <i>feels</i> for rodents, and whether this feeling is similar to the empathy humans experience, the similarity in neural structures suggests some analogies in emotional experience across rodents and humans. These neural homologies also reveal that feeling distress while others are distressed must serve an evolutionary purpose strong enough to warrant its stability across ~ 100 millions of years. We propose that it does so by allowing observers to set in motion the very emotions that have evolved to prepare them to deal with threats — with the benefit of triggering them <i>socially</i>, by harnessing conspecifics as sentinels, before the witness <i>personally</i> faces that threat. Finally, we discuss evidence that rodents can engage in prosocial behaviors that may be motivated by vicarious distress or reward.</p></div>","PeriodicalId":72119,"journal":{"name":"Affective science","volume":"4 4","pages":"662 - 671"},"PeriodicalIF":2.1,"publicationDate":"2023-08-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s42761-023-00198-x.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129725456","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Affective sciencePub Date : 2023-08-02DOI: 10.1007/s42761-023-00204-2
Pilleriin Sikka, James J. Gross
{"title":"Affect Across the Wake-Sleep Cycle","authors":"Pilleriin Sikka, James J. Gross","doi":"10.1007/s42761-023-00204-2","DOIUrl":"10.1007/s42761-023-00204-2","url":null,"abstract":"<div><p>Affective scientists traditionally have focused on periods of active wakefulness when people are responding to external stimuli or engaging in specific tasks. However, we live much of our lives immersed in experiences not related to the current environment or tasks at hand—mind-wandering (or daydreaming) during wakefulness and dreaming during sleep. Despite being disconnected from the immediate environment, our brains still generate affect during such periods. Yet, research on stimulus-independent affect has remained largely separate from affective science. Here, we suggest that one key future direction for affective science will be to expand our field of view by integrating the wealth of findings from research on mind-wandering, sleep, and dreaming to provide a more comprehensive account of affect across the wake-sleep cycle. In developing our argument, we address two key issues: affect variation across the wake-sleep cycle, and the benefits of expanding the study of affect across the full wake-sleep cycle. In considering these issues, we highlight the methodological and clinical implications for affective science.</p></div>","PeriodicalId":72119,"journal":{"name":"Affective science","volume":"4 3","pages":"563 - 569"},"PeriodicalIF":0.0,"publicationDate":"2023-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s42761-023-00204-2.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41162755","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Affective sciencePub Date : 2023-08-02DOI: 10.1007/s42761-023-00199-w
Erik C. Nook
{"title":"The Promise of Affective Language for Identifying and Intervening on Psychopathology","authors":"Erik C. Nook","doi":"10.1007/s42761-023-00199-w","DOIUrl":"10.1007/s42761-023-00199-w","url":null,"abstract":"<div><p>We are in dire need of innovative tools for reducing the global burden of psychopathology. Emerging evidence suggests that analyzing language (i.e., the words people use) can grant insight into an individual's emotional experiences, their ability to regulate their emotions, and even their current experiences of psychopathology. As such, linguistic analyses of people’s everyday word use may be a diagnostic marker of emotional well-being, and manipulating the words people use could foster adaptive emotion regulation and mental health. Given the ubiquity of language in everyday life, such language-based tools for measuring and intervening in emotion and mental health can advance how we identify and treat mental illnesses at a large scale. In this paper, I outline the promise of this approach and identify key problems we must solve if we are to make it a reality. In particular, I summarize evidence connecting language, emotion, and mental health for three key constructs: sentiment (i.e., the valence of one’s language), linguistic distancing (i.e., using language to separate oneself from distressing stimuli), and emotion differentiation (i.e., using words to specifically identify one’s emotions). I also identify open questions in need of attention for each of these constructs and this area of research as a whole. Overall, I believe the future is bright for the application of psycholinguistic approaches to mental health detection and intervention.</p></div>","PeriodicalId":72119,"journal":{"name":"Affective science","volume":"4 3","pages":"517 - 521"},"PeriodicalIF":0.0,"publicationDate":"2023-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s42761-023-00199-w.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41167623","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Affective sciencePub Date : 2023-07-11DOI: 10.1007/s42761-023-00196-z
Roberta L. Irvin, Dongjie Wu, Adam K. Fetterman, Michael D. Robinson
{"title":"Heads of Worry, Hearts of Joy: Daily Diary Investigations of Self-Location and Well-Being","authors":"Roberta L. Irvin, Dongjie Wu, Adam K. Fetterman, Michael D. Robinson","doi":"10.1007/s42761-023-00196-z","DOIUrl":"10.1007/s42761-023-00196-z","url":null,"abstract":"<p>\u0000When people are asked to locate the self, they frequently choose the head and heart regions of the body. These bodily regions, in turn, are linked to an extensive set of metaphors, including those that conceptualize the heart as the locus of authenticity, love, and passion. Based on such considerations as well as frameworks within the self and well-being literatures, four samples of participants in three studies (total <i>N</i> = 527) were asked whether, on particular days, they perceived themselves to be located in their head regions of their bodies or their heart regions. When the self was perceived to be in the heart to a greater extent, participants reported higher levels of affective and eudaimonic well-being, as mediated by processes related to reward perception (Study 1), savoring (Study 2), and social activity (Study 3). In terms of daily experiences, the heart-located self is a happier self.</p>","PeriodicalId":72119,"journal":{"name":"Affective science","volume":"4 4","pages":"744 - 756"},"PeriodicalIF":2.1,"publicationDate":"2023-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130370715","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Affective sciencePub Date : 2023-07-10DOI: 10.1007/s42761-023-00190-5
Erika B. Langley, Daniel J. O’Leary, James J. Gross, Michelle N. Shiota
{"title":"Breaking the Link Between Negative Emotion and Unhealthy Eating: the Role of Emotion Regulation","authors":"Erika B. Langley, Daniel J. O’Leary, James J. Gross, Michelle N. Shiota","doi":"10.1007/s42761-023-00190-5","DOIUrl":"10.1007/s42761-023-00190-5","url":null,"abstract":"<div><p>Stressful experiences frequently lead to increased consumption of unhealthy foods, high in sugar and fat yet low in nutrients. Can emotion regulation help break this link? In a laboratory experiment (<i>N</i> = 200), participants were encouraged to ruminate on a current, distressing personal problem, followed by instruction to use a specific emotion regulation strategy for managing feelings around that problem (challenge appraisal, relaxation/distraction, imagined social support, no-instruction control). Participants then spent 15 min on an anagram task in which 80% of items were unsolvable—a frustrating situation offering a second, implicit opportunity to use the regulation strategy. During the anagram task they had free access to a snack basket containing various options. Analyses revealed significant differences among regulation conditions in consumption of candy versus healthy snack options; challenge appraisal led to the healthiest snack choices, imagined social support to the least healthy snack choices.\u0000</p></div>","PeriodicalId":72119,"journal":{"name":"Affective science","volume":"4 4","pages":"702 - 710"},"PeriodicalIF":2.1,"publicationDate":"2023-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126660342","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Affective sciencePub Date : 2023-07-10DOI: 10.1007/s42761-023-00195-0
Marie P. Cross, Amanda M. Acevedo, John F. Hunter
{"title":"A Critique of Automated Approaches to Code Facial Expressions: What Do Researchers Need to Know?","authors":"Marie P. Cross, Amanda M. Acevedo, John F. Hunter","doi":"10.1007/s42761-023-00195-0","DOIUrl":"10.1007/s42761-023-00195-0","url":null,"abstract":"<div><p>Facial expression recognition software is becoming more commonly used by affective scientists to measure facial expressions. Although the use of this software has exciting implications, there are persistent and concerning issues regarding the validity and reliability of these programs. In this paper, we highlight three of these issues: biases of the programs against certain skin colors and genders; the common inability of these programs to capture facial expressions made in non-idealized conditions (e.g., “in the wild”); and programs being forced to adopt the underlying assumptions of the specific theory of emotion on which each software is based. We then discuss three directions for the future of affective science in the area of automated facial coding. First, researchers need to be cognizant of exactly how and on which data sets the machine learning algorithms underlying these programs are being trained. In addition, there are several ethical considerations, such as privacy and data storage, surrounding the use of facial expression recognition programs. Finally, researchers should consider collecting additional emotion data, such as body language, and combine these data with facial expression data in order to achieve a more comprehensive picture of complex human emotions. Facial expression recognition programs are an excellent method of collecting facial expression data, but affective scientists should ensure that they recognize the limitations and ethical implications of these programs.</p></div>","PeriodicalId":72119,"journal":{"name":"Affective science","volume":"4 3","pages":"500 - 505"},"PeriodicalIF":0.0,"publicationDate":"2023-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s42761-023-00195-0.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41155752","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Affective sciencePub Date : 2023-07-10DOI: 10.1007/s42761-023-00197-y
Yi Yang Teoh, William A. Cunningham, Cendri A. Hutcherson
{"title":"Framing Subjective Emotion Reports as Dynamic Affective Decisions","authors":"Yi Yang Teoh, William A. Cunningham, Cendri A. Hutcherson","doi":"10.1007/s42761-023-00197-y","DOIUrl":"10.1007/s42761-023-00197-y","url":null,"abstract":"<div><p>Self-reports remain affective science’s only direct measure of subjective affective experiences. Yet, little research has sought to understand the psychological process that transforms subjective experience into self-reports. Here, we propose that by framing these self-reports as dynamic affective decisions, affective scientists may leverage the computational tools of decision-making research, sequential sampling models specifically, to better disentangle affective experience from the noisy decision processes that constitute self-report. We further outline how such an approach could help affective scientists better probe the specific mechanisms that underlie important moderators of affective experience (e.g., contextual differences, individual differences, and emotion regulation) and discuss how adopting this decision-making framework could generate insight into affective processes more broadly and facilitate reciprocal collaborations between affective and decision scientists towards a more comprehensive and integrative psychological science.</p></div>","PeriodicalId":72119,"journal":{"name":"Affective science","volume":"4 3","pages":"522 - 528"},"PeriodicalIF":0.0,"publicationDate":"2023-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s42761-023-00197-y.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41158961","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}