EMOKINE:一个软件包和计算框架,用于扩大高度受控的情感全身运动数据集的创建规模。

IF 5.4 3区 材料科学 Q2 CHEMISTRY, PHYSICAL
ACS Applied Energy Materials Pub Date : 2024-10-01 Epub Date: 2024-06-25 DOI:10.3758/s13428-024-02433-0
Julia F Christensen, Andrés Fernández, Rebecca A Smith, Georgios Michalareas, Sina H N Yazdi, Fahima Farahi, Eva-Madeleine Schmidt, Nasimeh Bahmanian, Gemma Roig
{"title":"EMOKINE:一个软件包和计算框架,用于扩大高度受控的情感全身运动数据集的创建规模。","authors":"Julia F Christensen, Andrés Fernández, Rebecca A Smith, Georgios Michalareas, Sina H N Yazdi, Fahima Farahi, Eva-Madeleine Schmidt, Nasimeh Bahmanian, Gemma Roig","doi":"10.3758/s13428-024-02433-0","DOIUrl":null,"url":null,"abstract":"<p><p>EMOKINE is a software package and dataset creation suite for emotional full-body movement research in experimental psychology, affective neuroscience, and computer vision. A computational framework, comprehensive instructions, a pilot dataset, observer ratings, and kinematic feature extraction code are provided to facilitate future dataset creations at scale. In addition, the EMOKINE framework outlines how complex sequences of movements may advance emotion research. Traditionally, often emotional-'action'-based stimuli are used in such research, like hand-waving or walking motions. Here instead, a pilot dataset is provided with short dance choreographies, repeated several times by a dancer who expressed different emotional intentions at each repetition: anger, contentment, fear, joy, neutrality, and sadness. The dataset was simultaneously filmed professionally, and recorded using XSENS® motion capture technology (17 sensors, 240 frames/second). Thirty-two statistics from 12 kinematic features were extracted offline, for the first time in one single dataset: speed, acceleration, angular speed, angular acceleration, limb contraction, distance to center of mass, quantity of motion, dimensionless jerk (integral), head angle (with regards to vertical axis and to back), and space (convex hull 2D and 3D). Average, median absolute deviation (MAD), and maximum value were computed as applicable. The EMOKINE software is appliable to other motion-capture systems and is openly available on the Zenodo Repository. Releases on GitHub include: (i) the code to extract the 32 statistics, (ii) a rigging plugin for Python for MVNX file-conversion to Blender format (MVNX=output file XSENS® system), and (iii) a Python-script-powered custom software to assist with blurring faces; latter two under GPLv3 licenses.</p>","PeriodicalId":4,"journal":{"name":"ACS Applied Energy Materials","volume":null,"pages":null},"PeriodicalIF":5.4000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11525441/pdf/","citationCount":"0","resultStr":"{\"title\":\"EMOKINE: A software package and computational framework for scaling up the creation of highly controlled emotional full-body movement datasets.\",\"authors\":\"Julia F Christensen, Andrés Fernández, Rebecca A Smith, Georgios Michalareas, Sina H N Yazdi, Fahima Farahi, Eva-Madeleine Schmidt, Nasimeh Bahmanian, Gemma Roig\",\"doi\":\"10.3758/s13428-024-02433-0\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>EMOKINE is a software package and dataset creation suite for emotional full-body movement research in experimental psychology, affective neuroscience, and computer vision. A computational framework, comprehensive instructions, a pilot dataset, observer ratings, and kinematic feature extraction code are provided to facilitate future dataset creations at scale. In addition, the EMOKINE framework outlines how complex sequences of movements may advance emotion research. Traditionally, often emotional-'action'-based stimuli are used in such research, like hand-waving or walking motions. Here instead, a pilot dataset is provided with short dance choreographies, repeated several times by a dancer who expressed different emotional intentions at each repetition: anger, contentment, fear, joy, neutrality, and sadness. The dataset was simultaneously filmed professionally, and recorded using XSENS® motion capture technology (17 sensors, 240 frames/second). Thirty-two statistics from 12 kinematic features were extracted offline, for the first time in one single dataset: speed, acceleration, angular speed, angular acceleration, limb contraction, distance to center of mass, quantity of motion, dimensionless jerk (integral), head angle (with regards to vertical axis and to back), and space (convex hull 2D and 3D). Average, median absolute deviation (MAD), and maximum value were computed as applicable. The EMOKINE software is appliable to other motion-capture systems and is openly available on the Zenodo Repository. Releases on GitHub include: (i) the code to extract the 32 statistics, (ii) a rigging plugin for Python for MVNX file-conversion to Blender format (MVNX=output file XSENS® system), and (iii) a Python-script-powered custom software to assist with blurring faces; latter two under GPLv3 licenses.</p>\",\"PeriodicalId\":4,\"journal\":{\"name\":\"ACS Applied Energy Materials\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.4000,\"publicationDate\":\"2024-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11525441/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ACS Applied Energy Materials\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.3758/s13428-024-02433-0\",\"RegionNum\":3,\"RegionCategory\":\"材料科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/6/25 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"CHEMISTRY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Energy Materials","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.3758/s13428-024-02433-0","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/6/25 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"CHEMISTRY, PHYSICAL","Score":null,"Total":0}
引用次数: 0

摘要

EMOKINE 是一个软件包和数据集创建套件,用于实验心理学、情感神经科学和计算机视觉领域的情感全身运动研究。该软件提供了一个计算框架、全面的说明、一个试验数据集、观察者评分以及运动学特征提取代码,以方便今后大规模创建数据集。此外,EMOKINE 框架还概述了复杂的动作序列如何推动情绪研究。传统上,此类研究通常使用基于情感 "动作 "的刺激,如挥手或行走动作。在这里,我们提供了一个试验数据集,该数据集由一名舞者编排的简短舞蹈组成,舞者在每次重复时都会表达不同的情绪意图:愤怒、满足、恐惧、喜悦、中立和悲伤。数据集采用 XSENS® 动作捕捉技术(17 个传感器,240 帧/秒)同时进行专业拍摄和记录。首次在一个数据集中离线提取了 12 个运动学特征中的 32 个统计数据:速度、加速度、角速度、角加速度、肢体收缩、到质量中心的距离、运动量、无量纲挺举(积分)、头部角度(与垂直轴和背部的角度)和空间(凸壳二维和三维)。根据情况计算平均值、中位数绝对偏差(MAD)和最大值。EMOKINE 软件可用于其他运动捕捉系统,并可在 Zenodo 存储库中公开获取。GitHub 上发布的内容包括(i) 用于提取 32 项统计数据的代码,(ii) 用于将 MVNX 文件转换为 Blender 格式(MVNX=输出文件 XSENS® 系统)的 Python 装配插件,以及 (iii) 用于辅助模糊人脸的 Python 脚本驱动的定制软件;后两者均采用 GPLv3 许可。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

EMOKINE: A software package and computational framework for scaling up the creation of highly controlled emotional full-body movement datasets.

EMOKINE: A software package and computational framework for scaling up the creation of highly controlled emotional full-body movement datasets.

EMOKINE is a software package and dataset creation suite for emotional full-body movement research in experimental psychology, affective neuroscience, and computer vision. A computational framework, comprehensive instructions, a pilot dataset, observer ratings, and kinematic feature extraction code are provided to facilitate future dataset creations at scale. In addition, the EMOKINE framework outlines how complex sequences of movements may advance emotion research. Traditionally, often emotional-'action'-based stimuli are used in such research, like hand-waving or walking motions. Here instead, a pilot dataset is provided with short dance choreographies, repeated several times by a dancer who expressed different emotional intentions at each repetition: anger, contentment, fear, joy, neutrality, and sadness. The dataset was simultaneously filmed professionally, and recorded using XSENS® motion capture technology (17 sensors, 240 frames/second). Thirty-two statistics from 12 kinematic features were extracted offline, for the first time in one single dataset: speed, acceleration, angular speed, angular acceleration, limb contraction, distance to center of mass, quantity of motion, dimensionless jerk (integral), head angle (with regards to vertical axis and to back), and space (convex hull 2D and 3D). Average, median absolute deviation (MAD), and maximum value were computed as applicable. The EMOKINE software is appliable to other motion-capture systems and is openly available on the Zenodo Repository. Releases on GitHub include: (i) the code to extract the 32 statistics, (ii) a rigging plugin for Python for MVNX file-conversion to Blender format (MVNX=output file XSENS® system), and (iii) a Python-script-powered custom software to assist with blurring faces; latter two under GPLv3 licenses.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
ACS Applied Energy Materials
ACS Applied Energy Materials Materials Science-Materials Chemistry
CiteScore
10.30
自引率
6.20%
发文量
1368
期刊介绍: ACS Applied Energy Materials is an interdisciplinary journal publishing original research covering all aspects of materials, engineering, chemistry, physics and biology relevant to energy conversion and storage. The journal is devoted to reports of new and original experimental and theoretical research of an applied nature that integrate knowledge in the areas of materials, engineering, physics, bioscience, and chemistry into important energy applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信