Know Your Game, From in-Real Life Experts to Video Game Experts: Discriminating in-Real Life Experts From Non Experts Using Blinks and EAR-Derived Features

IF 2.8 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Gianluca Guglielmo;Michal Klincewicz;Elisabeth Huis in‘t Veld;Pieter Spronck
{"title":"Know Your Game, From in-Real Life Experts to Video Game Experts: Discriminating in-Real Life Experts From Non Experts Using Blinks and EAR-Derived Features","authors":"Gianluca Guglielmo;Michal Klincewicz;Elisabeth Huis in‘t Veld;Pieter Spronck","doi":"10.1109/TG.2024.3494724","DOIUrl":null,"url":null,"abstract":"Serious games are an effective method of reproducing aspects of the complex interplay between environments and stakeholders in business situations. In the game, we describe here, <italic>The Sustainable Port</i>, players experience what it is like to make decisions in such a complex environment. Their aim in the game is to grow the Port of Rotterdam while keeping economic growth in balance with sustainability goals. In this study, we assessed whether experienced Port of Rotterdam employees (PoR employees) show different psychophysiological patterns, and more specifically eye aspect ratio (EAR)-derived features, compared to students. We did this on the assumption that physiological patterns will tell us something about how people who are familiar with the environment of the Port of Rotterdam, more specifically PoR employees, make decisions compared to those lacking such familiarity. Our sample consisted of 28 PoR employees and 65 students, all of whom played <italic>The Sustainable Port</i> game and had their faces recorded with a camera. The EAR was extracted from these recordings, and then from those, we extracted EAR-derived features. Our results show that PoR employees perform better than students and that the two groups are characterized by different physiological variations in their EAR-derived features. A logistic regression model used to identify PoR employees and students obtained an F1 score of 0.62, an area under the precision–recall curve score of 0.64, and an ROC AUC score of 0.70. Such a performance significantly above baseline suggests the effectiveness of using EAR-derived features for this task. Our interpretation was further confirmed by a pseudo-R2 score used to evaluate the goodness of fit of a logistic regression model on the entire dataset. We found that PoR employees had a lower variation in blink rate per minute and higher variation in the root mean square of the successive differences in blinks (RMSSD), the consecutive difference between two continuous blinks. Moreover, this study shows that our methods were robust enough to negate the effects of confounders, such as biological sex and age, that affect some other studies that analyze blinks.","PeriodicalId":55977,"journal":{"name":"IEEE Transactions on Games","volume":"17 2","pages":"474-484"},"PeriodicalIF":2.8000,"publicationDate":"2024-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Games","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10758866/","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Serious games are an effective method of reproducing aspects of the complex interplay between environments and stakeholders in business situations. In the game, we describe here, The Sustainable Port, players experience what it is like to make decisions in such a complex environment. Their aim in the game is to grow the Port of Rotterdam while keeping economic growth in balance with sustainability goals. In this study, we assessed whether experienced Port of Rotterdam employees (PoR employees) show different psychophysiological patterns, and more specifically eye aspect ratio (EAR)-derived features, compared to students. We did this on the assumption that physiological patterns will tell us something about how people who are familiar with the environment of the Port of Rotterdam, more specifically PoR employees, make decisions compared to those lacking such familiarity. Our sample consisted of 28 PoR employees and 65 students, all of whom played The Sustainable Port game and had their faces recorded with a camera. The EAR was extracted from these recordings, and then from those, we extracted EAR-derived features. Our results show that PoR employees perform better than students and that the two groups are characterized by different physiological variations in their EAR-derived features. A logistic regression model used to identify PoR employees and students obtained an F1 score of 0.62, an area under the precision–recall curve score of 0.64, and an ROC AUC score of 0.70. Such a performance significantly above baseline suggests the effectiveness of using EAR-derived features for this task. Our interpretation was further confirmed by a pseudo-R2 score used to evaluate the goodness of fit of a logistic regression model on the entire dataset. We found that PoR employees had a lower variation in blink rate per minute and higher variation in the root mean square of the successive differences in blinks (RMSSD), the consecutive difference between two continuous blinks. Moreover, this study shows that our methods were robust enough to negate the effects of confounders, such as biological sex and age, that affect some other studies that analyze blinks.
了解你的游戏,从现实生活专家到电子游戏专家:使用眨眼和ear衍生功能区分现实生活专家和非专家
严肃游戏是再现商业环境和利益相关者之间复杂相互作用的有效方法。在这款名为《the Sustainable Port》的游戏中,玩家将体验到在如此复杂的环境中做出决定的感觉。他们在游戏中的目标是发展鹿特丹港,同时保持经济增长与可持续发展目标的平衡。在这项研究中,我们评估了经验丰富的鹿特丹港员工(PoR员工)与学生相比是否表现出不同的心理生理模式,更具体地说,是眼宽高比(EAR)衍生的特征。我们这样做的假设是,生理模式会告诉我们,与那些不熟悉鹿特丹港环境的人相比,熟悉鹿特丹港环境的人,更具体地说是PoR员工,是如何做出决定的。我们的样本包括28名PoR员工和65名学生,他们都玩了可持续港口游戏,并用相机记录了他们的脸。从这些录音中提取EAR,然后从中提取EAR衍生的特征。我们的研究结果表明,PoR员工的表现优于学生,这两组人在ear衍生特征上存在不同的生理变化。用于识别PoR员工和学生的logistic回归模型的F1得分为0.62,precision-recall曲线下面积得分为0.64,ROC AUC得分为0.70。这种明显高于基线的性能表明,在此任务中使用ear派生的特性是有效的。我们的解释进一步得到了伪r2评分的证实,该评分用于评估整个数据集上逻辑回归模型的拟合优度。我们发现,PoR员工的每分钟眨眼频率变化较小,而连续眨眼差异(RMSSD)的均方根变化较大,即两次连续眨眼之间的连续差异。此外,这项研究表明,我们的方法足够强大,可以消除混杂因素的影响,比如生物性别和年龄,这些混杂因素会影响其他一些分析眨眼的研究。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Games
IEEE Transactions on Games Engineering-Electrical and Electronic Engineering
CiteScore
4.60
自引率
8.70%
发文量
87
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信