Mohamad Roshanzamir, Mahboobeh Jafari, Roohallah Alizadehsani, Mahdi Roshanzamir, Afshin Shoeibi, Juan M. Gorriz, Abbas Khosravi, Saeid Nahavandi, U. Rajendra Acharya
{"title":"面部表情时面部发生了什么?使用数据挖掘技术分析面部表情运动矢量","authors":"Mohamad Roshanzamir, Mahboobeh Jafari, Roohallah Alizadehsani, Mahdi Roshanzamir, Afshin Shoeibi, Juan M. Gorriz, Abbas Khosravi, Saeid Nahavandi, U. Rajendra Acharya","doi":"10.1007/s10796-023-10466-7","DOIUrl":null,"url":null,"abstract":"<p>Automatic facial expression recognition is a big challenge in human–computer interaction. Analyzing the changes in the face during a facial expression can be used for this purpose. In this paper, these changes are extracted as a number of motion vectors. These motion vectors are extracted using an optical flow algorithm. Then, they are used to analyze facial expressions by some of the data mining algorithms. This analysis has not only determined what changes occur in the face during facial expression but has also been used to recognize facial expressions. Cohen-Kanade facial expression dataset was used in this research. Based on our findings, the vertical lengths of motion vectors created in the lower part of the face have the greatest impact on the classification of facial expressions. Among the investigated classification algorithms, deep learning, support vector machine, and C5.0 had better performance, yielding an accuracy of 95.3%, 92.8%, and 90.2% respectively.</p>","PeriodicalId":13610,"journal":{"name":"Information Systems Frontiers","volume":"20 1","pages":""},"PeriodicalIF":6.9000,"publicationDate":"2024-01-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"What Happens in Face During a Facial Expression? Using Data Mining Techniques to Analyze Facial Expression Motion Vectors\",\"authors\":\"Mohamad Roshanzamir, Mahboobeh Jafari, Roohallah Alizadehsani, Mahdi Roshanzamir, Afshin Shoeibi, Juan M. Gorriz, Abbas Khosravi, Saeid Nahavandi, U. Rajendra Acharya\",\"doi\":\"10.1007/s10796-023-10466-7\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Automatic facial expression recognition is a big challenge in human–computer interaction. Analyzing the changes in the face during a facial expression can be used for this purpose. In this paper, these changes are extracted as a number of motion vectors. These motion vectors are extracted using an optical flow algorithm. Then, they are used to analyze facial expressions by some of the data mining algorithms. This analysis has not only determined what changes occur in the face during facial expression but has also been used to recognize facial expressions. Cohen-Kanade facial expression dataset was used in this research. Based on our findings, the vertical lengths of motion vectors created in the lower part of the face have the greatest impact on the classification of facial expressions. Among the investigated classification algorithms, deep learning, support vector machine, and C5.0 had better performance, yielding an accuracy of 95.3%, 92.8%, and 90.2% respectively.</p>\",\"PeriodicalId\":13610,\"journal\":{\"name\":\"Information Systems Frontiers\",\"volume\":\"20 1\",\"pages\":\"\"},\"PeriodicalIF\":6.9000,\"publicationDate\":\"2024-01-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Information Systems Frontiers\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1007/s10796-023-10466-7\",\"RegionNum\":3,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Systems Frontiers","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s10796-023-10466-7","RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
What Happens in Face During a Facial Expression? Using Data Mining Techniques to Analyze Facial Expression Motion Vectors
Automatic facial expression recognition is a big challenge in human–computer interaction. Analyzing the changes in the face during a facial expression can be used for this purpose. In this paper, these changes are extracted as a number of motion vectors. These motion vectors are extracted using an optical flow algorithm. Then, they are used to analyze facial expressions by some of the data mining algorithms. This analysis has not only determined what changes occur in the face during facial expression but has also been used to recognize facial expressions. Cohen-Kanade facial expression dataset was used in this research. Based on our findings, the vertical lengths of motion vectors created in the lower part of the face have the greatest impact on the classification of facial expressions. Among the investigated classification algorithms, deep learning, support vector machine, and C5.0 had better performance, yielding an accuracy of 95.3%, 92.8%, and 90.2% respectively.
期刊介绍:
The interdisciplinary interfaces of Information Systems (IS) are fast emerging as defining areas of research and development in IS. These developments are largely due to the transformation of Information Technology (IT) towards networked worlds and its effects on global communications and economies. While these developments are shaping the way information is used in all forms of human enterprise, they are also setting the tone and pace of information systems of the future. The major advances in IT such as client/server systems, the Internet and the desktop/multimedia computing revolution, for example, have led to numerous important vistas of research and development with considerable practical impact and academic significance. While the industry seeks to develop high performance IS/IT solutions to a variety of contemporary information support needs, academia looks to extend the reach of IS technology into new application domains. Information Systems Frontiers (ISF) aims to provide a common forum of dissemination of frontline industrial developments of substantial academic value and pioneering academic research of significant practical impact.