Mansoor Nasir, Kalyani Sonawane, Nikhitha Bekkanti, Walter Talamonti
{"title":"透视汽车应用中的情感检测:两种情感人工智能 SDK 的性能评估","authors":"Mansoor Nasir, Kalyani Sonawane, Nikhitha Bekkanti, Walter Talamonti","doi":"10.1177/21695067231192630","DOIUrl":null,"url":null,"abstract":"The work presented herein quantifies the limitations of the technology provided by two prominent suppliers in Emotion AI. Each Software Development Kit (SDK) performance was measured for accuracy using image and video databases. The results indicate that while the SDKs show high accuracy in detecting positive emotions (e.g., Happy), the performance suffered for negative emotions (e.g., Angry) due to missed and false detections. The results were worse for structured video datasets and degraded further when subjects were in naturalistic settings. Although Emotion AI have improved greatly in recent years, the current versions are not reliable enough for automotive applications. The paper provides perspectives on the reasons for subpar performance and guidance for improvement for future emotion estimation software.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"217 1","pages":"2366 - 2371"},"PeriodicalIF":0.0000,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Perspective on Emotion Detection for Automotive Applications: Performance Evaluation of Two Emotion AI SDKs\",\"authors\":\"Mansoor Nasir, Kalyani Sonawane, Nikhitha Bekkanti, Walter Talamonti\",\"doi\":\"10.1177/21695067231192630\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The work presented herein quantifies the limitations of the technology provided by two prominent suppliers in Emotion AI. Each Software Development Kit (SDK) performance was measured for accuracy using image and video databases. The results indicate that while the SDKs show high accuracy in detecting positive emotions (e.g., Happy), the performance suffered for negative emotions (e.g., Angry) due to missed and false detections. The results were worse for structured video datasets and degraded further when subjects were in naturalistic settings. Although Emotion AI have improved greatly in recent years, the current versions are not reliable enough for automotive applications. The paper provides perspectives on the reasons for subpar performance and guidance for improvement for future emotion estimation software.\",\"PeriodicalId\":20673,\"journal\":{\"name\":\"Proceedings of the Human Factors and Ergonomics Society Annual Meeting\",\"volume\":\"217 1\",\"pages\":\"2366 - 2371\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the Human Factors and Ergonomics Society Annual Meeting\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1177/21695067231192630\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/21695067231192630","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Perspective on Emotion Detection for Automotive Applications: Performance Evaluation of Two Emotion AI SDKs
The work presented herein quantifies the limitations of the technology provided by two prominent suppliers in Emotion AI. Each Software Development Kit (SDK) performance was measured for accuracy using image and video databases. The results indicate that while the SDKs show high accuracy in detecting positive emotions (e.g., Happy), the performance suffered for negative emotions (e.g., Angry) due to missed and false detections. The results were worse for structured video datasets and degraded further when subjects were in naturalistic settings. Although Emotion AI have improved greatly in recent years, the current versions are not reliable enough for automotive applications. The paper provides perspectives on the reasons for subpar performance and guidance for improvement for future emotion estimation software.