Projna Paromita, Alaa Khader, Sydney Begerowski, S. Bell, Theodora Chaspari
{"title":"模拟太空探索任务中团队成员之间微行为的语言和声音标记","authors":"Projna Paromita, Alaa Khader, Sydney Begerowski, S. Bell, Theodora Chaspari","doi":"10.1109/MPRV.2022.3232780","DOIUrl":null,"url":null,"abstract":"We used machine learning classifiers and dialog state tracking models, combined with natural language processing techniques relying on lexicon-based methods and data-driven methods, to automatically detect positive and negative microbehaviors between team members in nine, four-person teams in a simulated space habitat. Our findings indicate that the psycholinguistic markers extracted using the linguistic inquiry and word count, STRESSnet dictionaries, and acoustic features can achieve an f1-score up to 54.87% in a three-class classification problem. Our findings also suggest that modeling turns between the sender and target of microbehaviors is significantly more effective in detecting microbehavior than only modeling the sender’s information. Finally, we demonstrate the effect of introducing context for detection purposes. Dialog state tracking approaches that model the linguistic interaction between team members and incorporate contextual information about the task and sentiment of the conversation can further yield improved performance, depicting an f1-score of 57.73%.","PeriodicalId":55021,"journal":{"name":"IEEE Pervasive Computing","volume":"22 1","pages":"7-18"},"PeriodicalIF":1.6000,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Linguistic and Vocal Markers of Microbehaviors Between Team Members During Analog Space Exploration Missions\",\"authors\":\"Projna Paromita, Alaa Khader, Sydney Begerowski, S. Bell, Theodora Chaspari\",\"doi\":\"10.1109/MPRV.2022.3232780\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We used machine learning classifiers and dialog state tracking models, combined with natural language processing techniques relying on lexicon-based methods and data-driven methods, to automatically detect positive and negative microbehaviors between team members in nine, four-person teams in a simulated space habitat. Our findings indicate that the psycholinguistic markers extracted using the linguistic inquiry and word count, STRESSnet dictionaries, and acoustic features can achieve an f1-score up to 54.87% in a three-class classification problem. Our findings also suggest that modeling turns between the sender and target of microbehaviors is significantly more effective in detecting microbehavior than only modeling the sender’s information. Finally, we demonstrate the effect of introducing context for detection purposes. Dialog state tracking approaches that model the linguistic interaction between team members and incorporate contextual information about the task and sentiment of the conversation can further yield improved performance, depicting an f1-score of 57.73%.\",\"PeriodicalId\":55021,\"journal\":{\"name\":\"IEEE Pervasive Computing\",\"volume\":\"22 1\",\"pages\":\"7-18\"},\"PeriodicalIF\":1.6000,\"publicationDate\":\"2023-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Pervasive Computing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1109/MPRV.2022.3232780\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Pervasive Computing","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1109/MPRV.2022.3232780","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
Linguistic and Vocal Markers of Microbehaviors Between Team Members During Analog Space Exploration Missions
We used machine learning classifiers and dialog state tracking models, combined with natural language processing techniques relying on lexicon-based methods and data-driven methods, to automatically detect positive and negative microbehaviors between team members in nine, four-person teams in a simulated space habitat. Our findings indicate that the psycholinguistic markers extracted using the linguistic inquiry and word count, STRESSnet dictionaries, and acoustic features can achieve an f1-score up to 54.87% in a three-class classification problem. Our findings also suggest that modeling turns between the sender and target of microbehaviors is significantly more effective in detecting microbehavior than only modeling the sender’s information. Finally, we demonstrate the effect of introducing context for detection purposes. Dialog state tracking approaches that model the linguistic interaction between team members and incorporate contextual information about the task and sentiment of the conversation can further yield improved performance, depicting an f1-score of 57.73%.
期刊介绍:
IEEE Pervasive Computing explores the role of computing in the physical world–as characterized by visions such as the Internet of Things and Ubiquitous Computing. Designed for researchers, practitioners, and educators, this publication acts as a catalyst for realizing the ideas described by Mark Weiser in 1988. The essence of this vision is the creation of environments saturated with sensing, computing, and wireless communication that gracefully support the needs of individuals and society. Many key building blocks for this vision are now viable commercial technologies: wearable and handheld computers, wireless networking, location sensing, Internet of Things platforms, and so on. However, the vision continues to present deep challenges for experts in areas such as hardware design, sensor networks, mobile systems, human-computer interaction, industrial design, machine learning, data science, and societal issues including privacy and ethics. Through special issues, the magazine explores applications in areas such as assisted living, automotive systems, cognitive assistance, hardware innovations, ICT4D, manufacturing, retail, smart cities, and sustainability. In addition, the magazine accepts peer-reviewed papers of wide interest under a general call, and also features regular columns on hot topics and interviews with luminaries in the field.