Bashar Alshouha, J. Serrano-Guerrero, D. Elizondo, Francisco P. Romero, J. A. Olivas
{"title":"消费者对医疗服务的态度如何?从消费者反馈中检测情感的迁移学习方法","authors":"Bashar Alshouha, J. Serrano-Guerrero, D. Elizondo, Francisco P. Romero, J. A. Olivas","doi":"10.3897/jucs.104093","DOIUrl":null,"url":null,"abstract":"The capability of offering patient-centered healthcare services involves knowing the consumer needs. Many of these needs can be conveyed through opinions about services that can be found on social networks. The consumers/patients can express their complains, satisfaction, frustration, etc. in terms of feelings and emotions toward those services; for that reason, it is pivotal to accurately detect them. There are many recent techniques to detect sentiments or emotions, but one of the most promising is transfer learning. This allows adapting a model originally trained for a task to a different one by fine-tuning. Following this idea, the primary objective of this research is to study whether several pre-trained language models can be adapted to a task such as patient emotion detection in an efficient manner. For this purpose, seven clinical and biomedical pre-trained models and four domain-general models have been adapted to detect multiple emotions. These models have been tuned using a dataset consisting of real patient opinions which convey several emotions per opinion. The experiments carried out state the domain-specific pre-trained models outperform the domain-general ones. Particularly, Clinical-Longformer obtained the best scores, 98.18% and 95.82% in terms of accuracy and F1-score, respectively. Analyzing the patient feedback available on social networks may provide valuable knowledge about consumer sentiments and emotions, especially for healthcare managers. This information can be very interesting for purposes such as assessing the quality of healthcare services or designing patient-centered services.","PeriodicalId":124602,"journal":{"name":"JUCS - Journal of Universal Computer Science","volume":"2 12","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-01-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"What is the Consumer Attitude toward Healthcare Services? A Transfer Learning Approach for Detecting Emotions from Consumer Feedback\",\"authors\":\"Bashar Alshouha, J. Serrano-Guerrero, D. Elizondo, Francisco P. Romero, J. A. Olivas\",\"doi\":\"10.3897/jucs.104093\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The capability of offering patient-centered healthcare services involves knowing the consumer needs. Many of these needs can be conveyed through opinions about services that can be found on social networks. The consumers/patients can express their complains, satisfaction, frustration, etc. in terms of feelings and emotions toward those services; for that reason, it is pivotal to accurately detect them. There are many recent techniques to detect sentiments or emotions, but one of the most promising is transfer learning. This allows adapting a model originally trained for a task to a different one by fine-tuning. Following this idea, the primary objective of this research is to study whether several pre-trained language models can be adapted to a task such as patient emotion detection in an efficient manner. For this purpose, seven clinical and biomedical pre-trained models and four domain-general models have been adapted to detect multiple emotions. These models have been tuned using a dataset consisting of real patient opinions which convey several emotions per opinion. The experiments carried out state the domain-specific pre-trained models outperform the domain-general ones. Particularly, Clinical-Longformer obtained the best scores, 98.18% and 95.82% in terms of accuracy and F1-score, respectively. Analyzing the patient feedback available on social networks may provide valuable knowledge about consumer sentiments and emotions, especially for healthcare managers. This information can be very interesting for purposes such as assessing the quality of healthcare services or designing patient-centered services.\",\"PeriodicalId\":124602,\"journal\":{\"name\":\"JUCS - Journal of Universal Computer Science\",\"volume\":\"2 12\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-01-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"JUCS - Journal of Universal Computer Science\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3897/jucs.104093\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"JUCS - Journal of Universal Computer Science","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3897/jucs.104093","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
要提供以患者为中心的医疗保健服务,就必须了解消费者的需求。其中许多需求可以通过社交网络上有关服务的意见来传达。消费者/患者可以通过对这些服务的感受和情绪来表达他们的抱怨、满意度、挫败感等,因此,准确检测这些感受和情绪至关重要。最近有很多检测情感或情绪的技术,但其中最有前途的是迁移学习。它可以通过微调将原本为某项任务训练的模型调整到不同的任务中。根据这一想法,本研究的主要目标是研究是否能以有效的方式将几个预先训练好的语言模型调整到病人情绪检测等任务中。为此,我们调整了七个临床和生物医学预训练模型和四个通用领域模型,以检测多种情绪。这些模型已通过一个由真实患者意见组成的数据集进行了调整,每个意见都表达了多种情绪。实验结果表明,特定领域的预训练模型优于一般领域的模型。其中,Clinical-Longformer 获得了最好的成绩,准确率和 F1 分数分别为 98.18% 和 95.82%。分析患者在社交网络上的反馈可以提供有关消费者情绪和情感的宝贵知识,尤其是对医疗保健管理者而言。这些信息对于评估医疗服务质量或设计以患者为中心的服务等目的都非常有意义。
What is the Consumer Attitude toward Healthcare Services? A Transfer Learning Approach for Detecting Emotions from Consumer Feedback
The capability of offering patient-centered healthcare services involves knowing the consumer needs. Many of these needs can be conveyed through opinions about services that can be found on social networks. The consumers/patients can express their complains, satisfaction, frustration, etc. in terms of feelings and emotions toward those services; for that reason, it is pivotal to accurately detect them. There are many recent techniques to detect sentiments or emotions, but one of the most promising is transfer learning. This allows adapting a model originally trained for a task to a different one by fine-tuning. Following this idea, the primary objective of this research is to study whether several pre-trained language models can be adapted to a task such as patient emotion detection in an efficient manner. For this purpose, seven clinical and biomedical pre-trained models and four domain-general models have been adapted to detect multiple emotions. These models have been tuned using a dataset consisting of real patient opinions which convey several emotions per opinion. The experiments carried out state the domain-specific pre-trained models outperform the domain-general ones. Particularly, Clinical-Longformer obtained the best scores, 98.18% and 95.82% in terms of accuracy and F1-score, respectively. Analyzing the patient feedback available on social networks may provide valuable knowledge about consumer sentiments and emotions, especially for healthcare managers. This information can be very interesting for purposes such as assessing the quality of healthcare services or designing patient-centered services.