{"title":"越南语联合跨度检测与面向情感分析的鲁棒层次模型","authors":"An Pha Le, T. Pham, T. Le, Duy V. Huynh, D. Ngo","doi":"10.1109/NICS56915.2022.10013463","DOIUrl":null,"url":null,"abstract":"Recent successes of large pre-trained language models highlighted deep neural networks' potential in solving complicated natural language processing tasks, but some remain unsolved, especially for non-English languages. Two of them are span detection and aspect-based sentiment analysis. The former is a general sequence tagging, and the latter is a hierarchical classification task. Both are challenging in various ways, most notably due to the lack of available resources and effective methods for training. To overcome these drawbacks, this paper introduces a fashionable and robust hierarchical model that learns both tasks simultaneously using a multi-task learning framework for Vietnamese datasets. Our model is trained using a tunable custom task-dependent loss and easily adapted to a wide range of similar tasks. Experimental results showed that our approach is superior to the existing baseline systems and achieved state-of-the-art results. We also make the source code publicly available as a starter kit for further investigation and research11https://github.com/datnnt1997/ViSA.","PeriodicalId":381028,"journal":{"name":"2022 9th NAFOSTED Conference on Information and Computer Science (NICS)","volume":"45 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Robust hierarchical model for joint span detection and aspect-based sentiment analysis in Vietnamese\",\"authors\":\"An Pha Le, T. Pham, T. Le, Duy V. Huynh, D. Ngo\",\"doi\":\"10.1109/NICS56915.2022.10013463\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Recent successes of large pre-trained language models highlighted deep neural networks' potential in solving complicated natural language processing tasks, but some remain unsolved, especially for non-English languages. Two of them are span detection and aspect-based sentiment analysis. The former is a general sequence tagging, and the latter is a hierarchical classification task. Both are challenging in various ways, most notably due to the lack of available resources and effective methods for training. To overcome these drawbacks, this paper introduces a fashionable and robust hierarchical model that learns both tasks simultaneously using a multi-task learning framework for Vietnamese datasets. Our model is trained using a tunable custom task-dependent loss and easily adapted to a wide range of similar tasks. Experimental results showed that our approach is superior to the existing baseline systems and achieved state-of-the-art results. We also make the source code publicly available as a starter kit for further investigation and research11https://github.com/datnnt1997/ViSA.\",\"PeriodicalId\":381028,\"journal\":{\"name\":\"2022 9th NAFOSTED Conference on Information and Computer Science (NICS)\",\"volume\":\"45 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 9th NAFOSTED Conference on Information and Computer Science (NICS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/NICS56915.2022.10013463\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 9th NAFOSTED Conference on Information and Computer Science (NICS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NICS56915.2022.10013463","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Robust hierarchical model for joint span detection and aspect-based sentiment analysis in Vietnamese
Recent successes of large pre-trained language models highlighted deep neural networks' potential in solving complicated natural language processing tasks, but some remain unsolved, especially for non-English languages. Two of them are span detection and aspect-based sentiment analysis. The former is a general sequence tagging, and the latter is a hierarchical classification task. Both are challenging in various ways, most notably due to the lack of available resources and effective methods for training. To overcome these drawbacks, this paper introduces a fashionable and robust hierarchical model that learns both tasks simultaneously using a multi-task learning framework for Vietnamese datasets. Our model is trained using a tunable custom task-dependent loss and easily adapted to a wide range of similar tasks. Experimental results showed that our approach is superior to the existing baseline systems and achieved state-of-the-art results. We also make the source code publicly available as a starter kit for further investigation and research11https://github.com/datnnt1997/ViSA.