{"title":"Advanced Subword Segmentation and Interdependent Regularization Mechanisms for Korean Language Understanding","authors":"Mansu Kim, Yunkon Kim, Yeonsoo Lim, E. Huh","doi":"10.1109/WorldS4.2019.8903977","DOIUrl":"https://doi.org/10.1109/WorldS4.2019.8903977","url":null,"abstract":"State-of-the-art neural language models highly rely on fixed-size subword vocabulary based pre-training process to improve the performance of language understanding. Existing subword segmentation algorithms have been researched to generate fixed-size vocabulary by frequency in large text pool without considering the linguistic structures. Also, most of research is focused on widely-used languages such as English and Chinese. However, for Korean, a segmentation algorithm considering the linguistic structure is required, and we thus propose the algorithm considering the characteristics of Korean. For example, Korean words include the special type of suffix called “Josa” that adds grammatical meaning. We also propose subword regularization algorithm based on mutual information, which is interdependence between words. The regularization algorithm customizes the size of vocabulary on demand. In addition, we present an experiment analysis of subword segmentation and interdependent regularization by testing neural language model. It can achieve better performance by small changes of vocabulary.","PeriodicalId":389892,"journal":{"name":"2019 Third World Conference on Smart Trends in Systems Security and Sustainablity (WorldS4)","volume":"164 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127423681","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Twitter Mining for Sentiment Analysis in Tourism Industry","authors":"Gunjan Gupta, Parul Gupta","doi":"10.1109/WorldS4.2019.8903940","DOIUrl":"https://doi.org/10.1109/WorldS4.2019.8903940","url":null,"abstract":"Tourism industry is probably most affected by the introduction of social media and micro-blogging websites. Millions of users share their perceptions, liking, choices and sentiments on social media. Therefore, Social media are the most preferred platforms for emotions and sentiment analysis. In this paper, we look at one such popular microblog called Twitter which is a great way to figure out how people feel about the popular travel websites using Twitter data. To do this, we Stream tweets from the Twitter API, Filter out the tweets that are relevant using search query, Perform sentiment analysis on Twitter data to figure out how they perceive each travel site and Store the tweets for additional analysis. This study is still in the initial stages in terms of tourism industry.","PeriodicalId":389892,"journal":{"name":"2019 Third World Conference on Smart Trends in Systems Security and Sustainablity (WorldS4)","volume":"82 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114902279","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}