W-NUT@EMNLPPub Date : 2020-11-01DOI: 10.18653/V1/2020.WNUT-1.71
Huy Dao Quang, T. N. Minh
{"title":"UET at WNUT-2020 Task 2: A Study of Combining Transfer Learning Methods for Text Classification with RoBERTa","authors":"Huy Dao Quang, T. N. Minh","doi":"10.18653/V1/2020.WNUT-1.71","DOIUrl":"https://doi.org/10.18653/V1/2020.WNUT-1.71","url":null,"abstract":"This paper reports our approach and the results of our experiments for W-NUT task 2: Identification of Informative COVID-19 English Tweets. In this paper, we test out the effectiveness of transfer learning method with state of the art language models as RoBERTa on this text classification task. Moreover, we examine the benefit of applying additional fine-tuning and training techniques including fine-tuning discrimination, gradual unfreezing as well as our custom head for the classifier. Our best model results in a high F1-score of 89.89 on the task’s private test dataset and that of 90.96 on public test set without ensembling multiple models and additional data.","PeriodicalId":343127,"journal":{"name":"W-NUT@EMNLP","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116145373","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"\"A Little Birdie Told Me ... \" - Inductive Biases for Rumour Stance Detection on Social Media","authors":"Karthik Radhakrishnan, Tushar Kanakagiri, Sharanya Chakravarthy, Vidhisha Balachandran","doi":"10.18653/v1/2020.wnut-1.31","DOIUrl":"https://doi.org/10.18653/v1/2020.wnut-1.31","url":null,"abstract":"The rise in the usage of social media has placed it in a central position for news dissemination and consumption. This greatly increases the potential for proliferation of rumours and misinformation. In an effort to mitigate the spread of rumours, we tackle the related task of identifying the stance (Support, Deny, Query, Comment) of a social media post. Unlike previous works (Fajcik et al., 2019; Yang et al., 2019), we impose inductive biases that capture platform specific user behavior. These biases, coupled with social media finetuning of BERT allow for better language understanding, thus yielding an F1 score of 58.7 on the SemEval 2019 task on rumour stance detection.","PeriodicalId":343127,"journal":{"name":"W-NUT@EMNLP","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117330888","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
W-NUT@EMNLPPub Date : 1900-01-01DOI: 10.18653/v1/2020.wnut-1.18
Tanvirul Alam, A. Khan, Firoj Alam
{"title":"Punctuation Restoration using Transformer Models for High-and Low-Resource Languages","authors":"Tanvirul Alam, A. Khan, Firoj Alam","doi":"10.18653/v1/2020.wnut-1.18","DOIUrl":"https://doi.org/10.18653/v1/2020.wnut-1.18","url":null,"abstract":"","PeriodicalId":343127,"journal":{"name":"W-NUT@EMNLP","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130000676","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}