Boyu He, Han Wu, Congduan Li, Linqi Song, Weigang Chen
{"title":"K-CSRL:知识增强会话语义角色标注","authors":"Boyu He, Han Wu, Congduan Li, Linqi Song, Weigang Chen","doi":"10.1145/3457682.3457763","DOIUrl":null,"url":null,"abstract":"Semantic role labeling (SRL) is widely used to extract predicate-argument pairs from sentences. Traditional SRL methods can perform well on the single sentence but fail to work in dialogue scenario where ellipsis and anaphora frequently occurs. Some research work has been proposed to solve this problem, i.e. Conversational Semantic Role Labeling (CSRL), but there are still huge room for improvements. The error case study of BERT-based CSRL model has shown that the majority of the errors are observed in boundary matching, especially in entity mention detection. We think the premier cause of this kind of error is the deficiency of external knowledge such that the ill-informed model cannot correctly capture and correlate the entities. To this end, we propose to incorporate external knowledge into BERT using visible masking strategy. We evaluate our proposed model on DuConv dataset. Experimental results show that our model with knowledge enhancement outperforms the benchmarks. Further analysis also demonstrates that dialogue SRL can benefit from external knowledge.","PeriodicalId":142045,"journal":{"name":"2021 13th International Conference on Machine Learning and Computing","volume":"78 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-02-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"K-CSRL: Knowledge Enhanced Conversational Semantic Role Labeling\",\"authors\":\"Boyu He, Han Wu, Congduan Li, Linqi Song, Weigang Chen\",\"doi\":\"10.1145/3457682.3457763\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Semantic role labeling (SRL) is widely used to extract predicate-argument pairs from sentences. Traditional SRL methods can perform well on the single sentence but fail to work in dialogue scenario where ellipsis and anaphora frequently occurs. Some research work has been proposed to solve this problem, i.e. Conversational Semantic Role Labeling (CSRL), but there are still huge room for improvements. The error case study of BERT-based CSRL model has shown that the majority of the errors are observed in boundary matching, especially in entity mention detection. We think the premier cause of this kind of error is the deficiency of external knowledge such that the ill-informed model cannot correctly capture and correlate the entities. To this end, we propose to incorporate external knowledge into BERT using visible masking strategy. We evaluate our proposed model on DuConv dataset. Experimental results show that our model with knowledge enhancement outperforms the benchmarks. Further analysis also demonstrates that dialogue SRL can benefit from external knowledge.\",\"PeriodicalId\":142045,\"journal\":{\"name\":\"2021 13th International Conference on Machine Learning and Computing\",\"volume\":\"78 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-02-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 13th International Conference on Machine Learning and Computing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3457682.3457763\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 13th International Conference on Machine Learning and Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3457682.3457763","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
K-CSRL: Knowledge Enhanced Conversational Semantic Role Labeling
Semantic role labeling (SRL) is widely used to extract predicate-argument pairs from sentences. Traditional SRL methods can perform well on the single sentence but fail to work in dialogue scenario where ellipsis and anaphora frequently occurs. Some research work has been proposed to solve this problem, i.e. Conversational Semantic Role Labeling (CSRL), but there are still huge room for improvements. The error case study of BERT-based CSRL model has shown that the majority of the errors are observed in boundary matching, especially in entity mention detection. We think the premier cause of this kind of error is the deficiency of external knowledge such that the ill-informed model cannot correctly capture and correlate the entities. To this end, we propose to incorporate external knowledge into BERT using visible masking strategy. We evaluate our proposed model on DuConv dataset. Experimental results show that our model with knowledge enhancement outperforms the benchmarks. Further analysis also demonstrates that dialogue SRL can benefit from external knowledge.