Multi feature fusion paper classification model based on attention mechanism

In recent years, the number of published scientific research papers has shown a growing trend. How to classify scientific research papers efficiently and accurately is a very important issue. However, excellent paper classification system platforms at home and abroad, such as China National Knowledge Infrastructure, Microsoft Academic Network, etc., rely heavily on the structured or semi-structured text in papers for classification, and do not interpret the unstructured text data in papers enough. To solve this problem, we proposed a multi-feature fusion paper classification model based on attention mechanism (AttentionMFF), which uses the fusion features of structured and unstructured text data in papers to improve classification performance. First, Attention MFF extracts the features of different texts in papers by a BERT layer, then uses attention mechanism to fuse different features, and finally get category through the linear layer. Experiments on the arXiv paper dataset show that the Attention MFF has higher F1-Score than TextCNN model and BERT model that only uses the feature of abstract.