Company Industry Classification with Neural and Attention-Based Learning Models

Abstract

This paper compares different solutions for the task of classifying companies with an industry classification scheme. Recent advances in deep learning methods show better performance in the text classification task. The dataset consists of short textual descriptions of companies and their economic activities. Target classification schemes are built by mapping related open data in a semi-controlled manner. Target classes are built from the bottom up by DBpedia. For the experiments are used modifications of methods BERT, XLNet, Glove and ULMfit with pre-trained models for English. Two simple models with perceptron architecture are used as the baseline. The results show that the best performance for multi-label classification of DBpedia companies abstracts is achieved by BERT and XLnet models, even for unbalanced classes.