Kodiak@ALQAC2021: Deep Learning for Vietnamese Legal Information Processing

In this paper, we propose deep learning based methods for addressing the problems of legal text processing in the Automated Legal Question Answering Competition (ALQAC 2021). The competition consists of three challenging tasks based on well-known statute laws in Vietnamese and Thai Language. We participated in three tasks related to the Vietnamese statute law, including the legal document retrieval (Task 1), the legal textual entailment (Task 2), and the legal question answering (Task 3). In Task 1, we combine semantic and lexical scores to identify relevant articles. In Tasks 2&3, we fine-tune pretrained models for the Vietnamese language in order to classify proper labels. The experimental results demonstrate both the difficulties and potentials associated with these approaches.