RoGraphER: Enhanced Extraction of Chinese Medical Entity Relationships Using RoFormer Pre-Trained Model and Weighted Graph Convolution

Abstract

Unstructured Chinese medical texts are rich sources of entity and relational information. The extraction of entity relationships from medical texts is pivotal for the construction of medical knowledge graphs and aiding healthcare professionals in making swift and informed decisions. However, the extraction of entity relationships from these texts presents a formidable challenge, notably due to the issue of overlapping entity relationships. This study introduces a novel extraction model that leverages RoFormer’s rotational position encoding (RoPE) technique for an efficient implementation of relative position encoding. This approach not only optimizes positional information utilization but also captures syntactic dependency information by constructing a weighted adjacency matrix. During the feature fusion phase, the model employs an entity attention mechanism for a deeper integration of features, effectively addressing the challenge of overlapping entity relationships. Experimental outcomes demonstrate that our model achieves an F1 score of 83.42 on datasets featuring overlapping entity relations, significantly outperforming other baseline models.