A medical information extraction model with contrastive tuning and tagging layer training

Abstract

Medical information extraction, as a core task in medical intelligent systems, focuses on extracting necessary structured information from clinical texts. In recent years, deep learning-based methods have become mainstream and often achieve superior extraction results. However, these existing methods have not fully tapped into the semantic potential of medical information categories, and most rely on a large amount of annotated data. This study proposes a novel semantic guided representation training model for medical information, which trains the representation of medical texts and medical information categories in the same semantic space by contrasting loss mechanisms, effectively reducing the need for annotated data. The experimental results show that our method objectives F1 value of 88.29 on CCKS2019 and 90.68 on CMeEE. Our method also exceeds the baseline by 4.07 on CCKS2019 and 4.95 on CMeEE.