Research on text structuralization in medical field

Abstract

Transforming the non-structured medical text data into structured data is the basis of the processing and analysis of medical data. The effect of general-purpose word segmentation tools recognizing terminology is not ideal, which greatly affects the accuracy of the word segmentation, and further influences the result of text structuralization. In view of above problems, this paper puts forward a method of discovering new words based on word embedding. It uses Google open source word vector tool word2vec to train text and map the words into abstracted n-dimensional vector space. We can get the latent semantic relations between words and words in the corpus. And then combining the information entropy and word frequency, we can find new words. Finally, we design information extraction rules to get the key information according to the new words, and organize them into structured data. Experimental results on real medical data show that the accuracy is improved by 10% compared to traditional method, and the time is saved by 18% compared to traditional method.