Sentiment Analysis of Radiological Narratives and Intracranial MRI Hemorrhage Images for the Prediction of Dementia and Alzheimer's Disease.

Introduction: Intracranial hemorrhage (IH) causes dementia and Alzheimer's disease in the later stages. Until now, the accurate, early detection of IH, its prognosis, and therapeutic interventions have been a challenging task. Objective: A Multimodal Joint Fusion Sentiment Analysis (MJFSA) framework is proposed for the early detection and classification of IH, as well as sentiment analysis to support prognosis and therapeutic report generation.

Methodology: MJFSA integrates radiological images and the radiological clinical narrative reports (RCNRs). In the proposed MJFSA model, MRI brain images are enhanced using the modified Contrast Limited Adaptive Histogram Equalization (M-CLAHE) algorithm. Enhanced images are processed with the proposed Tuned Temporal-GAN (Tuned-T-GAN) algorithm to generate temporal images. RCNRs are generated for temporal images using the Microsoft-Phi2 language model. Temporal images are processed with the Tuned-Vision Image Transformer (T-ViT) model to extract image features. On the other hand, the Bio-Bidirectional Encoder Representation Transformer (Bio-BERT) processes the RCNR texts for text feature extraction. Temporal image and RCNR text features are used for IH classification, such as intracerebral hemorrhage (ICH), epidural hemorrhage (EDH), subdural hemorrhage (SDH), and intraventricular hemorrhage (IVH), resulting in sentiment analysis for prognosis and therapeutic reports.

Results: The MJFSA model has achieved an accuracy of 96.5% in prognosis sentiment analysis and 94.5% in therapeutic sentiment analysis.

Discussion: The Multimodal Joint Fusion Sentiment Analysis (MJFSA) framework detects IH and classifies it using sentiment analysis for prognosis and therapeutic report generation.

Conclusion: The MJFSA model's prognosis and therapeutic sentiment analysis report aims to support the early identification and management of risk factors associated with dementia and Alzheimer's disease.

.