A Demo of multimodal medical retrieval

Abstract

Providing personalized medical care based on a patient's specific characteristics (diagnostic-image content, age, sex, weight, and so on) is an important aspect of modern medicine. This paper describes tools that aim to facilitate this process by providing clinicians with information regarding diagnosis, and treatment of past patients with similar characteristics. The additional information thus provided can help make better-informed decisions with regards to the diagnosis and treatment planning of new patients. Two existing tools: Shambala and Shangri-La can be combined for use within a clinical environment. Deployment inside healthcare facilities can become possible via the MD-Paedigree project.