FHN: Fuzzy Hashing Network for Medical Image Retrieval

Abstract

The rapid advancement of medical imaging technologies has led to an exponential increase in medical image data, making efficient retrieval from large-scale datasets critical for improving diagnostic accuracy and speed. However, two key challenges hinder this process: first, the presence of uncertain and subtle lesions in medical images that are often difficult to discern, and second, class imbalance across different case types within medical image databases. These inherent challenges significantly degrade the performance of existing hashing algorithms. In recent years, methods based on the Takagi–Sugeno–Kang fuzzy system (TSK-FS) have shown promising performance in medical image modeling. Inspired by these advances, this article proposes a novel fuzzy hashing network (FHN) based on TSK-FS to enhance retrieval performance by effectively handling both uncertainty and data imbalance in medical imaging. The FHN first introduces a novel fuzzification mechanism that incorporates the concept of a self-attention mechanism to effectively capture the complex underlying features in medical images, thereby enhancing the data discriminability in fuzzy spaces. Meanwhile, a new consequent parameter learning mechanism is developed for defuzzification by introducing the Transformer network, which aims to improve the inference efficiency and generalization capability of the FHN. Based on these two mechanisms, FHN’s capability of analyzing and handling uncertain data is significantly enhanced. Furthermore, a novel hash center loss is designed to capture global relationships while emphasizing local structural information, thereby improving the handling of imbalanced data and significantly enhancing retrieval performance.