Enhancing sports image search and retrieval using multi-modality ontology

Extracting knowledge from multimedia contents represents recently a big challenge. Organizing and analyzing multimedia collections requires specific tools for extracting knowledge from the contents to enable effective and efficient filtering, searching and retrieval. The use of knowledge models, such as Ontology, is gaining interest among multimedia retrieval researches. This paper builds and integrates a multi-modality ontology to the conventional image annotation and retrieval methodology. The proposed knowledge-model integration highly improves the searching process. Two ontologies are proposed, domain and visual description ontologies. Experiments have demonstrated the efficiency of the proposed multi-modality ontology method when compared against the classical retrieval technique. The results show that using ontologies increases the performance to reach 1, 0.91 and 0.94 for Precision, Recall and F-measure respectively.