E-LifeSeeker: An Interactive Lifelog Search Engine for LSC’23

Abstract

Lifelogging is referred to as the process of automatically capturing the everyday activities of an individual to ultimately create a digital diary for further sharing, which can be challenging to manage and retrieve due to its multimodal nature. Lifelog retrieval systems not only have the potential to transform the way people interact and understand their lives, but also provide insights into their behaviour, habits, and preferences. The Lifelog Search Challenge (LSC) is a live benchmarking challenge to evaluate the performance of lifelog search tools in a real-time. This paper describes the modifications made to the E-LifeSeeker retrieval system, which participates in the 6th LSC challenge. This year, we enhance not only the underlying core engine with the latest pre-trained embedding models but also the user interface to be more intuitive for novice users. Moreover, Differential Networks are implemented to address the new question-answering task this year. These new modalities are designed to provide users with a more intuitive and efficient search experience, easing the process of locating information needed from the huge collection of egocentric lifelog images.