Proceedings of the 6th Annual ACM Lifelog Search Challenge最新文献

筛选

英文中文

E-LifeSeeker: An Interactive Lifelog Search Engine for LSC’23 E-LifeSeeker:一种交互式生活日志搜索引擎

Proceedings of the 6th Annual ACM Lifelog Search Challenge Pub Date : 2023-06-12 DOI: 10.1145/3592573.3593098

Thao-Nhu Nguyen, Tu-Khiem Le, Van-Tu Ninh, C. Gurrin, Minh-Triet Tran, T. Nguyen, G. Healy, A. Caputo, Sinéad Smyth

{"title":"E-LifeSeeker: An Interactive Lifelog Search Engine for LSC’23","authors":"Thao-Nhu Nguyen, Tu-Khiem Le, Van-Tu Ninh, C. Gurrin, Minh-Triet Tran, T. Nguyen, G. Healy, A. Caputo, Sinéad Smyth","doi":"10.1145/3592573.3593098","DOIUrl":"https://doi.org/10.1145/3592573.3593098","url":null,"abstract":"Lifelogging is referred to as the process of automatically capturing the everyday activities of an individual to ultimately create a digital diary for further sharing, which can be challenging to manage and retrieve due to its multimodal nature. Lifelog retrieval systems not only have the potential to transform the way people interact and understand their lives, but also provide insights into their behaviour, habits, and preferences. The Lifelog Search Challenge (LSC) is a live benchmarking challenge to evaluate the performance of lifelog search tools in a real-time. This paper describes the modifications made to the E-LifeSeeker retrieval system, which participates in the 6th LSC challenge. This year, we enhance not only the underlying core engine with the latest pre-trained embedding models but also the user interface to be more intuitive for novice users. Moreover, Differential Networks are implemented to address the new question-answering task this year. These new modalities are designed to provide users with a more intuitive and efficient search experience, easing the process of locating information needed from the huge collection of egocentric lifelog images.","PeriodicalId":147486,"journal":{"name":"Proceedings of the 6th Annual ACM Lifelog Search Challenge","volume":"98-100 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120977817","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

LifeInsight: An Interactive Lifelog Retrieval System with Comprehensive Spatial Insights and Query Assistance LifeInsight:一个具有综合空间洞察和查询辅助的交互式生活日志检索系统

Proceedings of the 6th Annual ACM Lifelog Search Challenge Pub Date : 2023-06-12 DOI: 10.1145/3592573.3593106

Tien-Thanh Nguyen-Dang, Xuan-Dang Thai, Gia-Huy Vuong, Van-Son Ho, Minh-Triet Tran, Van-Tu Ninh, Minh Pham, Tu-Khiem Le, G. Healy

{"title":"LifeInsight: An Interactive Lifelog Retrieval System with Comprehensive Spatial Insights and Query Assistance","authors":"Tien-Thanh Nguyen-Dang, Xuan-Dang Thai, Gia-Huy Vuong, Van-Son Ho, Minh-Triet Tran, Van-Tu Ninh, Minh Pham, Tu-Khiem Le, G. Healy","doi":"10.1145/3592573.3593106","DOIUrl":"https://doi.org/10.1145/3592573.3593106","url":null,"abstract":"In this paper, we introduce LifeInsight – an interactive lifelog retrieval system developed for the sixth annual Lifelog Search Challenge (LSC’23). LifeInsight incorporates semantic search mechanisms from state-of-the-art lifelog retrieval systems while focusing on providing insights into the lifelogger’s routine using spatial information to support question-answering tasks. The system employs the Bootstrapping Language-Image Pre-training (BLIP) model for zero-shot image-text retrieval, which has been shown to achieve higher recall scores than the CLIP model on the Flickr30K dataset. In addition, the Elastic Search filtering mechanism is utilized to remove irrelevant images. Apart from semantic search mechanisms, the system also supports visual similarity search by comparing the inner product distance between the vectors in the lifelog image corpus and the query image. Furthermore, the system includes an explicit relevance feedback function, AI-based query description rewriting, and visual-example-generating features to re-phrase the query to describe it better and support end-users envisioning the targeted image for retrieval.","PeriodicalId":147486,"journal":{"name":"Proceedings of the 6th Annual ACM Lifelog Search Challenge","volume":"26 4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115771235","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

Proceedings of the 6th Annual ACM Lifelog Search Challenge 第六届年度ACM生活日志搜索挑战赛论文集

Proceedings of the 6th Annual ACM Lifelog Search Challenge Pub Date : 1900-01-01 DOI: 10.1145/3592573

引用次数: 0

首页上一页