Proceedings of the Third Annual Workshop on Lifelog Search Challenge最新文献

LifeGraph: A Knowledge Graph for Lifelogs LifeGraph:生活日志的知识图谱

Proceedings of the Third Annual Workshop on Lifelog Search Challenge Pub Date : 2020-06-09 DOI: 10.1145/3379172.3391717

Luca Rossetto, Matthias Baumgartner, Narges Ashena, Florian Ruosch, Romana Pernischová, A. Bernstein

引用次数: 16

VIRET Tool with Advanced Visual Browsing and Feedback 具有高级视觉浏览和反馈的vret工具

Proceedings of the Third Annual Workshop on Lifelog Search Challenge Pub Date : 2020-06-09 DOI: 10.1145/3379172.3391725

Gregor Kovalcík, Vít Skrhak, Tomás Soucek, Jakub Lokoč

引用次数: 19

SOMHunter for Lifelog Search

Proceedings of the Third Annual Workshop on Lifelog Search Challenge Pub Date : 2020-06-09 DOI: 10.1145/3379172.3391727

František Mejzlík, Patrik Veselý, Miroslav Kratochvíl, Tomás Soucek, Jakub Lokoč

引用次数: 16

LifeSeeker 2.0: Interactive Lifelog Search Engine at LSC 2020 lifeeeker 2.0:交互式生活日志搜索引擎在LSC 2020

Proceedings of the Third Annual Workshop on Lifelog Search Challenge Pub Date : 2020-06-09 DOI: 10.1145/3379172.3391724

Tu-Khiem Le, Van-Tu Ninh, M. Tran, Thanh-An Nguyen, Hai-Dang Nguyen, Liting Zhou, G. Healy, C. Gurrin

引用次数: 18

Multimodal Retrieval through Relations between Subjects and Objects in Lifelog Images 基于生活日志图像主客体关系的多模态检索

Proceedings of the Third Annual Workshop on Lifelog Search Challenge Pub Date : 2020-06-09 DOI: 10.1145/3379172.3391723

Tai-Te Chu, Chia-Chun Chang, An-Zi Yen, Hen-Hsen Huang, Hsin-Hsi Chen

{"title":"Multimodal Retrieval through Relations between Subjects and Objects in Lifelog Images","authors":"Tai-Te Chu, Chia-Chun Chang, An-Zi Yen, Hen-Hsen Huang, Hsin-Hsi Chen","doi":"10.1145/3379172.3391723","DOIUrl":"https://doi.org/10.1145/3379172.3391723","url":null,"abstract":"With the development of wearable devices, people nowadays record their life experiences much easier than before. Lifelog retrieval becomes an emerging task. Because of the semantic gap between visual data and textual queries, retrieving lifelog images with text queries could be challenging. This paper proposes an interactive lifelog retrieval system that is aimed at retrieving more intuitive and accurate results. Our system is divided into the offline and the online parts. In the offline part, we aim to incorporate original visual and textual concepts from images into our system utilizing pre-trained word embedding. Moreover, we encode the information of relationships between subjects and objects in images by using a pre-trained relation graph generation model. In the online part, We provide an intuitive frontend with various metadata filters, which not only provides users with a convenient interface, but also a mechanism to exploit detail memory recall to users. In this case, users would clearly know the difference between the concepts in the clusters and efficiently browse the retrieved images clusters in a short time.","PeriodicalId":340585,"journal":{"name":"Proceedings of the Third Annual Workshop on Lifelog Search Challenge","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-06-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126697571","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 13

Myscéal: An Experimental Interactive Lifelog Retrieval System for LSC'20 一种交互式生命日志检索系统[j]

Proceedings of the Third Annual Workshop on Lifelog Search Challenge Pub Date : 2020-06-09 DOI: 10.1145/3379172.3391719

Ly-Duyen Tran, Manh-Duy Nguyen, N. Binh, Hyowon Lee, C. Gurrin

引用次数: 30

FIRST - Flexible Interactive Retrieval SysTem for Visual Lifelog Exploration at LSC 2020 LSC 2020可视化生活日志探索的柔性交互检索系统

Proceedings of the Third Annual Workshop on Lifelog Search Challenge Pub Date : 2020-06-09 DOI: 10.1145/3379172.3391726

M. Tran, Thanh-An Nguyen, Quoc-Cuong Tran, Mai-Khiem Tran, Khanh-Duy Nguyen, Van-Tu Ninh, Tu-Khiem Le, Hoang-Phuc Trang-Trung, Hoang-Anh Le, Hai-Dang Nguyen, Trong-Le Do, Viet-Khoa Vo-Ho, C. Gurrin

{"title":"FIRST - Flexible Interactive Retrieval SysTem for Visual Lifelog Exploration at LSC 2020","authors":"M. Tran, Thanh-An Nguyen, Quoc-Cuong Tran, Mai-Khiem Tran, Khanh-Duy Nguyen, Van-Tu Ninh, Tu-Khiem Le, Hoang-Phuc Trang-Trung, Hoang-Anh Le, Hai-Dang Nguyen, Trong-Le Do, Viet-Khoa Vo-Ho, C. Gurrin","doi":"10.1145/3379172.3391726","DOIUrl":"https://doi.org/10.1145/3379172.3391726","url":null,"abstract":"Lifelog can provide useful insights of our daily activities. It is essential to provide a flexible way for users to retrieve certain events or moments of interest, corresponding to a wide variation of query types. This motivates us to develop FIRST, a Flexible Interactive Retrieval SysTem, to help users to combine or integrate various query components in a flexible manner to handle different query scenarios, such as visual clustering data based on color histogram, visual similarity, GPS location, or scene attributes. We also employ personalized concept detection and image captioning to enhance image understanding from visual lifelog data, and develop an autoencoder-like approach for query text and image feature mapping. Furthermore, we refine the user interface of the retrieval system to better assist users in query expansion and verifying sequential events in a flexible temporal resolution to control the navigation speed through sequences of images.","PeriodicalId":340585,"journal":{"name":"Proceedings of the Third Annual Workshop on Lifelog Search Challenge","volume":"289 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-06-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114449851","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 17

BIDAL-HCMUS@LSC2020: An Interactive Multimodal Lifelog Retrieval with Query-to-Sample Attention-based Search Engine BIDAL-HCMUS@LSC2020:一个交互式多模式生活日志检索与查询样本的基于注意力的搜索引擎

Proceedings of the Third Annual Workshop on Lifelog Search Challenge Pub Date : 2020-06-09 DOI: 10.1145/3379172.3391722

Anh-Vu Mai-Nguyen, Trong-Dat Phan, Anh-Khoa Vo, Van-Luon Tran, Minh-Son Dao, K. Zettsu

{"title":"BIDAL-HCMUS@LSC2020: An Interactive Multimodal Lifelog Retrieval with Query-to-Sample Attention-based Search Engine","authors":"Anh-Vu Mai-Nguyen, Trong-Dat Phan, Anh-Khoa Vo, Van-Luon Tran, Minh-Son Dao, K. Zettsu","doi":"10.1145/3379172.3391722","DOIUrl":"https://doi.org/10.1145/3379172.3391722","url":null,"abstract":"In this paper, we introduce an interactive multimodal lifelog retrieval system with the search engine built by utilizing the attention mechanism. The algorithm upon which the system relies is constructed by applying two observations: (1) most of the images belonged to one event probably contain cues (e.g., objects) that relate to the content of queries. These cues contribute to the representative of the event, and (2) instances of one event can be associated with the content and context of such an event. Hence, when we can determine the seed (by leveraging the first observation), we can find all relevant instances (by utilizing the second observation). We also take a benefit of querying by samples (e.g., images) by converting text query to images using the attention-based mechanism. Thus, we can enrich and add more semantic meaning into the simple text query of users towards having more accurate results, as well as discovering hidden results that cannot reach by using only text queries. The system is designed for both novice and expert users with several filters to help users express their queries from general to particular descriptions and to polish their results.","PeriodicalId":340585,"journal":{"name":"Proceedings of the Third Annual Workshop on Lifelog Search Challenge","volume":"106 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-06-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123307474","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 8

lifeXplore at the Lifelog Search Challenge 2020 2020年生活日志搜索挑战赛上的lifeXplore

Proceedings of the Third Annual Workshop on Lifelog Search Challenge Pub Date : 2020-06-09 DOI: 10.1145/3379172.3391721

Andreas Leibetseder, Klaus Schöffmann

引用次数: 13

Voxento: A Prototype Voice-controlled Interactive Search Engine for Lifelogs Voxento:一个用于生活日志的语音控制交互式搜索引擎原型

Proceedings of the Third Annual Workshop on Lifelog Search Challenge Pub Date : 2020-06-09 DOI: 10.1145/3379172.3391728

Ahmed Alateeq, M. Roantree, C. Gurrin

引用次数: 17