Marco A. Hudelist, Klaus Schöffmann, L. Böszörményi
{"title":"Mobile video browsing with a 3D filmstrip","authors":"Marco A. Hudelist, Klaus Schöffmann, L. Böszörményi","doi":"10.1145/2461466.2461515","DOIUrl":"https://doi.org/10.1145/2461466.2461515","url":null,"abstract":"As mobile devices become more and more pervasive, they are increasingly used to record and watch personal and professional videos. Common video browsers on smart phones and tablets, however, fail to provide users an efficient and engaging experience to browse through video content. In this demo paper, we present an early prototype for browsing videos on tablets: browsing video with a 3D filmstrip. A video is split up into equidistant, uniformly sampled time segments. The segments are represented by key-frames shown on the surface of a filmstrip, allowing an immediate overview of great parts of the video. Further, a user can scroll through the filmstrip, start playback for any segment and refine the preview of segments by simple touch gestures.","PeriodicalId":112437,"journal":{"name":"Proceedings of the 3rd ACM conference on International conference on multimedia retrieval","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125285065","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"ZhiWo: activity tagging and recognition system for personal lifelogs","authors":"Lijuan Marissa Zhou, C. Gurrin, Zhengwei Qiu","doi":"10.1145/2461466.2461526","DOIUrl":"https://doi.org/10.1145/2461466.2461526","url":null,"abstract":"With the increasing use of mobile devices as personal recording, communication and sensing tools, extracting the semantics of life activities through sensed data (photos, accelerometer, GPS etc.) is gaining widespread public awareness. A person who engages in long-term personal sensing is engaging in a process of lifelogging. Lifelogging typically involves using a range of (wearable) sensors to capture raw data, to segment into discrete activities, to annotate and subsequently to make accessible by search or browsing tools. In this paper, we present an intuitive lifelog activity recording and management system called ZhiWo. By using a supervised machine learning approach, sensed data collected by mobile devices are automatically classified into different types of daily human activities and these activities are interpreted as life activity retrieval units for personal archives.","PeriodicalId":112437,"journal":{"name":"Proceedings of the 3rd ACM conference on International conference on multimedia retrieval","volume":"194 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124333466","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Michele Trevisiol, H. Jégou, J. Delhumeau, G. Gravier
{"title":"Retrieving geo-location of videos with a divide & conquer hierarchical multimodal approach","authors":"Michele Trevisiol, H. Jégou, J. Delhumeau, G. Gravier","doi":"10.1145/2461466.2461468","DOIUrl":"https://doi.org/10.1145/2461466.2461468","url":null,"abstract":"This paper presents a strategy to identify the geographic location of videos. First, it relies on a multi-modal cascade pipeline that exploits the available sources of information, namely the user's upload history, his social network and a visual-based matching technique. Second, we present a novel divide & conquer strategy to better exploit the tags associated with the input video. It pre-selects one or several geographic area of interest of higher expected relevance and performs a deeper analysis inside the selected area(s) to return the coordinates most likely to be related to the input tags. The experiments were conducted as part of the MediaEval 2012 Placing Task. Our approach, which differs significantly from the other submitted techniques, achieves the best results on this benchmark when considering the same amount of external information, i.e. when not using any gazetteers nor any other kind of external information.","PeriodicalId":112437,"journal":{"name":"Proceedings of the 3rd ACM conference on International conference on multimedia retrieval","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130425829","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Identification of plants from multiple images and botanical IdKeys","authors":"A. Sfar, N. Boujemaa, D. Geman","doi":"10.1145/2461466.2461499","DOIUrl":"https://doi.org/10.1145/2461466.2461499","url":null,"abstract":"Automatic retrieval tools are becoming increasingly important in botany and agriculture due to the growing interest in biodiversity and the ongoing shortage of skilled taxonomists. Our work is motivated by a botanical field scenario where the basic unit of observation is a plant. We describe a novel, image-based retrieval system for both educational and decision-making purposes. Given multiple leaf images of the same plant, the algorithm displays a ranked list of the most relevant species, along with a varied set of representative images from each estimated species. We focus on leaves but the strategy is generic, based on a hierarchical representation of latent variables called identification keys (IdKeys) which embody domain knowledge about taxonomy and landmarks. For each query image, keys are estimated sequentially, proceeding from landmarks to the genus and finally to an estimated set of species. The results over multiple queries are then collated into a single ranked list of species. Experiments demonstrate that the proposed approach achieves excellent performance on several databases of uncluttered leaf images as well as providing an instructive interface for measuring diversity and identifying new species.","PeriodicalId":112437,"journal":{"name":"Proceedings of the 3rd ACM conference on International conference on multimedia retrieval","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128886589","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Semantic indexing and computational aesthetics: interactions, bridgesand boundaries","authors":"Miriam Redi","doi":"10.1145/2461466.2461532","DOIUrl":"https://doi.org/10.1145/2461466.2461532","url":null,"abstract":"Semantic Indexing and Computational Aesthetics are two closely related fields. For some aspects they are similar, complementary for others, and sometimes completely disjoint. Semantic Indexing is about automatically identifying content in natural images, namely recognizing objects and scenes. Computational Aesthetics provides a set of techniques to automatically assign a beauty degree to a given image. In our work, we enrich both types of visual analysis by exploring the synergy of those two fields. We investigate the role of Semantic Indexing techniques for Computational Aesthetics Frameworks, and, vice versa, the importance of Aesthetic features for Semantic Indexing prediction. We show the benefits and the limits of this synergy, and propose some improvements in this direction.","PeriodicalId":112437,"journal":{"name":"Proceedings of the 3rd ACM conference on International conference on multimedia retrieval","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115716850","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Minh-Son Dao, G. Boato, F. D. Natale, Truc-Vien T. Nguyen
{"title":"Jointly exploiting visual and non-visual information for event-related social media retrieval","authors":"Minh-Son Dao, G. Boato, F. D. Natale, Truc-Vien T. Nguyen","doi":"10.1145/2461466.2461494","DOIUrl":"https://doi.org/10.1145/2461466.2461494","url":null,"abstract":"In this contribution, we propose a watershed-based method with support from external data sources and visual information to detect social events in web multimedia. The idea is based on two main observations: (1) people cannot be involved in more than one event at the same time, and (2) people tend to introduce similar annotations for all images associated to the same event. Based on these observations, the metadata is turned to an image so that each row contains all records belonging to one user; and these records are sorted by time. Thus, the social event detection is turned to watershed-based image segmentation, where Markers are generated by using (keyword, location, visual) features with support of external data sources, and the Flood progress is carried on by taking into account (tags set, time, visual) features. We test our algorithm on the MediaEval 2012 dataset both using only external data but also introducing visual information.","PeriodicalId":112437,"journal":{"name":"Proceedings of the 3rd ACM conference on International conference on multimedia retrieval","volume":"196 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124376258","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Getting the look: clothing recognition and segmentation for automatic product suggestions in everyday photos","authors":"Yannis Kalantidis, L. Kennedy, Li-Jia Li","doi":"10.1145/2461466.2461485","DOIUrl":"https://doi.org/10.1145/2461466.2461485","url":null,"abstract":"We present a scalable approach to automatically suggest relevant clothing products, given a single image without metadata. We formulate the problem as cross-scenario retrieval: the query is a real-world image, while the products from online shopping catalogs are usually presented in a clean environment. We divide our approach into two main stages: a) Starting from articulated pose estimation, we segment the person area and cluster promising image regions in order to detect the clothing classes present in the query image. b) We use image retrieval techniques to retrieve visually similar products from each of the detected classes. We achieve clothing detection performance comparable to the state-of-the-art on a very recent annotated dataset, while being more than 50 times faster. Finally, we present a large scale clothing suggestion scenario, where the product database contains over one million products.","PeriodicalId":112437,"journal":{"name":"Proceedings of the 3rd ACM conference on International conference on multimedia retrieval","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124383055","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Geo-visual ranking for location prediction of social images","authors":"Xinchao Li, M. Larson, A. Hanjalic","doi":"10.1145/2461466.2461481","DOIUrl":"https://doi.org/10.1145/2461466.2461481","url":null,"abstract":"Predicting geographic location using exclusively the visual content of images holds the promise of greatly benefiting users' access to media collections. In this paper, we present a visual-content-based approach that predicts where in the world a social image was taken. We employ a ranking method that assigns a query photo the geo-location of its most likely geo-visual neighbor in the social image collection. The novelty of the approach is that ranking makes use not only of the photos themselves, but also their geo-visual neighbors. In contrast to other approaches, we do not restrict the locations we predict to landmarks or specific cities. The approach is evaluated on a set of 3 million geo-tagged photos from Flickr, released by MediaEval 2012. Experiments show that the proposed system delivers a substantive performance improvement compared with previously proposed, related visual content-based approaches. The discussion illustrates how photo densities, geo-visual redundancy and uploader patterns characteristic of social image collections impacts the performance.","PeriodicalId":112437,"journal":{"name":"Proceedings of the 3rd ACM conference on International conference on multimedia retrieval","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114940886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A shape-based approach for leaf classification using multiscaletriangular representation","authors":"S. Mouine, Itheri Yahiaoui, Anne Verroust-Blondet","doi":"10.1145/2461466.2461489","DOIUrl":"https://doi.org/10.1145/2461466.2461489","url":null,"abstract":"In this paper we introduce a new multiscale shape-based approach for leaf image retrieval. The leaf is represented by local descriptors associated with margin sample points. Within this local description, we study four multiscale triangle representations: the well known triangle area representation (TAR), the triangle side lengths representation (TSL) and two new representations that we denote triangle oriented angles (TOA) and triangle side lengths and angle representation (TSLA). Unlike existing TAR approaches, where a global matching is performed, the similarity measure is based on a locality sensitive hashing of local descriptors. The proposed approach is invariant under translation, rotation and scale and robust under partial occlusion. Evaluations made on four public leaf datasets show that our shape-based approach achieves a high retrieval accuracy w.r.t. state-of-art methods.","PeriodicalId":112437,"journal":{"name":"Proceedings of the 3rd ACM conference on International conference on multimedia retrieval","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121510637","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Cai-Zhi Zhu, Siriwat Kasamwattanarote, Xiaomeng Wu, S. Satoh
{"title":"Connect commercial films with realities","authors":"Cai-Zhi Zhu, Siriwat Kasamwattanarote, Xiaomeng Wu, S. Satoh","doi":"10.1145/2461466.2461527","DOIUrl":"https://doi.org/10.1145/2461466.2461527","url":null,"abstract":"Broadcast TV program is a quite informative media resource which records our daily life over the time. While for emphasizing real-time reporting, those out-of-date video archives once were elaborately created with high quality are always left without being fully used. In this paper, many known state-of-the-art retrieval technologies are integrated into a commercial film retrieval system, which manages to index a huge commercial dataset archived from five TV channels within recent three years. The final purpose is to connect images queried by users with our archived broadcast video dataset via searching relevant commercials and accessing their broadcast information, such as air time and replay frequency. This system also serves as one part of our ongoing broadcast TV program reusing project.","PeriodicalId":112437,"journal":{"name":"Proceedings of the 3rd ACM conference on International conference on multimedia retrieval","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122766111","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}