K. Hoashi, C. Ono, Daisuke Ishii, Hiroshi Watanabe
{"title":"Automatic preview generation of comic episodes for digitized comic search","authors":"K. Hoashi, C. Ono, Daisuke Ishii, Hiroshi Watanabe","doi":"10.1145/2072298.2072047","DOIUrl":"https://doi.org/10.1145/2072298.2072047","url":null,"abstract":"This research proposes a novel method to present \"thumbnails\" of episodes of digitized comics, in order to improve the efficiency of comic search. Comic episode thumbnails are generated based on image analysis technologies developed especially for comic images. Namely, the following procedures are developed for our system: automatic comic frame segmentation, text balloon extraction, and a linear regression based model to calculate the importance score of each extracted frame. The system then selects frames from each episode with high importance score, and aligns the selected frames to create the episode thumbnail, which is presented to the system user as a compact preview of the episode. User experiments conducted with actual Japanese comic images prove that the proposed method significantly decreases the time necessary to search for specific episodes from a large scaled comic data collection.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129127927","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sherif A. Halawa, Derek Pang, Ngai-Man Cheung, B. Girod
{"title":"ClassX: an open source interactive lecture StreamingSystem","authors":"Sherif A. Halawa, Derek Pang, Ngai-Man Cheung, B. Girod","doi":"10.1145/2072298.2072428","DOIUrl":"https://doi.org/10.1145/2072298.2072428","url":null,"abstract":"The ClassX open source project is a free experimental interactive video streaming platform designed for educators, researchers and software developers. With minimal infra-structure set-up, ClassX offers educational communities a cost-effective solution for online lecture delivery. Our goal is to encourage contributions from other researchers, developers and educators in building an open, cost-effective and state-of-the-art online education video viewing system for the general public.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"2009 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125648851","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Dual-sensor fusion for indoor user localisation","authors":"M. Redzic, C. Brennan, N. O’Connor","doi":"10.1145/2072298.2071948","DOIUrl":"https://doi.org/10.1145/2072298.2071948","url":null,"abstract":"In this paper we address the automatic identification of indoor locations using a combination of WLAN and image sensing. Our motivation is the increasing prevalence of wearable cameras, some of which can also capture WLAN data. We propose to use image-based and WLAN-based localization individually and then fuse the results to obtain better performance overall. We demonstrate the effectiveness of our fusion algorithm for localisation to within a 8.9m2 room on very challenging data both for WLAN and image-based algorithms. We envisage the potential usefulness of our approach in a range of ambient assisted living applications.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132478011","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reading between the tags to predict real-world size-class for visually depicted objects in images","authors":"M. Larson, Christoph Kofler, A. Hanjalic","doi":"10.1145/2072298.2072335","DOIUrl":"https://doi.org/10.1145/2072298.2072335","url":null,"abstract":"Multimedia information retrieval stands to benefit from the availability of additional information about tags and how they relate to the content visually depicted in images. We propose a generic approach that contributes to improving the informativeness of image tags by combining generalizations about the distributional tendencies of physical objects in the real world and statistics of natural language use patterns that have been mined from the Web. The approach, which we refer to as 'Reading between the Tags,' provides for each tag associated with an image, first, a prediction concerning corporeality, i.e., whether or not the tag denotes a physical entity, and, then, concerning the real-world size of that entity, i.e., large, medium or small. Mining takes place using a set of Language Use Frames (LUFs) that are composed of natural language neighborhoods characteristic of tag classes. We validate our approach with a series of experiments on a set of images from the MIRFLICKR data set using ground truth created with standard crowdsourcing techniques. The main experiments demonstrate the effectiveness of our approach for size-class prediction. A further experiment shows that size-class prediction can be improved and made image-specific using general and relatively small sets of visual concepts. A final experiment confirms that the set of LUFs can also be chosen automatically via statistical feature selection.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130888640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"ARA: the active reading application","authors":"G. Golovchinsky, S. Carter, Anthony Dunnigan","doi":"10.1145/2072298.2072464","DOIUrl":"https://doi.org/10.1145/2072298.2072464","url":null,"abstract":"The Active Reading Application (ARA) brings the familiar experience of writing on paper to the tablet. The application augments paper-based practices with audio, the ability to review annotations, and sharing. It is designed to make it easier to review, annotate, and comment on documents by individuals and groups. ARA incorporates several patented technologies and draws on several years of research and experimentation.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129174358","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Andreas Girgensohn, F. Shipman, L. Wilcox, Qiong Liu, Chunyuan Liao, Yuichi Oneda
{"title":"A tool for authoring unambiguous links from printed content to digital media","authors":"Andreas Girgensohn, F. Shipman, L. Wilcox, Qiong Liu, Chunyuan Liao, Yuichi Oneda","doi":"10.1145/2072298.2072065","DOIUrl":"https://doi.org/10.1145/2072298.2072065","url":null,"abstract":"Embedded Media Markers (EMMs) are nearly transparent icons printed on paper documents that link to associated digital media. By using the document content for retrieval, EMMs are less visually intrusive than barcodes and other glyphs while still providing an indication for the presence of links. An initial implementation demonstrated good overall performance but exposed difficulties in guaranteeing the creation of unambiguous EMMs. We developed an EMM authoring tool that supports the interactive authoring of EMMs via visualizations that show the user which areas on a page may cause recognition errors and automatic feedback that moves the authored EMM away from those areas. The authoring tool and the techniques it relies on have been applied to corpora with different visual characteristics to explore the generality of our approach.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"69 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126408548","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Robust image representation for efficient recognition and retrieval","authors":"Xia Li","doi":"10.1145/2072298.2072495","DOIUrl":"https://doi.org/10.1145/2072298.2072495","url":null,"abstract":"Image representation plays an essential role in image categorization and retrieval applications. Images span on visual and spatial space. Encoding both visual and spatial information for effective and efficient image matching remains a fundamental problem in computer vision. The objective of my research is to construct a robust image representation for efficient recognition and retrieval.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126920664","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Real-time 3D interaction with deformable model on mobile devices","authors":"Ziying Tang, Orkun Ozbek, X. Guo","doi":"10.1145/2072298.2071925","DOIUrl":"https://doi.org/10.1145/2072298.2071925","url":null,"abstract":"Mobile-based augmented reality is an emerging technology that provides immersive experiences over wireless networks. Its applications, such as 3D streaming, have become more and more popular on mobile devices. However, most of these applications do not support real-time 3D interactions. Consequently, mobile users can only watch or browse 3D contents passively instead of actively interacting with 3D objects. In this paper, we propose a novel method that allows mobile users to change a model's shape and motions through interactions via mobile touch screen and obtain feedbacks in real-time. To accelerate computational speed and reduce communication load, we compute 3D deformations using a spectral representation. Moreover, a progressive deformation streaming technique is proposed to reduce the effect of interaction delay between the server and mobile clients. Our experimental results indicate that our method provides real-time interaction feedback, offering satisfactory user experiences.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121070184","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Sharing rectangular objects in a video conference","authors":"Senthil Kumar, Sreedal Menon, F. Zane","doi":"10.1145/2072298.2071914","DOIUrl":"https://doi.org/10.1145/2072298.2071914","url":null,"abstract":"This paper presents a novel method for sharing rectangular objects in a video conference. During these sessions, users often want to share a printed document or other planar rectangular objects (a photograph, the whiteboard on the wall, etc.) with the other participants. If the object is simply held in front of the camera (or if the camera is turned towards the object), the object will undergo perspective distortion and a rectangular object will appear in the video as a quadrilateral. In addition, a handheld document will not be steady and it will be difficult for other users to read its contents. In this paper, we present an algorithm that uses real-time predictive keystone correction to automatically lock on to object and present it with the proper orientation and shape.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116076775","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"From local features to local regions","authors":"Stefan Romberg","doi":"10.1145/2072298.2072487","DOIUrl":"https://doi.org/10.1145/2072298.2072487","url":null,"abstract":"Local features are omnipresent in computer vision applications and an important building block for applications like object recognition and image retrieval. Such applications often involve feature matching or use an inverted index to efficiently retrieve similar local features for a given query. In such cases it is commonly known that local features are often not informative yielding mismatches and false positives when used for feature matching (see Figure 1)or retrieval. As a result retrieval systems employ expensive post-retrieval verification steps. These observations underline the importance of embedding spatial information of a local image region directly within the index to decrease the number of false positives upon retrieval. We present our latest method for embedding spatial information into an index by bundling local feature triples for logo recognition. We give an overview of our feature representation, describe currently ongoing research and pose open questions for discussion.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"102 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121164916","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}