Proceedings of the 19th ACM international conference on Multimedia最新文献_第4页

JIGSAW: interactive mobile visual search with multimodal queries JIGSAW:具有多模式查询的交互式移动视觉搜索

Proceedings of the 19th ACM international conference on Multimedia Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072310

Yang Wang, Tao Mei, Jingdong Wang, Houqiang Li, Shipeng Li

{"title":"JIGSAW: interactive mobile visual search with multimodal queries","authors":"Yang Wang, Tao Mei, Jingdong Wang, Houqiang Li, Shipeng Li","doi":"10.1145/2072298.2072310","DOIUrl":"https://doi.org/10.1145/2072298.2072310","url":null,"abstract":"The traditional text-based visual search has not been sufficiently improved over the years to accommodate the new emerging demand of mobile users. While on the go, searching on one's phone is becoming pervasive. This paper presents an innovative application for mobile phone users to facilitate their visual search experience. By taking advantage of smart phone functionalities such as multi-modal and multi-touch interactions, users can more conveniently formulate their search intent, and thus search performance can be significantly improved. The system, called JIGSAW (Joint search with ImaGe, Speech, And Words), represents one of the first attempts to create an interactive and multi-modal mobile visual search application. The key of JIGSAW is the composition of an exemplary image query generated from the raw speech via multi-touch user interaction, as well as the visual search based on the exemplary image. Through JIGSAW, users can formulate their search intent in a natural way like playing a jigsaw puzzle on the phone screen: 1) a user speaks a natural sentence as the query, 2) the speech is recognized and transferred to text which is further decomposed to keywords through entity extraction, 3) the user selects preferred exemplary images that can visually represent his/her intent and composes a query image via multi-touch, and 4) the composite image is then used as a visual query to search similar images. We have deployed JIGSAW on a real-world phone system, evaluated the performance on one million images, and demonstrated that it is an effective complement to existing mobile visual search applications.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"77 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133740153","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 26

Location-aware system based on a dynamic 3D model to help in live broadcasting of sport events 基于动态3D模型的位置感知系统，有助于体育赛事的直播

Proceedings of the 19th ACM international conference on Multimedia Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071924

Roberto Yus, E. Mena, Jordi Bernad, S. Ilarri, A. Illarramendi

引用次数: 4

Reliving on demand: a total viewer experience 按需重温:一个完整的观众体验

Proceedings of the 19th ACM international conference on Multimedia Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072342

V. Singh, Jiebo Luo, D. Joshi, Phoury Lei, M. Das, Peter O. Stubler

{"title":"Reliving on demand: a total viewer experience","authors":"V. Singh, Jiebo Luo, D. Joshi, Phoury Lei, M. Das, Peter O. Stubler","doi":"10.1145/2072298.2072342","DOIUrl":"https://doi.org/10.1145/2072298.2072342","url":null,"abstract":"Billions of people worldwide use images and videos to capture various events in their lives. The primary purpose of the proposed media sharing application is digital re-living of those events by the photographers and their families and friends. The most popular tools for achieving this today are still static slide-shows (SSS) which primarily focus on visual effects rather than understanding the semantics of the media assets being used, or allowing different viewers (e.g. friends, family, who have different relationships, interests, time availabilities, and familiarities) any control over the flow of the show. We present a novel system that generates an aesthetically appealing and semantically drivable audio-visual media show based on several reliving dimensions of events, people, locations, and time. We allow each viewer to interact with the default presentation to 'on-the-fly' redirect the flow of reliving as desired from their individual perspectives. Moreover, each reliving session is logged and can be shared with other people over a wide array of platforms and devices, allowing sharing experience to go beyond the sharing of the media assets themselves. From a detailed analysis of the logged sessions across different user categories, we have obtained many interesting findings on the reliving needs, behaviors and patterns, which in turn validate our design motivations and principles.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115753711","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 6

Low-cost creation of a 3D interactive museum exhibition 低成本创建一个3D互动博物馆展览

Proceedings of the 19th ACM international conference on Multimedia Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072477

David S. Monaghan, James O'Sullivan, N. O’Connor, Bridget Kelly, Olivier Kazmierczak, Lorraine Comer

引用次数: 10

Galaxy browser: exploratory search of web videos 银河浏览器:探索性搜索网络视频

Proceedings of the 19th ACM international conference on Multimedia Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072467

Lei Pang, Song Tan, Hung-Khoon Tan, C. Ngo

引用次数: 3

Digital media distribution: the future 数字媒体发行:未来

Proceedings of the 19th ACM international conference on Multimedia Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072376

A. Robert

引用次数: 0

A VLC media player plugin enabling dynamic adaptive streaming over HTTP 一个VLC媒体播放器插件，支持HTTP上的动态自适应流

Proceedings of the 19th ACM international conference on Multimedia Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072429

Christopher Müller, C. Timmerer

引用次数: 112

Innovating the multimedia experience 创新多媒体体验

Proceedings of the 19th ACM international conference on Multimedia Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072384

K. El-Maleh, Haohong Wang, Susie Wee, H. Yu, James D. Johnston, Zhengyou Zhang

引用次数: 1

Analysis, indexing and visualization of presentation videos 分析，索引和可视化演示视频

Proceedings of the 19th ACM international conference on Multimedia Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072499

Michele Merler

{"title":"Analysis, indexing and visualization of presentation videos","authors":"Michele Merler","doi":"10.1145/2072298.2072499","DOIUrl":"https://doi.org/10.1145/2072298.2072499","url":null,"abstract":"The exponential diffusion of unstructured multimedia content on sites such as YouTube has lately fostered a rapid growth of interest in the multimedia community toward a new line of systems to recognize visual content \"in the wild\", that is, in less structured, unconstrained and more realistic domains. Due to the lack of structure and to the low quality of the data, algorithms and paradigms designed for professional content often cannot directly be applied to the aforementioned domains, thus presenting a new challenge. One particular instance of such \"wild videos\" is represented by unstructured presentation videos, which are tools nowadays employed in a large variety of systems for different purposes, spanning from distance or e-learning to generation of conference proceedings, from corporate talks to student presentations. We are interested in helping users efficiently and effectively access visual information, in particular technical information, and learn from such online multimedia sources. Our proposed system aims at summarizing, indexing, cross- referencing and browsing unstructured (\"wild\") presentation videos, with a focus on the quality of the produced indexes as perceived by the end users.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"144 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125900952","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Towards textually describing complex video contents with audio-visual concept classifiers 利用视听概念分类器对复杂视频内容进行文本化描述

Proceedings of the 19th ACM international conference on Multimedia Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072411

Chun-Chet Tan, Yu-Gang Jiang, C. Ngo

引用次数: 41