Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval最新文献

筛选
英文 中文
A Short Survey of Recent Advances in Graph Matching 图匹配的最新进展综述
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912035
Junchi Yan, Xu-Cheng Yin, Weiyao Lin, Cheng Deng, H. Zha, Xiaokang Yang
{"title":"A Short Survey of Recent Advances in Graph Matching","authors":"Junchi Yan, Xu-Cheng Yin, Weiyao Lin, Cheng Deng, H. Zha, Xiaokang Yang","doi":"10.1145/2911996.2912035","DOIUrl":"https://doi.org/10.1145/2911996.2912035","url":null,"abstract":"Graph matching, which refers to a class of computational problems of finding an optimal correspondence between the vertices of graphs to minimize (maximize) their node and edge disagreements (affinities), is a fundamental problem in computer science and relates to many areas such as combinatorics, pattern recognition, multimedia and computer vision. Compared with the exact graph (sub)isomorphism often considered in a theoretical setting, inexact weighted graph matching receives more attentions due to its flexibility and practical utility. A short review of the recent research activity concerning (inexact) weighted graph matching is presented, detailing the methodologies, formulations, and algorithms. It highlights the methods under several key bullets, e.g. how many graphs are involved, how the affinity is modeled, how the problem order is explored, and how the matching procedure is conducted etc. Moreover, the research activity at the forefront of graph matching applications especially in computer vision, multimedia and machine learning is reported. The aim is to provide a systematic and compact framework regarding the recent development and the current state-of-the-arts in graph matching.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"1 3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116797761","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 153
Image Annotation using Multi-scale Hypergraph Heat Diffusion Framework 基于多尺度超图热扩散框架的图像标注
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912055
V. N. Murthy, Avinash Sharma, Visesh Chari, R. Manmatha
{"title":"Image Annotation using Multi-scale Hypergraph Heat Diffusion Framework","authors":"V. N. Murthy, Avinash Sharma, Visesh Chari, R. Manmatha","doi":"10.1145/2911996.2912055","DOIUrl":"https://doi.org/10.1145/2911996.2912055","url":null,"abstract":"The task of automatic image annotation involves assigning relevant multiple labels/tags to query images based on their visual content. One of the key challenge in multi-label image annotation task is the class imbalance problem where frequently occurring labels suppress the participation of rarely occurring labels. In this paper, we propose to exploit the multi-scale behavior in hypergraph heat diffusion framework for the automatic image annotation task. The proposed novel technique enables to model the higher order relationship among images in the feature space and provides a multi-scale label diffusion mechanism to address the class imbalance problem in the data.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"246 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121876116","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 14
Recurrent Support Vector Machines for Audio-Based Multimedia Event Detection 基于音频的多媒体事件检测的循环支持向量机
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912048
Yun Wang, Florian Metze
{"title":"Recurrent Support Vector Machines for Audio-Based Multimedia Event Detection","authors":"Yun Wang, Florian Metze","doi":"10.1145/2911996.2912048","DOIUrl":"https://doi.org/10.1145/2911996.2912048","url":null,"abstract":"Multimedia event detection (MED) is the task of detecting given events (e.g. parade, birthday party) in a large collection of video clips. While the most useful information comes from visual features and speech recognition, a lot can also be inferred from the non-speech audio content, either alone or in conjunction with visual and speech cues. This paper studies MED with non-speech audio information only. MED is usually performed in two stages. The first stage generates a representation for each clip in the form of either a single vector or a sequence of vectors, often by aggregating frame-level features; the second stage performs binary or multi-class classification to decide whether each target event occurs in each clip. Common classifiers used for the second stage include support vector machines (SVMs), feed-forward deep neural networks (DNNs), and recurrent neural networks (RNNs). In this paper, we propose to classify clips for events using \"recurrent SVMs\". These models combine the kernel mapping and the large-margin optimization criterion of SVMs, and the ability to process sequences of variable lengths of RNNs. Reinforced with data augmentation, recurrent SVMs have achieved higher mean average precision (MAP) on the TRECVID 2011 MED task than both SVMs and RNNs.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131069020","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Audiovisual Summarization of Lectures and Meetings Using a Segment Similarity Graph 使用片段相似图对讲座和会议进行视听总结
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912047
C. Bhatt, Andrei Popescu-Belis, Matthew L. Cooper
{"title":"Audiovisual Summarization of Lectures and Meetings Using a Segment Similarity Graph","authors":"C. Bhatt, Andrei Popescu-Belis, Matthew L. Cooper","doi":"10.1145/2911996.2912047","DOIUrl":"https://doi.org/10.1145/2911996.2912047","url":null,"abstract":"We propose a method for extractive summarization of audiovisual recordings focusing on topic-level segments. We first build a content similarity graph between all segments across the collection, using word vectors from the transcripts, and then select the most central segments for the summaries. We evaluate the method quantitatively on the AMI Meeting Corpus using gold standard reference summaries and the Rouge metric, and qualitatively on lecture recordings using a novel two-tiered approach with human judges. The results show that our method compares favorably with others in terms of Rouge, and outperforms the baselines for human scores, thus also validating our evaluation protocol.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131082828","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Human's Scene Sketch Understanding 人类对场景素描的理解
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912067
Y. Ye, Yijuan Lu, Hao Jiang
{"title":"Human's Scene Sketch Understanding","authors":"Y. Ye, Yijuan Lu, Hao Jiang","doi":"10.1145/2911996.2912067","DOIUrl":"https://doi.org/10.1145/2911996.2912067","url":null,"abstract":"Human's sketch understanding is important. It has many applications in human computer interaction, multimedia, and computer vision. Recognizing human sketches is also challenging. Previous methods focus on single-object sketch recognition. Understanding human's scene sketch that involves multiple objects and their complex interactions has not been explored. In this paper, we tackle this new problem. We create the first scene sketch dataset \"Scene250\" and propose a deep learning method to understand human scene sketches. We propose \"Scene-Net\", a new deep convolutional neural network (CNN) structure, based on which we build a novel scene sketch recognition system. Our system has been tested on the collected scene sketch dataset and compared with other state-of-the-art CNNs and sketch recognition approaches. Our experimental results demonstrate that our method achieves the state of art.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114405086","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
A Quality Adaptive Multimodal Affect Recognition System for User-Centric Multimedia Indexing 以用户为中心的多媒体索引质量自适应多模态影响识别系统
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912059
Rishabh Gupta, M. K. Abadi, Jesús Alejandro Cárdenes Cabré, Fabio Morreale, T. Falk, N. Sebe
{"title":"A Quality Adaptive Multimodal Affect Recognition System for User-Centric Multimedia Indexing","authors":"Rishabh Gupta, M. K. Abadi, Jesús Alejandro Cárdenes Cabré, Fabio Morreale, T. Falk, N. Sebe","doi":"10.1145/2911996.2912059","DOIUrl":"https://doi.org/10.1145/2911996.2912059","url":null,"abstract":"The recent increase in interest for online multimedia streaming platforms has availed massive amounts of multimedia information that need to be indexed to be searchable and retrievable. User-centric implicit affective indexing employing emotion detection based on psycho-physiological signals, such as electrocardiography (ECG), galvanic skin response (GSR), electroencephalography (EEG) and face tracking, has recently gained attention. However, real world psycho-physiological signals obtained from wearable devices and facial trackers are contaminated by various noise sources that can result in spurious emotion detection. Therefore, in this paper we propose the development of psycho-physiological signal quality estimators for unimodal affect recognition systems. The presented systems perform adequately in classifying users affect however, they resulted in high failure rates due to rejection of bad quality samples. Thus, to reduce the affect recognition failure rate, a quality adaptive multimodal fusion scheme is proposed. The proposed scheme yields no failure, while at the same time classify the users' arousal/valence and liking with significantly above chance weighted F1-scores in a cross-user experiment. Another finding of this study is that head movements encode liking perception of users in response to music snippets. This work also includes the release of the employed dataset including psycho-physiological signals, their quality annotations, and users' affective self-assessments.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114459300","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 27
On the Effects of Spam Filtering and Incremental Learning for Web-Supervised Visual Concept Classification 垃圾邮件过滤和增量学习对网络监督视觉概念分类的影响
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912072
Matthias Springstein, R. Ewerth
{"title":"On the Effects of Spam Filtering and Incremental Learning for Web-Supervised Visual Concept Classification","authors":"Matthias Springstein, R. Ewerth","doi":"10.1145/2911996.2912072","DOIUrl":"https://doi.org/10.1145/2911996.2912072","url":null,"abstract":"Deep neural networks have been successfully applied to the task of visual concept classification. However, they require a large number of training examples for learning. Although pre-trained deep neural networks are available for some domains, they usually have to be fine-tuned for an envisaged target domain. Recently, some approaches have been suggested that are aimed at incrementally (or even endlessly) learning visual concepts based on Web data. Since tags of Web images are often noisy, normally some filtering mechanisms are employed in order to remove ``spam'' images that are not appropriate for training. In this paper, we investigate several aspects of a web-supervised system that has to be adapted to another target domain: 1.) the effect of incremental learning, 2.) the effect of spam filtering, and 3.) the behavior of particular concept classes with respect to 1.) and 2.). The experimental results provide some insights under which conditions incremental learning and spam filtering are useful.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"91 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116103826","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Large-Scale E-Commerce Image Retrieval with Top-Weighted Convolutional Neural Networks 基于顶加权卷积神经网络的大规模电子商务图像检索
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912052
Shichao Zhao, Youjiang Xu, Yahong Han
{"title":"Large-Scale E-Commerce Image Retrieval with Top-Weighted Convolutional Neural Networks","authors":"Shichao Zhao, Youjiang Xu, Yahong Han","doi":"10.1145/2911996.2912052","DOIUrl":"https://doi.org/10.1145/2911996.2912052","url":null,"abstract":"Several recent researches have shown that image features produced by Convolutional Neural Networks (CNNs) provide the state-of-the-art performance for image classification and retrieval. Moreover, some researchers have found that the features extracted from the deep convolutional layers of CNNs perform better than that from the fully-connected layers. Features extracted from the convolutional layers have a natural interpretation: descriptors of local image regions correspond well to the receptive fields of the particular features. In order to obtain both representative and discriminative descriptors for large-scale e-commerce image retrieval, we come up with a new feature extraction framework. At first, we propose the Top-Weight method to detect the interesting area of e-commerce images automatically. With the estimated weight, we then aggregate local deep features and produce high-quality global representation for e-commerce image retrieval. We have conducted experiments on an e-commerce dataset ALISC [1] released by Alibaba Group. Experimental results show that our method outperforms other deep learning based methods.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"58 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124511542","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Correlation Autoencoder Hashing for Supervised Cross-Modal Search 监督跨模态搜索的相关自编码器哈希
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912000
Yue Cao, Mingsheng Long, Jianmin Wang, Han Zhu
{"title":"Correlation Autoencoder Hashing for Supervised Cross-Modal Search","authors":"Yue Cao, Mingsheng Long, Jianmin Wang, Han Zhu","doi":"10.1145/2911996.2912000","DOIUrl":"https://doi.org/10.1145/2911996.2912000","url":null,"abstract":"Due to its storage and query efficiency, hashing has been widely applied to approximate nearest neighbor search from large-scale datasets. While there is increasing interest in cross-modal hashing which facilitates cross-media retrieval by embedding data from different modalities into a common Hamming space, how to distill the cross-modal correlation structure effectively remains a challenging problem. In this paper, we propose a novel supervised cross-modal hashing method, Correlation Autoencoder Hashing (CAH), to learn discriminative and compact binary codes based on deep autoencoders. Specifically, CAH jointly maximizes the feature correlation revealed by bimodal data and the semantic correlation conveyed in similarity labels, while embeds them into hash codes by nonlinear deep autoencoders. Extensive experiments clearly show the superior effectiveness and efficiency of CAH against the state-of-the-art hashing methods on standard cross-modal retrieval benchmarks.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"128 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128138267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 87
Personalized Retrieval and Browsing of Classical Music and Supporting Multimedia Material 古典音乐及辅助多媒体资料的个人化检索与浏览
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912023
M. Tkalcic, M. Schedl, Cynthia C. S. Liem, M. Melenhorst
{"title":"Personalized Retrieval and Browsing of Classical Music and Supporting Multimedia Material","authors":"M. Tkalcic, M. Schedl, Cynthia C. S. Liem, M. Melenhorst","doi":"10.1145/2911996.2912023","DOIUrl":"https://doi.org/10.1145/2911996.2912023","url":null,"abstract":"This paper reports on three demonstrators developed to provide personalized, enhanced experiences of classical music, within the EU FP7 project \"Performances as Highly Enriched aNd Interactive Concert eXperiences\" (PHENICX): (i) an interface for accessing supplemental multimodal material about music items, (ii) a recommender system for visualizations of classical music, and (iii) a recommender system for tagging. The personalization in all three demos is achieved through modeling users' personality and musical sophistication. The links to the web interfaces are provided as well as the outcomes of quantitative and qualitative evaluations.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"8 2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128944749","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书