Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval最新文献

筛选
英文 中文
Combining Holistic and Part-based Deep Representations for Computational Painting Categorization 结合整体和基于部分的深度表示的计算绘画分类
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912063
R. Anwer, F. Khan, Joost van de Weijer, Jorma T. Laaksonen
{"title":"Combining Holistic and Part-based Deep Representations for Computational Painting Categorization","authors":"R. Anwer, F. Khan, Joost van de Weijer, Jorma T. Laaksonen","doi":"10.1145/2911996.2912063","DOIUrl":"https://doi.org/10.1145/2911996.2912063","url":null,"abstract":"Automatic analysis of visual art, such as paintings, is a challenging inter-disciplinary research problem. Conventional approaches only rely on global scene characteristics by encoding holistic information for computational painting categorization. We argue that such approaches are sub-optimal and that discriminative common visual structures provide complementary information for painting classification. We present an approach that encodes both the global scene layout and discriminative latent common structures for computational painting categorization. The region of interests are automatically extracted, without any manual part labeling, by training class-specific deformable part-based models. Both holistic and region-of-interests are then described using multi-scale dense convolutional features. These features are pooled separately using Fisher vector encoding and concatenated afterwards in a single image representation. Experiments are performed on a challenging dataset with 91 different painters and 13 diverse painting styles. Our approach outperforms the standard method, which only employs the global scene characteristics. Furthermore, our method achieves state-of-the-art results outperforming a recent multi-scale deep features based approach by $6.4%$ and $3.8%$ respectively on artist and style classification.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123937367","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 25
Learning Music Embedding with Metadata for Context Aware Recommendation 基于上下文感知推荐的元数据音乐嵌入学习
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912045
Dongjing Wang, Shuiguang Deng, X. Zhang, Guandong Xu
{"title":"Learning Music Embedding with Metadata for Context Aware Recommendation","authors":"Dongjing Wang, Shuiguang Deng, X. Zhang, Guandong Xu","doi":"10.1145/2911996.2912045","DOIUrl":"https://doi.org/10.1145/2911996.2912045","url":null,"abstract":"Contextual factors can benefit music recommendation and retrieval tasks remarkably. However, how to acquire and utilize the contextual information still need to be studied. In this paper, we propose a context aware music recommendation approach, which can recommend music appropriate for users' contextual preference for music. In analogy to matrix factorization methods for collaborative filtering, the proposed approach does not require songs to be described by features beforehand, but it learns music pieces' embeddings (vectors in low-dimensional continuous space) from music playing records and corresponding metadata and infer users' general and contextual preference for music from their playing records with the learned embedding. Then, our approach can recommend appropriate music pieces. Experimental evaluations on a real world dataset show that the proposed approach outperforms baseline methods.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115269681","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 28
New Frontiers of Large Scale Multimedia Information Retrieval 大规模多媒体信息检索的新前沿
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2930063
Shih-Fu Chang
{"title":"New Frontiers of Large Scale Multimedia Information Retrieval","authors":"Shih-Fu Chang","doi":"10.1145/2911996.2930063","DOIUrl":"https://doi.org/10.1145/2911996.2930063","url":null,"abstract":"Multimedia information retrieval aims to automatically extract useful information from large collection of images, videos, and combinations with other data like text and speech. As reported in recent news, it's now possible to search information over millions or more of products with just an example image on the mobile phone. Intelligent apps are being deployed by major companies to automatically generate keywords or even captions of an image at a sophistication level that could not be imagined before. In this talk, I will review core technologies involved and discuss challenges and opportunities ahead. First, to address the complexity bottleneck when scaling up the data size, I will present extremely compact hash codes and deep learning image classification models that can reduce complexity by orders of magnitude while preserving approximate accuracy. Second, to support easy extension of recognition systems to new domains, instead of relying on fixed image categories, we introduce a new paradigm to automatically discover unique multimodal concepts and structures using large amounts of multimedia data available. Last, to support emerging applications beyond basic image categorization, I will discuss on-going efforts in understanding how images are used in expressing sentiments and emotions in online social media and how languages/cultures may influence such online multimedia communication.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114143365","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
The Science and Detection of Tilting 倾斜的科学与检测
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912019
Xingjie Wei, Jussi Palomäki, Jeff Yan, P. Robinson
{"title":"The Science and Detection of Tilting","authors":"Xingjie Wei, Jussi Palomäki, Jeff Yan, P. Robinson","doi":"10.1145/2911996.2912019","DOIUrl":"https://doi.org/10.1145/2911996.2912019","url":null,"abstract":"Tilting refers to losing control due to negative emotions, behaving erratically, and thereby suffering adverse consequences. The term tilt originated in poker playing communities, where it is often a consequence of so called bad beats, i.e. losing with an unlikely-to-lose poker hand. Often resulting in devastating monetary losses, tilting is ubiquitous and well known in poker, but rarely studied despite its significance. In this paper, we argue that tilting is a fertile topic for interdisciplinary research both for psychologists and computer scientists. Specifically, we propose to study the manifestation of tilting via facial emotion expressions, and motivate the development of an automatic tilt-detection system. The scientific understanding of the psychology of tilting can be increased via a computing approach, which has not been previously attempted. Automatic tilting detection will lead to a practical technology that reduces poker players' monetary losses and improves their well being through reduced tilting. We also argue that while tilting is best known as a poker phenomenon, it also exists in other contexts. Thus, the idea we suggest is a novel application of computer vision, affective computing and multimedia technologies in the real world, across many domains.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"78 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126236141","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Scaling Group Testing Similarity Search 缩放组测试相似度搜索
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912010
Ahmet Iscen, L. Amsaleg, T. Furon
{"title":"Scaling Group Testing Similarity Search","authors":"Ahmet Iscen, L. Amsaleg, T. Furon","doi":"10.1145/2911996.2912010","DOIUrl":"https://doi.org/10.1145/2911996.2912010","url":null,"abstract":"The large dimensionality of modern image feature vectors, up to thousands of dimensions, is challenging the high dimensional indexing techniques. Traditional approaches fail at returning good quality results within a response time that is usable in practice. However, similarity search techniques inspired by the group testing framework have recently been proposed in an attempt to specifically defeat the curse of dimensionality. Yet, group testing does not scale and fails at indexing very large collections of images because its internal procedures analyze an excessively large fraction of the indexed data collection. This paper identifies these difficulties and proposes extensions to the group testing framework for similarity searches that allow to handle larger collections of feature vectors. We demonstrate that it can return high quality results much faster compared to state-of-the-art group testing strategies when indexing truly high-dimensional features that are indeed hardly indexable with traditional indexing approaches.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126795268","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Bidirectional Joint Representation Learning with Symmetrical Deep Neural Networks for Multimodal and Crossmodal Applications 基于对称深度神经网络的双向联合表示学习在多模态和跨模态中的应用
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912064
V. Vukotic, C. Raymond, G. Gravier
{"title":"Bidirectional Joint Representation Learning with Symmetrical Deep Neural Networks for Multimodal and Crossmodal Applications","authors":"V. Vukotic, C. Raymond, G. Gravier","doi":"10.1145/2911996.2912064","DOIUrl":"https://doi.org/10.1145/2911996.2912064","url":null,"abstract":"Common approaches to problems involving multiple modalities (classification, retrieval, hyperlinking, etc.) are early fusion of the initial modalities and crossmodal translation from one modality to the other. Recently, deep neural networks, especially deep autoencoders, have proven promising both for crossmodal translation and for early fusion via multimodal embedding. In this work, we propose a flexible crossmodal deep neural network architecture for multimodal and crossmodal representation. By tying the weights of two deep neural networks, symmetry is enforced in central hidden layers thus yielding a multimodal representation space common to the two original representation spaces. The proposed architecture is evaluated in multimodal query expansion and multimodal retrieval tasks within the context of video hyperlinking. Our method demonstrates improved crossmodal translation capabilities and produces a multimodal embedding that significantly outperforms multimodal embeddings obtained by deep autoencoders, resulting in an absolute increase of 14.14 in precision at 10 on a video hyperlinking task.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"510 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131510194","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 43
Vinereactor: Crowdsourced Spontaneous Facial Expression Data Vinereactor:众包自发面部表情数据
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912038
Edward Kim, Shruthika Vangala
{"title":"Vinereactor: Crowdsourced Spontaneous Facial Expression Data","authors":"Edward Kim, Shruthika Vangala","doi":"10.1145/2911996.2912038","DOIUrl":"https://doi.org/10.1145/2911996.2912038","url":null,"abstract":"Although machines are more pervasive in our everyday lives, we are still forced to interact with them through limited communication channels. Our overarching goal is to support new and complex interactions by teaching the computer to interpret the expressions of the user. Towards this goal, we present Vinereactor, a new labeled database for face analysis and affect recognition. Our dataset is one of the first to explore human expression recognition in response to a stimulus video, enabling a new facet of affect analysis research. Furthermore, our dataset is the largest of its kind, nearly a magnitude larger than its closest related work.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131834613","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
An Automated End-To-End Pipeline for Fine-Grained Video Annotation using Deep Neural Networks 基于深度神经网络的细粒度视频注释自动化端到端管道
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912028
Baptist Vandersmissen, Lucas Sterckx, T. Demeester, A. Jalalvand, W. D. Neve, R. Walle
{"title":"An Automated End-To-End Pipeline for Fine-Grained Video Annotation using Deep Neural Networks","authors":"Baptist Vandersmissen, Lucas Sterckx, T. Demeester, A. Jalalvand, W. D. Neve, R. Walle","doi":"10.1145/2911996.2912028","DOIUrl":"https://doi.org/10.1145/2911996.2912028","url":null,"abstract":"The searchability of video content is often limited to the descriptions authors and/or annotators care to provide. The level of description can range from absolutely nothing to fine-grained annotations at the level of frames. Based on these annotations, certain parts of the video content are more searchable than others. Within the context of the STEAMER project, we developed an innovative end-to-end system that attempts to tackle the problem of unsupervised retrieval of news video content, leveraging multiple information streams and deep neural networks. In particular, we extracted keyphrases and named entities from transcripts, subsequently refining these keyphrases and named entities based on their visual appearance in the news video content. Moreover, to allow for fine-grained frame-level annotations, we temporally located high-confidence keyphrases in the news video content. To that end, we had to tackle challenges such as the automatic construction of training sets and the automatic assessment of keyphrase imageability. In this paper, we discuss the main components of our end-to-end system, capable of transforming textual and visual information into fine-grained video annotations.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"110 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131957433","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Diverse Concept-Level Features for Multi-Object Classification 多目标分类的不同概念级特征
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912013
Y. Tamaazousti, H. Borgne, C. Hudelot
{"title":"Diverse Concept-Level Features for Multi-Object Classification","authors":"Y. Tamaazousti, H. Borgne, C. Hudelot","doi":"10.1145/2911996.2912013","DOIUrl":"https://doi.org/10.1145/2911996.2912013","url":null,"abstract":"We consider the problem of image classification with semantic features that are built from a set of base classifier outputs, each reflecting visual concepts. However, existing approaches consider visual concepts independently from each other whereas they are often linked together. When those relations are considered, existing models strongly rely on image low-level features, yielding in irrelevant relations when the low-level representation fails. On the contrary, the approach we propose, uses existing human knowledge, the application context itself and the human categorization mechanism to reflect complex relations between concepts. By nesting this human knowledge and the application context in the concept detection and selection processes, our final semantic feature captures the most useful information for an effective categorization. Thus, it enables to give good representation, even if some important concepts failed to be recognized. Experimental validation is conducted on three publicly available benchmarks of multi-class object classification and leads to results that outperforms comparable approaches.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131656825","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Web Video Popularity Prediction using Sentiment and Content Visual Features 基于情感和内容视觉特征的网络视频流行度预测
Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval Pub Date : 2016-06-06 DOI: 10.1145/2911996.2912053
Giulia Fontanini, M. Bertini, A. Bimbo
{"title":"Web Video Popularity Prediction using Sentiment and Content Visual Features","authors":"Giulia Fontanini, M. Bertini, A. Bimbo","doi":"10.1145/2911996.2912053","DOIUrl":"https://doi.org/10.1145/2911996.2912053","url":null,"abstract":"Hundreds of hours of videos are uploaded every minute on YouTube and other video sharing sites: some will be viewed by millions of people and other will go unnoticed by all but the uploader. In this paper we propose to use visual sentiment and content features to predict the popularity of web videos. The proposed approach outperforms current state-of-the-art methods on two publicly available datasets.","PeriodicalId":201992,"journal":{"name":"Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130706583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 27
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书