Proceedings of the 25th ACM international conference on Multimedia最新文献

筛选
英文 中文
Multirate Multimodal Video Captioning 多速率多模态视频字幕
Proceedings of the 25th ACM international conference on Multimedia Pub Date : 2017-10-23 DOI: 10.1145/3123266.3127904
Ziwei Yang, Youjiang Xu, Huiyun Wang, Bo Wang, Yahong Han
{"title":"Multirate Multimodal Video Captioning","authors":"Ziwei Yang, Youjiang Xu, Huiyun Wang, Bo Wang, Yahong Han","doi":"10.1145/3123266.3127904","DOIUrl":"https://doi.org/10.1145/3123266.3127904","url":null,"abstract":"Automatically describing videos with natural language is a crucial challenge of video understanding. Compared to images, videos have specific spatial-temporal structure and various modality information. In this paper, we propose a Multirate Multimodal Approach for video captioning. Considering that the speed of motion in videos varies constantly, we utilize a Multirate GRU to capture temporal structure of videos. It encodes video frames with different intervals and has a strong ability to deal with motion speed variance. As videos contain different modality cues, we design a particular multimodal fusion method. By incorporating visual, motion, and topic information together, we construct a well-designed video representation. Then the video representation is fed into a RNN-based language model for generating natural language descriptions. We evaluate our approach for video captioning on \"Microsoft Research - Video to Text\" (MSR-VTT), a large-scale video benchmark for video understanding. And our approach gets great performance on the 2nd MSR Video to Language Challenge.","PeriodicalId":201783,"journal":{"name":"Proceedings of the 25th ACM international conference on Multimedia","volume":"416 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123144999","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
Session details: Fast Forward 4 会话细节:快进4
Proceedings of the 25th ACM international conference on Multimedia Pub Date : 2017-10-23 DOI: 10.1145/3257935
C. Bhatt
{"title":"Session details: Fast Forward 4","authors":"C. Bhatt","doi":"10.1145/3257935","DOIUrl":"https://doi.org/10.1145/3257935","url":null,"abstract":"","PeriodicalId":201783,"journal":{"name":"Proceedings of the 25th ACM international conference on Multimedia","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116996075","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
LSVC2017: Large-Scale Video Classification Challenge LSVC2017:大规模视频分类挑战赛
Proceedings of the 25th ACM international conference on Multimedia Pub Date : 2017-10-23 DOI: 10.1145/3123266.3138874
Zuxuan Wu, Yu-Gang Jiang, L. Davis, Shih-Fu Chang
{"title":"LSVC2017: Large-Scale Video Classification Challenge","authors":"Zuxuan Wu, Yu-Gang Jiang, L. Davis, Shih-Fu Chang","doi":"10.1145/3123266.3138874","DOIUrl":"https://doi.org/10.1145/3123266.3138874","url":null,"abstract":"Recognizing visual contents in unconstrained videos has become a very important problem for many applications, such as Web video search and recommendation, smart advertising, robotics, etc. This workshop and challenge aims at exploring new challenges and approaches for large-scale video classification with large number of classes from open source videos in a realistic setting, based upon an extension of Fudan-Columbia Video Dataset (FCVID). This newly collected dataset contains over 8000 hours of video data from YouTube and Flicker, annotated into 500 categories. We hope this dataset can stimulate innovative research on this challenging and important problem.","PeriodicalId":201783,"journal":{"name":"Proceedings of the 25th ACM international conference on Multimedia","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117197316","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
MMHealth 2017: Workshop on Multimedia for Personal Health and Health Care MMHealth 2017:个人健康和保健多媒体研讨会
Proceedings of the 25th ACM international conference on Multimedia Pub Date : 2017-10-23 DOI: 10.1145/3123266.3132051
Susanne CJ Boll, T. Ebrahimi, C. Gurrin, Laleh Jalali, R. Jain, Jochen Meyer, N. O’Connor
{"title":"MMHealth 2017: Workshop on Multimedia for Personal Health and Health Care","authors":"Susanne CJ Boll, T. Ebrahimi, C. Gurrin, Laleh Jalali, R. Jain, Jochen Meyer, N. O’Connor","doi":"10.1145/3123266.3132051","DOIUrl":"https://doi.org/10.1145/3123266.3132051","url":null,"abstract":"Ever since the emergence of digitization, we've used the term multimedia to represent a combination of different kinds of media types, such as images, audio, and videos. As new sensing technologies emerge and are now becoming omnipresent in daily lives, the definition, role and significance of multimedia is changing. Multimedia now represents the means for communicating, cooperating, and also for monitoring numerous aspects of daily life, at various levels of granularity and application, ranging from personal to societal. With this shift, we have since moved from comprehending single media and its state toward comprehending media in terms of its use context. Multimedia is thus no longer confined to documentation and preservation, entertainment or personal media collections; rather, it has become an integral part of the tools and systems that are providing solutions to today's societal challenges--including challenges related to health, aging, education, societal participation, sustainable energy, and intelligent transportation. Multimedia has thus evolved into a core enabler for future interactive and cooperative applications at the heart of society. In this workshop we explore the relevance and contribution of multimedia to health care and personal media.","PeriodicalId":201783,"journal":{"name":"Proceedings of the 25th ACM international conference on Multimedia","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115990526","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Session details: Engagement 1 -- Multimedia Search and Recommendation 会议细节:参与1——多媒体搜索和推荐
Proceedings of the 25th ACM international conference on Multimedia Pub Date : 2017-10-23 DOI: 10.1145/3257929
Liangliang Cao
{"title":"Session details: Engagement 1 -- Multimedia Search and Recommendation","authors":"Liangliang Cao","doi":"10.1145/3257929","DOIUrl":"https://doi.org/10.1145/3257929","url":null,"abstract":"","PeriodicalId":201783,"journal":{"name":"Proceedings of the 25th ACM international conference on Multimedia","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129494286","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Summary for AVEC 2017: Real-life Depression and Affect Challenge and Workshop AVEC 2017总结:现实生活中的抑郁和情绪挑战和研讨会
Proceedings of the 25th ACM international conference on Multimedia Pub Date : 2017-10-23 DOI: 10.1145/3123266.3132049
F. Ringeval, Björn Schuller, M. Valstar, J. Gratch, R. Cowie, M. Pantic
{"title":"Summary for AVEC 2017: Real-life Depression and Affect Challenge and Workshop","authors":"F. Ringeval, Björn Schuller, M. Valstar, J. Gratch, R. Cowie, M. Pantic","doi":"10.1145/3123266.3132049","DOIUrl":"https://doi.org/10.1145/3123266.3132049","url":null,"abstract":"The seventh Audio-Visual Emotion Challenge and workshop AVEC 2017 was held in conjunction with ACM Multimedia'17. This year, the AVEC series addresses two distinct sub-challenges: emotion recognition and depression detection. The Affect Sub-Challenge is based on a novel dataset of human-human interactions recorded 'in-the-wild', whereas the Depression Sub-Challenge is based on the same dataset as the one used in AVEC 2016, with human-agent interactions. In this summary, we mainly describe participation and its conditions.","PeriodicalId":201783,"journal":{"name":"Proceedings of the 25th ACM international conference on Multimedia","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129428605","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Session details: Tutorials 会议详情:教程
Proceedings of the 25th ACM international conference on Multimedia Pub Date : 2017-10-23 DOI: 10.1145/3257955
R. Jain
{"title":"Session details: Tutorials","authors":"R. Jain","doi":"10.1145/3257955","DOIUrl":"https://doi.org/10.1145/3257955","url":null,"abstract":"","PeriodicalId":201783,"journal":{"name":"Proceedings of the 25th ACM international conference on Multimedia","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121551220","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Do Individuals Smile More in Diverse Social Company?: Studying Smiles and Diversity Via Social Media Photos 在不同的社交场合,人们会更容易微笑吗?:通过社交媒体照片研究微笑和多样性
Proceedings of the 25th ACM international conference on Multimedia Pub Date : 2017-10-23 DOI: 10.1145/3123266.3127908
Vivek K. Singh, Akanksha Atrey, Saket Hegde
{"title":"Do Individuals Smile More in Diverse Social Company?: Studying Smiles and Diversity Via Social Media Photos","authors":"Vivek K. Singh, Akanksha Atrey, Saket Hegde","doi":"10.1145/3123266.3127908","DOIUrl":"https://doi.org/10.1145/3123266.3127908","url":null,"abstract":"Photographs are one of the most fundamental ways for human beings to capture their social experiences and smiling is one of the most common actions associated with photo-taking. Photos, thus provide a unique opportunity to study the phenomena of mixing of different people and also the smiles expressed by individuals in these social settings. In this work, we study whether a social media-based computational framework can be employed to obtain smile and diversity scores at very fine, individual relationship resolution, and study their associations. We analyze two data sets from different social networks, Twitter and Instagram, over different time periods. Primarily looking at photographs, using computer vision APIs, we capture the diversity of social interactions in terms of age, gender, and race of those present, and smile levels. Analysis of both data sets suggest similar and significant findings: (a) people, in general, tend to smile more in the presence of others; and (b) people tend to smile more in a more diverse company. The results can help scale, test, and validate multiple theories related to affect and diversity in sociology, psychology, biology, and urban planning, and inform future mechanisms for encouraging people to smile more often in everyday settings","PeriodicalId":201783,"journal":{"name":"Proceedings of the 25th ACM international conference on Multimedia","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127562260","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
Cross-media Retrieval by Learning Rich Semantic Embeddings of Multimedia 学习多媒体丰富语义嵌入的跨媒体检索
Proceedings of the 25th ACM international conference on Multimedia Pub Date : 2017-10-23 DOI: 10.1145/3123266.3123369
Mengdi Fan, Wenmin Wang, Peilei Dong, Liang Han, Ronggang Wang, Ge Li
{"title":"Cross-media Retrieval by Learning Rich Semantic Embeddings of Multimedia","authors":"Mengdi Fan, Wenmin Wang, Peilei Dong, Liang Han, Ronggang Wang, Ge Li","doi":"10.1145/3123266.3123369","DOIUrl":"https://doi.org/10.1145/3123266.3123369","url":null,"abstract":"Cross-media retrieval aims at seeking the semantic association between different media types. Most existing methods paid much attention on learning mapping functions or finding the optimal spaces, but neglected how people accurately cognize images and texts. This paper proposes a brain inspired cross-media retrieval framework to learn rich semantic embeddings of multimedia. Different from directly using off-the-shelf image features, we combine the visual and descriptive senses for an image from the view of human perception via a joint model, called multi-sensory fusion network (MSFN). A topic model based TextNet maps texts into the same semantic space as images according to their shared ground truth labels. Moreover, in order to overcome the limitations of insufficient data for training neural networks and less complexity in text form, we introduce a large-scale image-text dataset, called Britannica dataset. Extensive experiments show the effectiveness of our framework for different lengths of texts on three benchmark datasets as well as Britannica dataset. Most of all, we report the best known average results of Img2Text and Text2Img compared with several state-of-the-art methods.","PeriodicalId":201783,"journal":{"name":"Proceedings of the 25th ACM international conference on Multimedia","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132639696","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
MANet: A Modal Attention Network for Describing Videos 描述视频的模态注意网络
Proceedings of the 25th ACM international conference on Multimedia Pub Date : 2017-10-23 DOI: 10.1145/3123266.3127898
Sang Phan Le, Yusuke Miyao, S. Satoh
{"title":"MANet: A Modal Attention Network for Describing Videos","authors":"Sang Phan Le, Yusuke Miyao, S. Satoh","doi":"10.1145/3123266.3127898","DOIUrl":"https://doi.org/10.1145/3123266.3127898","url":null,"abstract":"Exploiting multimodal features has become a standard approach towards many video applications, including the video captioning task. One problem with the existing work is that it models the relevance of each type of features evenly, which neutralizes the impact of each individual modality to the word to be generated. In this paper, we propose a novel Modal Attention Network (MANet) to account for this issue. Our MANet extends the standard encoder-decoder network by adapting the attention mechanism to video modalities. As a result, MANet emphasizes the impact of each modality with respect to the word to be generated. Experimental results show that our MANet effectively utilizes multimodal features to generate better video descriptions. Especially, our MANet system was ranked among the top three systems at the 2nd Video to Language Challenge in both automatic metrics and human evaluations.","PeriodicalId":201783,"journal":{"name":"Proceedings of the 25th ACM international conference on Multimedia","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133458482","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书