Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing最新文献

The effect of different video summarization models on the quality of video recommendation based on low-level visual features 基于底层视觉特征的不同视频摘要模型对视频推荐质量的影响

Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing Pub Date : 2017-06-19 DOI: 10.1145/3095713.3095734

Yashar Deldjoo, P. Cremonesi, M. Schedl, Massimo Quadrana

引用次数: 14

Tag Propagation Approaches within Speaking Face Graphs for Multimodal Person Discovery 面向多模态人物发现的说话人脸图中的标签传播方法

Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing Pub Date : 2017-06-19 DOI: 10.1145/3095713.3095729

G. B. Fonseca, I. Freire, Zenilton K. G. Patrocínio, S. Guimarães, G. Sargent, R. Sicre, G. Gravier

{"title":"Tag Propagation Approaches within Speaking Face Graphs for Multimodal Person Discovery","authors":"G. B. Fonseca, I. Freire, Zenilton K. G. Patrocínio, S. Guimarães, G. Sargent, R. Sicre, G. Gravier","doi":"10.1145/3095713.3095729","DOIUrl":"https://doi.org/10.1145/3095713.3095729","url":null,"abstract":"The indexing of broadcast TV archives is a current problem in multimedia research. As the size of these databases grows continuously, meaningful features are needed to describe and connect their elements efficiently, such as the identification of speaking faces. In this context, this paper focuses on two approaches for unsupervised person discovery. Initial tagging of speaking faces is provided by an OCR-based method, and these tags propagate through a graph model based on audiovisual relations between speaking faces. Two propagation methods are proposed, one based on random walks and the other based on a hierarchical approach. To better evaluate their performances, these methods were compared with two graph clustering baselines. We also study the impact of different modality fusions on the graph-based tag propagation scenario. From a quantitative analysis, we observed that the graph propagation techniques always outperform the baselines. Among all compared strategies, the methods based on hierarchical propagation with late fusion and random walk with score-fusion obtained the highest MAP values. Finally, even though these two methods produce highly equivalent results according to Kappa coefficient, the random walk method performs better according to a paired t-test, and the computing time for the hierarchical propagation is more than 4 times lower than the one for the random walk propagation.","PeriodicalId":310224,"journal":{"name":"Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing","volume":"141 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114457048","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

Semi-automatic Video Assessment System 半自动视频评估系统

Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing Pub Date : 2017-06-19 DOI: 10.1145/3095713.3095748

Pedro Martins, N. Correia

引用次数: 3

Efficient Approximate Medoids of Temporal Sequences 时间序列的有效近似介质

Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing Pub Date : 2017-06-19 DOI: 10.1145/3095713.3095717

W. Bailer

引用次数: 0

Detection and Classification of Bleeding Region in WCE Images using Color Feature 基于颜色特征的WCE图像出血区域检测与分类

Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing Pub Date : 2017-06-19 DOI: 10.1145/3095713.3095731

S. Suman, F. Hussin, A. Malik, Konstantin Pogorelov, M. Riegler, Shiaw-Hooi Ho, I. Hilmi, K. Goh

引用次数: 35

Detecting adversarial example attacks to deep neural networks 检测对深度神经网络的对抗性示例攻击

Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing Pub Date : 2017-06-19 DOI: 10.1145/3095713.3095753

F. Carrara, F. Falchi, R. Caldelli, Giuseppe Amato, Roberta Fumarola, Rudy Becarelli

引用次数: 33

Connoisseur: classification of styles of Mexican architectural heritage with deep learning and visual attention prediction 鉴赏家:用深度学习和视觉注意力预测对墨西哥建筑遗产的风格进行分类

Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing Pub Date : 2017-06-19 DOI: 10.1145/3095713.3095730

A. M. Obeso, M. García-Vázquez, A. A. Ramírez-Acosta, J. Benois-Pineau

{"title":"Connoisseur: classification of styles of Mexican architectural heritage with deep learning and visual attention prediction","authors":"A. M. Obeso, M. García-Vázquez, A. A. Ramírez-Acosta, J. Benois-Pineau","doi":"10.1145/3095713.3095730","DOIUrl":"https://doi.org/10.1145/3095713.3095730","url":null,"abstract":"The automatic description of multimedia content was mainly developed for classification tasks, retrieval systems and massive ordering of data. Preservation of cultural heritage is a field of high importance for application to this method. Our problem is classification of architectural styles of buildings in digital photographs of Mexican cultural heritage. The selection of relevant content in the scene for training classification models allows them to be more precise in the classification task. Here we use a saliency-driven approach to predict visual attention in images and use it to train a Convolutional Neural Network to identify the architectural style of Mexican buildings. Also, we present an analysis of the behavior of the models trained under the traditional cropped image and the prominence maps. In this sense, we show that the performance of the saliency-based CNNs is better than the traditional training reaching a classification rate of 97% in validation dataset. It is considered that style identification with this technique can make a wide contribution in video description tasks, specifically in the automatic documentation of Mexican cultural heritage.","PeriodicalId":310224,"journal":{"name":"Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116367970","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 28

Towards large scale multimedia indexing: A case study on person discovery in broadcast news 迈向大规模多媒体索引:以广播新闻中的人物发现为例

Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing Pub Date : 2017-06-19 DOI: 10.1145/3095713.3095732

N. Le, H. Bredin, G. Sargent, Miquel India, Paula Lopez-Otero, C. Barras, Camille Guinaudeau, G. Gravier, G. B. Fonseca, I. Freire, Zenilton K. G. Patrocínio, S. Guimarães, Gerard Martí, J. Morros, J. Hernando, Laura Docío Fernández, C. García-Mateo, S. Meignier, J. Odobez

{"title":"Towards large scale multimedia indexing: A case study on person discovery in broadcast news","authors":"N. Le, H. Bredin, G. Sargent, Miquel India, Paula Lopez-Otero, C. Barras, Camille Guinaudeau, G. Gravier, G. B. Fonseca, I. Freire, Zenilton K. G. Patrocínio, S. Guimarães, Gerard Martí, J. Morros, J. Hernando, Laura Docío Fernández, C. García-Mateo, S. Meignier, J. Odobez","doi":"10.1145/3095713.3095732","DOIUrl":"https://doi.org/10.1145/3095713.3095732","url":null,"abstract":"The rapid growth of multimedia databases and the human interest in their peers make indices representing the location and identity of people in audio-visual documents essential for searching archives. Person discovery in the absence of prior identity knowledge requires accurate association of audio-visual cues and detected names. To this end, we present 3 different strategies to approach this problem: clustering-based naming, verification-based naming, and graph-based naming. Each of these strategies utilizes different recent advances in unsupervised face / speech representation, verification, and optimization. To have a better understanding of the approaches, this paper also provides a quantitative and qualitative comparative study of these approaches using the associated corpus of the Person Discovery challenge at MediaEval 2016. From the results of our experiments, we can observe the pros and cons of each approach, thus paving the way for future promising research directions.","PeriodicalId":310224,"journal":{"name":"Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129548910","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 13

Music Feature Maps with Convolutional Neural Networks for Music Genre Classification 基于卷积神经网络的音乐类型分类特征映射

Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing Pub Date : 2017-06-19 DOI: 10.1145/3095713.3095733

Christine Sénac, Thomas Pellegrini, Florian Mouret, J. Pinquier

引用次数: 51

Live Collaborative Social-Media Video Timelines 实时协作社交媒体视频时间表

Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing Pub Date : 2017-06-19 DOI: 10.1145/3095713.3095750

Rui Queiros, N. Correia, João Magalhães

引用次数: 1