2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR)最新文献_第9页

Multimodal Image Captioning for Marketing Analysis 营销分析的多模态图像字幕

2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) Pub Date : 2018-02-06 DOI: 10.1109/MIPR.2018.00035

Philipp Harzig, Stephan Brehm, R. Lienhart, Carolin Kaiser, René Schallner

{"title":"Multimodal Image Captioning for Marketing Analysis","authors":"Philipp Harzig, Stephan Brehm, R. Lienhart, Carolin Kaiser, René Schallner","doi":"10.1109/MIPR.2018.00035","DOIUrl":"https://doi.org/10.1109/MIPR.2018.00035","url":null,"abstract":"Automatically captioning images with natural language sentences is an important research topic. State of the art models are able to produce human-like sentences. These models typically describe the depicted scene as a whole and do not target specific objects of interest or emotional relationships between these objects in the image. However, marketing companies require to describe these important attributes of a given scene. In our case, objects of interest are consumer goods, which are usually identifiable by a product logo and are associated with certain brands. From a marketing point of view, it is desirable to also evaluate the emotional context of a trademarked product, i.e., whether it appears in a positive or a negative connotation. We address the problem of finding brands in images and deriving corresponding captions by introducing a modified image captioning network. We also add a third output modality, which simultaneously produces real-valued image ratings. Our network is trained using a classification-aware loss function in order to stimulate the generation of sentences with an emphasis on words identifying the brand of a product. We evaluate our model on a dataset of images depicting interactions between humans and branded products. The introduced network improves mean class accuracy by 24.5 percent. Thanks to adding the third output modality, it also considerably improves the quality of generated captions for images depicting branded products.","PeriodicalId":320000,"journal":{"name":"2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR)","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-02-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116745141","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 10

Generative Sensing: Transforming Unreliable Sensor Data for Reliable Recognition 生成传感:将不可靠的传感器数据转化为可靠的识别

2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) Pub Date : 2018-01-08 DOI: 10.1109/MIPR.2018.00025

Lina Karam, Tejas S. Borkar, Yu Cao, J. Chae

引用次数: 4

Improving Malware Detection Accuracy by Extracting Icon Information 通过提取图标信息提高恶意软件检测的准确性

2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) Pub Date : 2017-12-10 DOI: 10.1109/MIPR.2018.00088

Pedro Silva, Sepehr Akhavan-Masouleh, Li Li

引用次数: 4

Can You Tell a Face from a HEVC Bitstream? 你能从HEVC比特流中分辨人脸吗?

2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) Pub Date : 2017-09-09 DOI: 10.1109/MIPR.2018.00060

Saeed Ranjbar Alvar, Hyomin Choi, I. Bajić

引用次数: 13

Do They All Look the Same? Deciphering Chinese, Japanese and Koreans by Fine-Grained Deep Learning 他们看起来都一样吗?通过细粒度深度学习解码汉语、日语和韩语

2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) Pub Date : 2016-10-06 DOI: 10.1109/MIPR.2018.00015

Yu Wang, Yang Feng, Haofu Liao, Jiebo Luo, Xiangyang Xu

引用次数: 22