A New Retrieval System Based on Low Dynamic Range Expansion and SIFT Descriptor

Raoua Khwildi, A. O. Zaid
{"title":"A New Retrieval System Based on Low Dynamic Range Expansion and SIFT Descriptor","authors":"Raoua Khwildi, A. O. Zaid","doi":"10.1109/MMSP.2018.8547089","DOIUrl":null,"url":null,"abstract":"When comparing the intelligibility of Low Dynamic Range (LDR) content with that of the human visual system (HSV), we find that the former is quite limited. This is straightforward, as LDR technologies could only handle 8 or 12-bit per color channel. This being said, LDR images are still used in a wide range of multimedia applications. This paper presents a solution for efficiently indexing LDR content by introducing a novel descriptor based on LDR content expansion. To increase the richness of features that are strongly dependent on the illumination of the scene, the LDR image is converted to High Dynamic Range (HDR) one using reverse Tone Mapping Operator (rTMO). The result HDR image is in turn tone mapped and the relevant features are determined according the Scale Invariant Feature Transform (SIFT) descriptor. After that, the obtained features are gathered into a vector using Bag-of-Visual-Word (BoVW) strategy. A set of routine benchmarking experiments utilizing the Wang and Pascal Voc databases indicates that our system performs well for image retrieval. These experiments also demonstrate that features extracted from reverse tone mapped and tone mapped image are more descriptive than those extracted from LDR and HDR contents.","PeriodicalId":137522,"journal":{"name":"2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/MMSP.2018.8547089","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

Abstract

When comparing the intelligibility of Low Dynamic Range (LDR) content with that of the human visual system (HSV), we find that the former is quite limited. This is straightforward, as LDR technologies could only handle 8 or 12-bit per color channel. This being said, LDR images are still used in a wide range of multimedia applications. This paper presents a solution for efficiently indexing LDR content by introducing a novel descriptor based on LDR content expansion. To increase the richness of features that are strongly dependent on the illumination of the scene, the LDR image is converted to High Dynamic Range (HDR) one using reverse Tone Mapping Operator (rTMO). The result HDR image is in turn tone mapped and the relevant features are determined according the Scale Invariant Feature Transform (SIFT) descriptor. After that, the obtained features are gathered into a vector using Bag-of-Visual-Word (BoVW) strategy. A set of routine benchmarking experiments utilizing the Wang and Pascal Voc databases indicates that our system performs well for image retrieval. These experiments also demonstrate that features extracted from reverse tone mapped and tone mapped image are more descriptive than those extracted from LDR and HDR contents.
基于低动态范围扩展和SIFT描述符的检索系统
将低动态范围(LDR)内容的可理解性与人类视觉系统(HSV)的可理解性进行比较,发现前者的可理解性相当有限。这很简单,因为LDR技术每个颜色通道只能处理8位或12位。话虽如此,LDR图像仍然在广泛的多媒体应用中使用。本文通过引入基于LDR内容扩展的描述符,提出了一种高效索引LDR内容的解决方案。为了增加强烈依赖于场景照明的特征的丰富性,使用反向色调映射算子(rTMO)将LDR图像转换为高动态范围(HDR)图像。结果HDR图像依次进行色调映射,并根据尺度不变特征变换(SIFT)描述符确定相关特征。然后,使用视觉词袋(bag -of- visual word, BoVW)策略将得到的特征集合成一个向量。一组使用Wang和Pascal Voc数据库的常规基准实验表明,我们的系统在图像检索方面表现良好。这些实验还表明,从反向色调映射和色调映射图像中提取的特征比从LDR和HDR内容中提取的特征更具描述性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信