A two-stage tone mapping network based on attention mechanism for high dynamic range images

IF 2.8 4区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS
Mingtao Zhu , Hengyong Yu , Ying Chu
{"title":"A two-stage tone mapping network based on attention mechanism for high dynamic range images","authors":"Mingtao Zhu ,&nbsp;Hengyong Yu ,&nbsp;Ying Chu","doi":"10.1016/j.jvcir.2025.104672","DOIUrl":null,"url":null,"abstract":"<div><div>High dynamic range (HDR) imaging enhances visual realism by capturing a wide luminance range, but displaying HDR images on devices with limited dynamic range requires effective tone mapping operators (TMOs). We propose a novel two-stage tone mapping network (TSTMNet) based on attention mechanisms to address this challenge. The first stage utilizes adaptive luminance modulation blocks based on channel attention to dynamically adjust global luminance, achieving adaptive luminance modification. The second stage integrates local enhancement transformer blocks, leveraging self-attention from Transformers to enhance local details. This combination allows the TSTMNet to utilize the strengths of both CNNs and Transformers, overcoming their individual limitations in modeling long-range dependencies and preserving local details. Extensive experiments demonstrate that TSTMNet achieves competitive performance among recent methods in both quantitative metrics and qualitative visual quality, achieving superior dynamic range compression and detail preservation. Our method offers a robust and efficient solution to the tone mapping problem. The code is available to be downloaded at <span><span>https://github.com/mtlaa/TSTMNet</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":54755,"journal":{"name":"Journal of Visual Communication and Image Representation","volume":"115 ","pages":"Article 104672"},"PeriodicalIF":2.8000,"publicationDate":"2026-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Visual Communication and Image Representation","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S104732032500286X","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/12/3 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

High dynamic range (HDR) imaging enhances visual realism by capturing a wide luminance range, but displaying HDR images on devices with limited dynamic range requires effective tone mapping operators (TMOs). We propose a novel two-stage tone mapping network (TSTMNet) based on attention mechanisms to address this challenge. The first stage utilizes adaptive luminance modulation blocks based on channel attention to dynamically adjust global luminance, achieving adaptive luminance modification. The second stage integrates local enhancement transformer blocks, leveraging self-attention from Transformers to enhance local details. This combination allows the TSTMNet to utilize the strengths of both CNNs and Transformers, overcoming their individual limitations in modeling long-range dependencies and preserving local details. Extensive experiments demonstrate that TSTMNet achieves competitive performance among recent methods in both quantitative metrics and qualitative visual quality, achieving superior dynamic range compression and detail preservation. Our method offers a robust and efficient solution to the tone mapping problem. The code is available to be downloaded at https://github.com/mtlaa/TSTMNet.
基于注意机制的高动态范围图像两阶段色调映射网络
高动态范围(HDR)成像通过捕获宽亮度范围来增强视觉真实感,但在动态范围有限的设备上显示HDR图像需要有效的色调映射算子(TMOs)。我们提出了一种新的基于注意机制的两阶段音调映射网络(TSTMNet)来解决这一挑战。第一阶段利用基于信道关注的自适应亮度调制块动态调整全局亮度,实现自适应亮度修改;第二阶段集成本地增强变压器块,利用变压器的自关注来增强本地细节。这种组合允许TSTMNet利用cnn和transformer的优势,克服它们在建模远程依赖关系和保留局部细节方面的各自限制。大量的实验表明,TSTMNet在定量度量和定性视觉质量方面都取得了与现有方法相媲美的性能,实现了优越的动态范围压缩和细节保存。我们的方法为色调映射问题提供了一个鲁棒和高效的解决方案。代码可从https://github.com/mtlaa/TSTMNet下载。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Visual Communication and Image Representation
Journal of Visual Communication and Image Representation 工程技术-计算机:软件工程
CiteScore
5.40
自引率
11.50%
发文量
188
审稿时长
9.9 months
期刊介绍: The Journal of Visual Communication and Image Representation publishes papers on state-of-the-art visual communication and image representation, with emphasis on novel technologies and theoretical work in this multidisciplinary area of pure and applied research. The field of visual communication and image representation is considered in its broadest sense and covers both digital and analog aspects as well as processing and communication in biological visual systems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书