Scene-content-sensitive real-time adaptive foveated rendering

IF 1.7 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC
Chuanyu Shen, Chunyi Chen, Xiaojuan Hu
{"title":"Scene-content-sensitive real-time adaptive foveated rendering","authors":"Chuanyu Shen,&nbsp;Chunyi Chen,&nbsp;Xiaojuan Hu","doi":"10.1002/jsid.1346","DOIUrl":null,"url":null,"abstract":"<p>In recent years, techniques for accelerating rendering by exploiting the limitations of the human visual system have become increasingly prevalent. The foveated rendering method significantly reduces the computational requirements during rendering by reducing image quality in peripheral regions. In this paper, we propose a scene-content-sensitive real-time adaptive foveated rendering method. First, we pre-render the three-dimensional (3D) scene at a low resolution. Then, we utilize the low-resolution pre-rendered image as input to extract edge, local contrast, and color features. Subsequently, we generate a screen-space region division map based on the gaze point position. Next, we calculate the visual importance of each 16 × 16 pixel tile based on edge, local contrast, color, and screen-space region. We then map the visual importance to the shading rate to generate a shading rate control map for the current frame. Finally, we complete the rendering of the current frame based on variable rate shading technology. Experimental results demonstrate that our method effectively enhances the visual quality of images near the foveal region while generating high quality foveal region images. Furthermore, our method can significantly improve performance compared to per-pixel shading method and existing scene-content-based foveated rendering methods.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":null,"pages":null},"PeriodicalIF":1.7000,"publicationDate":"2024-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the Society for Information Display","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/jsid.1346","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

In recent years, techniques for accelerating rendering by exploiting the limitations of the human visual system have become increasingly prevalent. The foveated rendering method significantly reduces the computational requirements during rendering by reducing image quality in peripheral regions. In this paper, we propose a scene-content-sensitive real-time adaptive foveated rendering method. First, we pre-render the three-dimensional (3D) scene at a low resolution. Then, we utilize the low-resolution pre-rendered image as input to extract edge, local contrast, and color features. Subsequently, we generate a screen-space region division map based on the gaze point position. Next, we calculate the visual importance of each 16 × 16 pixel tile based on edge, local contrast, color, and screen-space region. We then map the visual importance to the shading rate to generate a shading rate control map for the current frame. Finally, we complete the rendering of the current frame based on variable rate shading technology. Experimental results demonstrate that our method effectively enhances the visual quality of images near the foveal region while generating high quality foveal region images. Furthermore, our method can significantly improve performance compared to per-pixel shading method and existing scene-content-based foveated rendering methods.

场景内容敏感型实时自适应有眼图渲染
近年来,利用人类视觉系统的局限性来加速渲染的技术越来越普遍。有焦点渲染方法通过降低外围区域的图像质量,大大降低了渲染过程中的计算要求。在本文中,我们提出了一种对场景内容敏感的实时自适应焦点渲染方法。首先,我们对三维(3D)场景进行低分辨率预渲染。然后,我们利用低分辨率预渲染图像作为输入,提取边缘、局部对比度和颜色特征。随后,我们根据注视点位置生成屏幕空间区域划分图。接下来,我们根据边缘、局部对比度、颜色和屏幕空间区域计算每个 16 × 16 像素瓦片的视觉重要性。然后,我们将视觉重要性与着色率进行映射,生成当前帧的着色率控制图。最后,我们根据可变着色率技术完成当前帧的渲染。实验结果表明,我们的方法在生成高质量眼窝区域图像的同时,有效地提高了眼窝区域附近图像的视觉质量。此外,与按像素着色方法和现有的基于场景内容的有眼窝渲染方法相比,我们的方法能显著提高性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of the Society for Information Display
Journal of the Society for Information Display 工程技术-材料科学:综合
CiteScore
4.80
自引率
8.70%
发文量
98
审稿时长
3 months
期刊介绍: The Journal of the Society for Information Display publishes original works dealing with the theory and practice of information display. Coverage includes materials, devices and systems; the underlying chemistry, physics, physiology and psychology; measurement techniques, manufacturing technologies; and all aspects of the interaction between equipment and its users. Review articles are also published in all of these areas. Occasional special issues or sections consist of collections of papers on specific topical areas or collections of full length papers based in part on oral or poster presentations given at SID sponsored conferences.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信