High Resolution Video Playback in Immersive Virtual Environments

2009 IEEE Virtual Reality Conference Pub Date : 2009-03-14 DOI:10.1109/VR.2009.4811038

Han Suk Kim, J. Schulze

{"title":"High Resolution Video Playback in Immersive Virtual Environments","authors":"Han Suk Kim, J. Schulze","doi":"10.1109/VR.2009.4811038","DOIUrl":null,"url":null,"abstract":"High resolution 2D video content in High Definition or higher resolutions has become widespread and video playback of such media in immersive virtual environments (VE) will be a valuable element adding more realism to VE applications. This kind of video play-back, however, has to overcome several problems. First, the data volume of video clips can reach up to hundreds of gigabytes or more depending on the length of the clips, and the data has to be streamed into virtual reality (VR) systems in real-time. Second, the interactivity of the playback screen in 3D virtual environments requires efficient rendering of each video frame. Interactivity means that the plane of the video playback screen needs to rotate, translate, and zoom in and out in 3D space as the viewer roams around in the VE. This also means that the video is not necessarily parallel to the display screen but will need to be displayed as a general quadrangle. In this work, we propose an efficient algorithm that utilizes mipmapped data, that is, multiple levels of resolutions, to provide an efficient way to interactively play back high resolution video content in VEs. In addition, we discuss several optimizations to sustain a constant frame rate, such as an optimized memory management mechanism, dynamic resolution adjustment, and predictive prefetching of data. Finally, we evaluate two video playback applications running on a virtual reality CAVE system: 1) high definition video at 3840 × 2160 pixels and 2) 32 independent 256 × 192 pixels video clips.","PeriodicalId":433266,"journal":{"name":"2009 IEEE Virtual Reality Conference","volume":"5 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2009-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2009 IEEE Virtual Reality Conference","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/VR.2009.4811038","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 2

Abstract

High resolution 2D video content in High Definition or higher resolutions has become widespread and video playback of such media in immersive virtual environments (VE) will be a valuable element adding more realism to VE applications. This kind of video play-back, however, has to overcome several problems. First, the data volume of video clips can reach up to hundreds of gigabytes or more depending on the length of the clips, and the data has to be streamed into virtual reality (VR) systems in real-time. Second, the interactivity of the playback screen in 3D virtual environments requires efficient rendering of each video frame. Interactivity means that the plane of the video playback screen needs to rotate, translate, and zoom in and out in 3D space as the viewer roams around in the VE. This also means that the video is not necessarily parallel to the display screen but will need to be displayed as a general quadrangle. In this work, we propose an efficient algorithm that utilizes mipmapped data, that is, multiple levels of resolutions, to provide an efficient way to interactively play back high resolution video content in VEs. In addition, we discuss several optimizations to sustain a constant frame rate, such as an optimized memory management mechanism, dynamic resolution adjustment, and predictive prefetching of data. Finally, we evaluate two video playback applications running on a virtual reality CAVE system: 1) high definition video at 3840 × 2160 pixels and 2) 32 independent 256 × 192 pixels video clips.

查看原文本刊更多论文

沉浸式虚拟环境中的高分辨率视频播放

高分辨率或更高分辨率的高分辨率2D视频内容已经变得普遍，在沉浸式虚拟环境(VE)中播放此类媒体的视频将是为VE应用增加更多真实感的宝贵元素。然而，这种视频回放必须克服几个问题。首先，根据视频片段的长度，视频片段的数据量可以达到数百gb甚至更多，并且数据必须实时流式传输到虚拟现实(VR)系统中。其次，3D虚拟环境中播放屏幕的交互性要求对每个视频帧进行高效渲染。交互性是指当观看者在VE内漫游时，视频播放界面的平面需要在3D空间中进行旋转、平移、缩放等操作。这也意味着视频不一定与显示屏平行，但需要显示为一般的四边形。在这项工作中，我们提出了一种有效的算法，利用mimapping数据，即多层分辨率，提供一种有效的方法来交互播放高分辨率视频内容。此外，我们还讨论了维持恒定帧速率的几种优化，例如优化的内存管理机制、动态分辨率调整和数据的预测预取。最后，我们评估了在虚拟现实CAVE系统上运行的两种视频播放应用:1)3840 × 2160像素的高清视频和2)32个独立的256 × 192像素视频剪辑。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

2009 IEEE Virtual Reality Conference

自引率

0.00%

发文量