Automatic camera self-calibration for immersive navigation of free viewpoint sports video

2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP) Pub Date : 2016-09-01 DOI:10.1109/MMSP.2016.7813399

Qiang Yao, Hiroshi Sankoh, Keisuke Nonaka, S. Naito

{"title":"Automatic camera self-calibration for immersive navigation of free viewpoint sports video","authors":"Qiang Yao, Hiroshi Sankoh, Keisuke Nonaka, S. Naito","doi":"10.1109/MMSP.2016.7813399","DOIUrl":null,"url":null,"abstract":"In recent years, the demand of immersive experience has triggered a great revolution in the applications and formats of multimedia. Particularly, immersive navigation of free viewpoint sports video has become increasingly popular, and people would like to be able to actively select different viewpoints when watching sports videos to enhance the ultra realistic experience. In the practical realization of immersive navigation of free viewpoint video, the camera calibration is of vital importance. Especially, automatic camera calibration is very significant in real-time implementation and the accuracy of camera parameter directly determines the final experience of free viewpoint navigation. In this paper, we propose an automatic camera self-calibration method based on a field model for free viewpoint navigation in sports events. The proposed method is composed of three parts, namely, extraction of field lines in a camera image, calculation of crossing points, determination of the optimal camera parameter. Experimental results show that the camera parameter can be automatically estimated by the proposed method for a fixed camera, dynamic camera and multi-view cameras with high accuracy. Furthermore, immersive free viewpoint navigation in sports events can also be completely realized based on the camera parameter estimated by the proposed method.","PeriodicalId":113192,"journal":{"name":"2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2016-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"8","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/MMSP.2016.7813399","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 8

Abstract

In recent years, the demand of immersive experience has triggered a great revolution in the applications and formats of multimedia. Particularly, immersive navigation of free viewpoint sports video has become increasingly popular, and people would like to be able to actively select different viewpoints when watching sports videos to enhance the ultra realistic experience. In the practical realization of immersive navigation of free viewpoint video, the camera calibration is of vital importance. Especially, automatic camera calibration is very significant in real-time implementation and the accuracy of camera parameter directly determines the final experience of free viewpoint navigation. In this paper, we propose an automatic camera self-calibration method based on a field model for free viewpoint navigation in sports events. The proposed method is composed of three parts, namely, extraction of field lines in a camera image, calculation of crossing points, determination of the optimal camera parameter. Experimental results show that the camera parameter can be automatically estimated by the proposed method for a fixed camera, dynamic camera and multi-view cameras with high accuracy. Furthermore, immersive free viewpoint navigation in sports events can also be completely realized based on the camera parameter estimated by the proposed method.

查看原文本刊更多论文

自动相机自校准沉浸式导航的自由视点体育视频

近年来，沉浸式体验的需求引发了多媒体应用和格式的巨大变革。特别是自由视点体育视频的沉浸式导航越来越受欢迎，人们希望在观看体育视频时能够主动选择不同的视点，以增强超现实的体验。在自由视点视频沉浸式导航的实际实现中，摄像机标定是至关重要的。特别是相机自动标定在实时实现中具有十分重要的意义，相机参数的准确性直接决定了自由视点导航的最终体验。针对体育赛事中自由视点导航问题，提出了一种基于场模型的摄像机自动自标定方法。该方法由三部分组成，即提取相机图像中的场线，计算交叉点，确定最佳相机参数。实验结果表明，该方法可以对固定摄像机、动态摄像机和多视点摄像机进行高精度的参数自动估计。此外，基于该方法估计的摄像机参数，还可以完全实现体育赛事中的沉浸式自由视点导航。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP)

自引率

0.00%

发文量