无模型和基于模型的高效运动估计在交通视频压缩中的应用

Edgar A. Bernal, Qun Li, Orhan Bulan, Wencheng Wu, S. Schweid
{"title":"无模型和基于模型的高效运动估计在交通视频压缩中的应用","authors":"Edgar A. Bernal, Qun Li, Orhan Bulan, Wencheng Wu, S. Schweid","doi":"10.1109/WACVW.2016.7470120","DOIUrl":null,"url":null,"abstract":"Block-based motion estimation is an important component in many video coding standards that aims at removing temporal redundancy between neighboring frames. Traditional methods for block-based motion estimation such as the Exhaustive Block Matching Algorithm (EBMA) are capable of achieving good matching performance but are computationally expensive. Alternatives to EBMA have been proposed to reduce the amount of search points by trading off matching optimality with computational resources. Although they exploit shared local spatial attributes around the target block, they fail to take advantage of the characteristics of the video sequences acquired with stationary cameras used in transportation and surveillance applications, where motion patterns are largely regularized; often, they also fail to yield semantically meaningful motion vector fields. In this paper, we propose two alternative approaches to improve the efficiency of motion estimation in video compression: (i) a highly efficient model-less approach that estimates the direction and magnitude of motion of objects in the scene and predicts the optimal search direction/neighborhood location for motion vectors; and (ii) a model-based approach that learns the dominant spatiotemporal characteristics of the motion patterns captured in the video via statistical models and enables reduced searches according to the constructed models. We demonstrate via experimental validation that the proposed methods attain computational savings, achieve improved reconstruction error and prediction capabilities for a given search neighborhood size, and yield more semantically meaningful motion vector fields when coupled with traditional motion estimation algorithms.","PeriodicalId":185674,"journal":{"name":"2016 IEEE Winter Applications of Computer Vision Workshops (WACVW)","volume":"74 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2016-03-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Model-less and model-based computationally efficient motion estimation for video compression in transportation applications\",\"authors\":\"Edgar A. Bernal, Qun Li, Orhan Bulan, Wencheng Wu, S. Schweid\",\"doi\":\"10.1109/WACVW.2016.7470120\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Block-based motion estimation is an important component in many video coding standards that aims at removing temporal redundancy between neighboring frames. Traditional methods for block-based motion estimation such as the Exhaustive Block Matching Algorithm (EBMA) are capable of achieving good matching performance but are computationally expensive. Alternatives to EBMA have been proposed to reduce the amount of search points by trading off matching optimality with computational resources. Although they exploit shared local spatial attributes around the target block, they fail to take advantage of the characteristics of the video sequences acquired with stationary cameras used in transportation and surveillance applications, where motion patterns are largely regularized; often, they also fail to yield semantically meaningful motion vector fields. In this paper, we propose two alternative approaches to improve the efficiency of motion estimation in video compression: (i) a highly efficient model-less approach that estimates the direction and magnitude of motion of objects in the scene and predicts the optimal search direction/neighborhood location for motion vectors; and (ii) a model-based approach that learns the dominant spatiotemporal characteristics of the motion patterns captured in the video via statistical models and enables reduced searches according to the constructed models. We demonstrate via experimental validation that the proposed methods attain computational savings, achieve improved reconstruction error and prediction capabilities for a given search neighborhood size, and yield more semantically meaningful motion vector fields when coupled with traditional motion estimation algorithms.\",\"PeriodicalId\":185674,\"journal\":{\"name\":\"2016 IEEE Winter Applications of Computer Vision Workshops (WACVW)\",\"volume\":\"74 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2016-03-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2016 IEEE Winter Applications of Computer Vision Workshops (WACVW)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/WACVW.2016.7470120\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2016 IEEE Winter Applications of Computer Vision Workshops (WACVW)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/WACVW.2016.7470120","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

基于块的运动估计是许多视频编码标准的重要组成部分,旨在消除相邻帧之间的时间冗余。传统的基于块的运动估计方法,如穷举块匹配算法(EBMA)能够获得良好的匹配性能,但计算成本较高。已经提出了EBMA的替代方案,通过权衡匹配最优性和计算资源来减少搜索点的数量。虽然它们利用目标块周围共享的局部空间属性,但它们无法利用运输和监视应用中使用的固定摄像机获得的视频序列的特征,其中运动模式在很大程度上是正则化的;通常,它们也不能产生语义上有意义的运动向量场。在本文中,我们提出了两种替代方法来提高视频压缩中运动估计的效率:(i)一种高效的无模型方法,该方法估计场景中物体的运动方向和大小,并预测运动矢量的最佳搜索方向/邻域位置;(ii)基于模型的方法,通过统计模型学习视频中捕获的运动模式的主要时空特征,并根据构建的模型减少搜索。通过实验验证,我们证明了所提出的方法可以节省计算量,在给定搜索邻域大小下实现改进的重建误差和预测能力,并且当与传统的运动估计算法相结合时,可以产生更多语义上有意义的运动向量场。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Model-less and model-based computationally efficient motion estimation for video compression in transportation applications
Block-based motion estimation is an important component in many video coding standards that aims at removing temporal redundancy between neighboring frames. Traditional methods for block-based motion estimation such as the Exhaustive Block Matching Algorithm (EBMA) are capable of achieving good matching performance but are computationally expensive. Alternatives to EBMA have been proposed to reduce the amount of search points by trading off matching optimality with computational resources. Although they exploit shared local spatial attributes around the target block, they fail to take advantage of the characteristics of the video sequences acquired with stationary cameras used in transportation and surveillance applications, where motion patterns are largely regularized; often, they also fail to yield semantically meaningful motion vector fields. In this paper, we propose two alternative approaches to improve the efficiency of motion estimation in video compression: (i) a highly efficient model-less approach that estimates the direction and magnitude of motion of objects in the scene and predicts the optimal search direction/neighborhood location for motion vectors; and (ii) a model-based approach that learns the dominant spatiotemporal characteristics of the motion patterns captured in the video via statistical models and enables reduced searches according to the constructed models. We demonstrate via experimental validation that the proposed methods attain computational savings, achieve improved reconstruction error and prediction capabilities for a given search neighborhood size, and yield more semantically meaningful motion vector fields when coupled with traditional motion estimation algorithms.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信