基于元启发式优化算法的智能混合机器学习增强实时视频稳定

IF 0.5 Q4 TELECOMMUNICATIONS
S. Afsal, J. Arul Linsely
{"title":"基于元启发式优化算法的智能混合机器学习增强实时视频稳定","authors":"S. Afsal,&nbsp;J. Arul Linsely","doi":"10.1002/itl2.70089","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>In the modern era, video stabilization is one of the essential advancement features of digital video processing equipped with 5G technology. Also, this technology leverages the intelligent software innovations to deliver high quality and smooth video recording experiences. Despite advancement in machine learning (ML) algorithms for video stabilization, there are numerous challenges, especially when applying 5G technologies like stable and unstable videos for training performance. Consequently, video stabilization includes complex analyses such as frame interpolation and motion assessment. Moreover, the advanced stabilization modes are developed to analyze the motion data. Nevertheless, they decrease or fail to calculate the features and provide poor results. To overcome these issues, an adaptive video stabilization methodology is proposed. In the proposed method, a novel Convolution Neural with StabNet based Hawks Optimization (CNSbHO) algorithm is introduced. In this research, hand-held video clips generally suffer from unwanted video jitters due to unbalanced camera motion. Therefore, 5G ultra-low latency with respect to drone footage video feeds is taken as the stabilization process. Then, a pre-processing Gaussian filter was enabled to enhance consistency and quality. Hereafter, a Convolution Neural Network (CNN) was used to extract the features, and motion estimation is also done in this section with feature tracking point of CNN. Furthermore, end-to-end stabilization strategy as StabNet model can provide stabilized frame outputs. Then, the Harris Hawks Optimization (HHO) algorithm was used to enhance the accuracy of the entire performance. The developed CNSbHO strategy was implemented in Python and validated using the 5G traffic datasets. In order to validate the effectiveness of the developed strategy, we selected the traditional algorithms for the comparison in terms of learned perceptual image patch similarity (LPIPS), structural similarity index (SSIM), accuracy, and peak signal-to-noise ratio (PSNR). The comparative assessment confirms that the proposed method outperforms conventional stabilization techniques, making it a reliable solution for real-time video processing tasks.</p>\n </div>","PeriodicalId":100725,"journal":{"name":"Internet Technology Letters","volume":"8 5","pages":""},"PeriodicalIF":0.5000,"publicationDate":"2025-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Intelligent Hybrid Machine Learning With Meta-Heuristic Optimization Algorithms for Enhancing Real-Time Video Stabilization\",\"authors\":\"S. Afsal,&nbsp;J. Arul Linsely\",\"doi\":\"10.1002/itl2.70089\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n <p>In the modern era, video stabilization is one of the essential advancement features of digital video processing equipped with 5G technology. Also, this technology leverages the intelligent software innovations to deliver high quality and smooth video recording experiences. Despite advancement in machine learning (ML) algorithms for video stabilization, there are numerous challenges, especially when applying 5G technologies like stable and unstable videos for training performance. Consequently, video stabilization includes complex analyses such as frame interpolation and motion assessment. Moreover, the advanced stabilization modes are developed to analyze the motion data. Nevertheless, they decrease or fail to calculate the features and provide poor results. To overcome these issues, an adaptive video stabilization methodology is proposed. In the proposed method, a novel Convolution Neural with StabNet based Hawks Optimization (CNSbHO) algorithm is introduced. In this research, hand-held video clips generally suffer from unwanted video jitters due to unbalanced camera motion. Therefore, 5G ultra-low latency with respect to drone footage video feeds is taken as the stabilization process. Then, a pre-processing Gaussian filter was enabled to enhance consistency and quality. Hereafter, a Convolution Neural Network (CNN) was used to extract the features, and motion estimation is also done in this section with feature tracking point of CNN. Furthermore, end-to-end stabilization strategy as StabNet model can provide stabilized frame outputs. Then, the Harris Hawks Optimization (HHO) algorithm was used to enhance the accuracy of the entire performance. The developed CNSbHO strategy was implemented in Python and validated using the 5G traffic datasets. In order to validate the effectiveness of the developed strategy, we selected the traditional algorithms for the comparison in terms of learned perceptual image patch similarity (LPIPS), structural similarity index (SSIM), accuracy, and peak signal-to-noise ratio (PSNR). The comparative assessment confirms that the proposed method outperforms conventional stabilization techniques, making it a reliable solution for real-time video processing tasks.</p>\\n </div>\",\"PeriodicalId\":100725,\"journal\":{\"name\":\"Internet Technology Letters\",\"volume\":\"8 5\",\"pages\":\"\"},\"PeriodicalIF\":0.5000,\"publicationDate\":\"2025-07-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Internet Technology Letters\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/itl2.70089\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"TELECOMMUNICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Internet Technology Letters","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/itl2.70089","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

在现代时代,视频防抖是5G技术下数字视频处理的重要进步特征之一。此外,该技术利用智能软件创新,提供高质量和流畅的视频录制体验。尽管用于视频稳定的机器学习(ML)算法取得了进步,但仍存在许多挑战,特别是在应用5G技术(如稳定和不稳定视频)进行训练性能时。因此,视频稳定包括复杂的分析,如帧插值和运动评估。此外,还开发了先进的稳定模式来分析运动数据。然而,它们减少或无法计算特征并提供较差的结果。为了克服这些问题,提出了一种自适应视频稳定方法。在该方法中,引入了一种新的基于StabNet的卷积神经鹰优化算法(CNSbHO)。在本研究中,手持视频剪辑通常遭受不必要的视频抖动由于不平衡的相机运动。因此,我们将无人机视频馈送的5G超低延迟作为稳定过程。然后,使用预处理高斯滤波器增强一致性和质量。接下来使用卷积神经网络(convolutional Neural Network, CNN)进行特征提取,并利用CNN的特征跟踪点进行运动估计。此外,作为StabNet模型的端到端稳定策略可以提供稳定的帧输出。然后,采用Harris Hawks Optimization (HHO)算法来提高整个性能的准确性。开发的CNSbHO策略在Python中实现,并使用5G流量数据集进行验证。为了验证所开发策略的有效性,我们选择传统算法在学习感知图像斑块相似度(LPIPS)、结构相似度指数(SSIM)、准确率和峰值信噪比(PSNR)方面进行比较。对比评估证实,该方法优于传统的稳定技术,是实时视频处理任务的可靠解决方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
An Intelligent Hybrid Machine Learning With Meta-Heuristic Optimization Algorithms for Enhancing Real-Time Video Stabilization

In the modern era, video stabilization is one of the essential advancement features of digital video processing equipped with 5G technology. Also, this technology leverages the intelligent software innovations to deliver high quality and smooth video recording experiences. Despite advancement in machine learning (ML) algorithms for video stabilization, there are numerous challenges, especially when applying 5G technologies like stable and unstable videos for training performance. Consequently, video stabilization includes complex analyses such as frame interpolation and motion assessment. Moreover, the advanced stabilization modes are developed to analyze the motion data. Nevertheless, they decrease or fail to calculate the features and provide poor results. To overcome these issues, an adaptive video stabilization methodology is proposed. In the proposed method, a novel Convolution Neural with StabNet based Hawks Optimization (CNSbHO) algorithm is introduced. In this research, hand-held video clips generally suffer from unwanted video jitters due to unbalanced camera motion. Therefore, 5G ultra-low latency with respect to drone footage video feeds is taken as the stabilization process. Then, a pre-processing Gaussian filter was enabled to enhance consistency and quality. Hereafter, a Convolution Neural Network (CNN) was used to extract the features, and motion estimation is also done in this section with feature tracking point of CNN. Furthermore, end-to-end stabilization strategy as StabNet model can provide stabilized frame outputs. Then, the Harris Hawks Optimization (HHO) algorithm was used to enhance the accuracy of the entire performance. The developed CNSbHO strategy was implemented in Python and validated using the 5G traffic datasets. In order to validate the effectiveness of the developed strategy, we selected the traditional algorithms for the comparison in terms of learned perceptual image patch similarity (LPIPS), structural similarity index (SSIM), accuracy, and peak signal-to-noise ratio (PSNR). The comparative assessment confirms that the proposed method outperforms conventional stabilization techniques, making it a reliable solution for real-time video processing tasks.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
3.10
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信