Tianyu Ren , Jia He , Zhenhong Jia , Xiaohui Huang , Sensen Song , Jiajia Wang , Gang Zhou , Fei Shi , Ming Lv
{"title":"基于自适应超像素重建和多尺度奇异值分解融合的夜间大视场视频图像变化检测","authors":"Tianyu Ren , Jia He , Zhenhong Jia , Xiaohui Huang , Sensen Song , Jiajia Wang , Gang Zhou , Fei Shi , Ming Lv","doi":"10.1016/j.displa.2024.102840","DOIUrl":null,"url":null,"abstract":"<div><p>With the development of technology and the needs of social governance, surveillance equipment has been widely used. It is very mature to detect the change of surveillance video images in conventional scenes through video image change detection algorithms. However, in the large field of view environment at night, there are complex random noise and low signal-to-noise ratio in surveillance video images, which makes it difficult for people to find small moving targets. To this end, we propose a new method for nighttime large-field surveillance video image change detection based on adaptive superpixel reconstruction and multi-scale singular value decomposition fusion. The proposed method consists of two parts. On the one hand, an adaptive superpixel reconstruction method is used to reconstruct the two denoised difference images by selecting different segmentation parameters, and the edge information of the two reconstructed difference images is significantly enhanced. On the other hand, a multi-scale singular value decomposition fusion method is used to fuse the two difference images. The multi-scale singular value decomposition fusion obtains a robust difference image by selecting fusion rules at different scales and using the complementary information of different difference images, and the Fuzzy c-means (FCM) clustering algorithm is used to obtain the final changed image. Experimental results on a self-built nighttime large-field video image dataset with two resolutions show that the proposed method is superior to other algorithms in terms of detection accuracy and robustness.</p></div>","PeriodicalId":50570,"journal":{"name":"Displays","volume":"85 ","pages":"Article 102840"},"PeriodicalIF":3.7000,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Nighttime large-field video image change detection based on adaptive superpixel reconstruction and multi-scale singular value decomposition fusion\",\"authors\":\"Tianyu Ren , Jia He , Zhenhong Jia , Xiaohui Huang , Sensen Song , Jiajia Wang , Gang Zhou , Fei Shi , Ming Lv\",\"doi\":\"10.1016/j.displa.2024.102840\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>With the development of technology and the needs of social governance, surveillance equipment has been widely used. It is very mature to detect the change of surveillance video images in conventional scenes through video image change detection algorithms. However, in the large field of view environment at night, there are complex random noise and low signal-to-noise ratio in surveillance video images, which makes it difficult for people to find small moving targets. To this end, we propose a new method for nighttime large-field surveillance video image change detection based on adaptive superpixel reconstruction and multi-scale singular value decomposition fusion. The proposed method consists of two parts. On the one hand, an adaptive superpixel reconstruction method is used to reconstruct the two denoised difference images by selecting different segmentation parameters, and the edge information of the two reconstructed difference images is significantly enhanced. On the other hand, a multi-scale singular value decomposition fusion method is used to fuse the two difference images. The multi-scale singular value decomposition fusion obtains a robust difference image by selecting fusion rules at different scales and using the complementary information of different difference images, and the Fuzzy c-means (FCM) clustering algorithm is used to obtain the final changed image. Experimental results on a self-built nighttime large-field video image dataset with two resolutions show that the proposed method is superior to other algorithms in terms of detection accuracy and robustness.</p></div>\",\"PeriodicalId\":50570,\"journal\":{\"name\":\"Displays\",\"volume\":\"85 \",\"pages\":\"Article 102840\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2024-09-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Displays\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S014193822400204X\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Displays","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S014193822400204X","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
Nighttime large-field video image change detection based on adaptive superpixel reconstruction and multi-scale singular value decomposition fusion
With the development of technology and the needs of social governance, surveillance equipment has been widely used. It is very mature to detect the change of surveillance video images in conventional scenes through video image change detection algorithms. However, in the large field of view environment at night, there are complex random noise and low signal-to-noise ratio in surveillance video images, which makes it difficult for people to find small moving targets. To this end, we propose a new method for nighttime large-field surveillance video image change detection based on adaptive superpixel reconstruction and multi-scale singular value decomposition fusion. The proposed method consists of two parts. On the one hand, an adaptive superpixel reconstruction method is used to reconstruct the two denoised difference images by selecting different segmentation parameters, and the edge information of the two reconstructed difference images is significantly enhanced. On the other hand, a multi-scale singular value decomposition fusion method is used to fuse the two difference images. The multi-scale singular value decomposition fusion obtains a robust difference image by selecting fusion rules at different scales and using the complementary information of different difference images, and the Fuzzy c-means (FCM) clustering algorithm is used to obtain the final changed image. Experimental results on a self-built nighttime large-field video image dataset with two resolutions show that the proposed method is superior to other algorithms in terms of detection accuracy and robustness.
期刊介绍:
Displays is the international journal covering the research and development of display technology, its effective presentation and perception of information, and applications and systems including display-human interface.
Technical papers on practical developments in Displays technology provide an effective channel to promote greater understanding and cross-fertilization across the diverse disciplines of the Displays community. Original research papers solving ergonomics issues at the display-human interface advance effective presentation of information. Tutorial papers covering fundamentals intended for display technologies and human factor engineers new to the field will also occasionally featured.