{"title":"面向发电机机器人视觉检测的全局最优可扩展视频图像拼接","authors":"Leonid Kostrykin, Claus Rohr, K. Rohr","doi":"10.23919/ICCAS52745.2021.9649973","DOIUrl":null,"url":null,"abstract":"Large-scale image stitching of temporal video data acquired by a small robot can facilitate the inspection process of electric generators, reduce the inspection time, and improve the reliability. However, the image data poses a number of challenges due to the small field of view, lack of distinct texture, specular highlights, and other image artifacts. We introduce a novel image stitching method, which generates composite images of generator wedges from temporal videos using intensity-based registration and non-linear blending. In contrast to previous intensity-based registration approaches, our global method simultaneously exploits the information of all image frames of a video and directly determines the global image translations. We propose a suitable energy function and employ a graph-based method for globally optimal minimization in linear runtime. Regularization is used to exploit physical knowledge about the application domain which improves the robustness. We have applied our approach to temporal video data of rotor wedges and performed a comparison with previous methods. We found that our method yields superior results.","PeriodicalId":411064,"journal":{"name":"2021 21st International Conference on Control, Automation and Systems (ICCAS)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-10-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Globally Optimal and Scalable Video Image Stitching for Robotic Visual Inspection of Electric Generators\",\"authors\":\"Leonid Kostrykin, Claus Rohr, K. Rohr\",\"doi\":\"10.23919/ICCAS52745.2021.9649973\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Large-scale image stitching of temporal video data acquired by a small robot can facilitate the inspection process of electric generators, reduce the inspection time, and improve the reliability. However, the image data poses a number of challenges due to the small field of view, lack of distinct texture, specular highlights, and other image artifacts. We introduce a novel image stitching method, which generates composite images of generator wedges from temporal videos using intensity-based registration and non-linear blending. In contrast to previous intensity-based registration approaches, our global method simultaneously exploits the information of all image frames of a video and directly determines the global image translations. We propose a suitable energy function and employ a graph-based method for globally optimal minimization in linear runtime. Regularization is used to exploit physical knowledge about the application domain which improves the robustness. We have applied our approach to temporal video data of rotor wedges and performed a comparison with previous methods. We found that our method yields superior results.\",\"PeriodicalId\":411064,\"journal\":{\"name\":\"2021 21st International Conference on Control, Automation and Systems (ICCAS)\",\"volume\":\"19 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-10-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 21st International Conference on Control, Automation and Systems (ICCAS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.23919/ICCAS52745.2021.9649973\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 21st International Conference on Control, Automation and Systems (ICCAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.23919/ICCAS52745.2021.9649973","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Globally Optimal and Scalable Video Image Stitching for Robotic Visual Inspection of Electric Generators
Large-scale image stitching of temporal video data acquired by a small robot can facilitate the inspection process of electric generators, reduce the inspection time, and improve the reliability. However, the image data poses a number of challenges due to the small field of view, lack of distinct texture, specular highlights, and other image artifacts. We introduce a novel image stitching method, which generates composite images of generator wedges from temporal videos using intensity-based registration and non-linear blending. In contrast to previous intensity-based registration approaches, our global method simultaneously exploits the information of all image frames of a video and directly determines the global image translations. We propose a suitable energy function and employ a graph-based method for globally optimal minimization in linear runtime. Regularization is used to exploit physical knowledge about the application domain which improves the robustness. We have applied our approach to temporal video data of rotor wedges and performed a comparison with previous methods. We found that our method yields superior results.