{"title":"利用深度神经网络检测图像序列中的混叠伪影","authors":"Anjul Patney, A. Lefohn","doi":"10.1145/3231578.3231580","DOIUrl":null,"url":null,"abstract":"In this short paper we present a machine learning approach to detect visual artifacts in rendered image sequences. Specifically, we train a deep neural network using example aliased and antialiased image sequences exported from a real-time renderer. The trained network learns to identify and locate aliasing artifacts in an input sequence, without comparing it against a ground truth. Thus, it is useful as a fully automated tool for evaluating image quality. We demonstrate the effectiveness of our approach in detecting aliasing in several rendered sequences. The trained network correctly predicts aliasing in 64 x 64 x 4 animated sequences with more than 90% accuracy for images it hasn't seen before. The output of our network is a single scalar between 0 and 1, which is usable as a quality metric for aliasing. It follows the same trend as (1-SSIM) for images with increasing sample counts.","PeriodicalId":354787,"journal":{"name":"Proceedings of the Conference on High-Performance Graphics","volume":"22 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":"{\"title\":\"Detecting aliasing artifacts in image sequences using deep neural networks\",\"authors\":\"Anjul Patney, A. Lefohn\",\"doi\":\"10.1145/3231578.3231580\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this short paper we present a machine learning approach to detect visual artifacts in rendered image sequences. Specifically, we train a deep neural network using example aliased and antialiased image sequences exported from a real-time renderer. The trained network learns to identify and locate aliasing artifacts in an input sequence, without comparing it against a ground truth. Thus, it is useful as a fully automated tool for evaluating image quality. We demonstrate the effectiveness of our approach in detecting aliasing in several rendered sequences. The trained network correctly predicts aliasing in 64 x 64 x 4 animated sequences with more than 90% accuracy for images it hasn't seen before. The output of our network is a single scalar between 0 and 1, which is usable as a quality metric for aliasing. It follows the same trend as (1-SSIM) for images with increasing sample counts.\",\"PeriodicalId\":354787,\"journal\":{\"name\":\"Proceedings of the Conference on High-Performance Graphics\",\"volume\":\"22 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-08-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"5\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the Conference on High-Performance Graphics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3231578.3231580\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the Conference on High-Performance Graphics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3231578.3231580","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 5
摘要
在这篇短文中,我们提出了一种机器学习方法来检测渲染图像序列中的视觉伪影。具体来说,我们使用从实时渲染器导出的示例混叠和反混叠图像序列来训练深度神经网络。经过训练的网络学习识别和定位输入序列中的混叠工件,而不将其与基础事实进行比较。因此,它是有用的,作为一个完全自动化的工具,评估图像质量。我们证明了我们的方法在几个渲染序列中检测混叠的有效性。经过训练的网络正确预测64 x 64 x 4动画序列中的混叠,对于以前从未见过的图像,准确率超过90%。我们网络的输出是0到1之间的单个标量,它可用作混叠的质量度量。对于样本数量增加的图像,它遵循与(1-SSIM)相同的趋势。
Detecting aliasing artifacts in image sequences using deep neural networks
In this short paper we present a machine learning approach to detect visual artifacts in rendered image sequences. Specifically, we train a deep neural network using example aliased and antialiased image sequences exported from a real-time renderer. The trained network learns to identify and locate aliasing artifacts in an input sequence, without comparing it against a ground truth. Thus, it is useful as a fully automated tool for evaluating image quality. We demonstrate the effectiveness of our approach in detecting aliasing in several rendered sequences. The trained network correctly predicts aliasing in 64 x 64 x 4 animated sequences with more than 90% accuracy for images it hasn't seen before. The output of our network is a single scalar between 0 and 1, which is usable as a quality metric for aliasing. It follows the same trend as (1-SSIM) for images with increasing sample counts.