Narúsci S. Bastos, Lucas Seidy Ribeiro Dos Santos Ikenoue, D. Palomino, G. Corrêa, Tatiana Tavares, B. Zatt
{"title":"使用轻量级机器学习的全参考立体客观质量评估","authors":"Narúsci S. Bastos, Lucas Seidy Ribeiro Dos Santos Ikenoue, D. Palomino, G. Corrêa, Tatiana Tavares, B. Zatt","doi":"10.1145/3539637.3557936","DOIUrl":null,"url":null,"abstract":"Decades of research on Image Quality Assessment (IQA) have promoted the creation of a variety of objective quality metrics that strongly correlate to subjective image quality. However, challenges remain when considering quality assessment of 3D/stereo images. Multiple objective quality metrics for 3D images were designed by extending the well-known 2D metrics. As a result, these solutions tend to present weaknesses under 3D-specific artifacts. Recent works demonstrate the effectiveness of machine-learning techniques in the design of 3D quality metrics. Although effective, some machine learning-based solutions may lead to high computational effort and restrict its adoption in low-latency lightweight systems/applications. This paper presents a study on full-reference stereoscopic objective quality assessment considering lightweight machine learning. We evaluated four different decision tree-based algorithms considering eight distinct sets of image features. The classifiers were trained using data from the Waterloo IVC 3D Image Quality Database to determine the subjective quality score measured using Mean Opinion Score (MOS). The results show that RandomForest generally obtains the best accuracy. Our study demonstrates the feasibility of decision tree-based solutions as an accurate and lightweight approach for 3D image quality assessment.","PeriodicalId":350776,"journal":{"name":"Proceedings of the Brazilian Symposium on Multimedia and the Web","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Full Reference Stereoscopic Objective Quality Assessment using Lightweight Machine Learning\",\"authors\":\"Narúsci S. Bastos, Lucas Seidy Ribeiro Dos Santos Ikenoue, D. Palomino, G. Corrêa, Tatiana Tavares, B. Zatt\",\"doi\":\"10.1145/3539637.3557936\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Decades of research on Image Quality Assessment (IQA) have promoted the creation of a variety of objective quality metrics that strongly correlate to subjective image quality. However, challenges remain when considering quality assessment of 3D/stereo images. Multiple objective quality metrics for 3D images were designed by extending the well-known 2D metrics. As a result, these solutions tend to present weaknesses under 3D-specific artifacts. Recent works demonstrate the effectiveness of machine-learning techniques in the design of 3D quality metrics. Although effective, some machine learning-based solutions may lead to high computational effort and restrict its adoption in low-latency lightweight systems/applications. This paper presents a study on full-reference stereoscopic objective quality assessment considering lightweight machine learning. We evaluated four different decision tree-based algorithms considering eight distinct sets of image features. The classifiers were trained using data from the Waterloo IVC 3D Image Quality Database to determine the subjective quality score measured using Mean Opinion Score (MOS). The results show that RandomForest generally obtains the best accuracy. Our study demonstrates the feasibility of decision tree-based solutions as an accurate and lightweight approach for 3D image quality assessment.\",\"PeriodicalId\":350776,\"journal\":{\"name\":\"Proceedings of the Brazilian Symposium on Multimedia and the Web\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-11-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the Brazilian Symposium on Multimedia and the Web\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3539637.3557936\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the Brazilian Symposium on Multimedia and the Web","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3539637.3557936","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Full Reference Stereoscopic Objective Quality Assessment using Lightweight Machine Learning
Decades of research on Image Quality Assessment (IQA) have promoted the creation of a variety of objective quality metrics that strongly correlate to subjective image quality. However, challenges remain when considering quality assessment of 3D/stereo images. Multiple objective quality metrics for 3D images were designed by extending the well-known 2D metrics. As a result, these solutions tend to present weaknesses under 3D-specific artifacts. Recent works demonstrate the effectiveness of machine-learning techniques in the design of 3D quality metrics. Although effective, some machine learning-based solutions may lead to high computational effort and restrict its adoption in low-latency lightweight systems/applications. This paper presents a study on full-reference stereoscopic objective quality assessment considering lightweight machine learning. We evaluated four different decision tree-based algorithms considering eight distinct sets of image features. The classifiers were trained using data from the Waterloo IVC 3D Image Quality Database to determine the subjective quality score measured using Mean Opinion Score (MOS). The results show that RandomForest generally obtains the best accuracy. Our study demonstrates the feasibility of decision tree-based solutions as an accurate and lightweight approach for 3D image quality assessment.