Herman Prawiro, Tse-Yu Pan, Chun-Kai Yang, Chih-Tsun Huang, Min-Chun Hu
{"title":"实现 360 度视频的高效视觉注意力预测","authors":"Herman Prawiro, Tse-Yu Pan, Chun-Kai Yang, Chih-Tsun Huang, Min-Chun Hu","doi":"10.1109/AIxVR59861.2024.00014","DOIUrl":null,"url":null,"abstract":"Visual attention prediction refers to the ability to predict the most visually important or attention-grabbing areas in a scene, and emphasize them to create an engaging and realistic experience for the user. These technologies require real-time processing of high-quality visual content to maintain user engagement and immersion. As such, it is necessary to use lightweight models that can predict the most important regions of a scene without incurring large computational cost. The contribution of this work is the development and evaluation of a lightweight model for visual attention prediction, which serves as a baseline on public datasets. We study various model design choices and their effects on the performance and efficiency. We also study the effect of a model compression technique, namely self-distillation.","PeriodicalId":518749,"journal":{"name":"2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR)","volume":"135 1","pages":"50-59"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Towards Efficient Visual Attention Prediction for 360 Degree Videos\",\"authors\":\"Herman Prawiro, Tse-Yu Pan, Chun-Kai Yang, Chih-Tsun Huang, Min-Chun Hu\",\"doi\":\"10.1109/AIxVR59861.2024.00014\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Visual attention prediction refers to the ability to predict the most visually important or attention-grabbing areas in a scene, and emphasize them to create an engaging and realistic experience for the user. These technologies require real-time processing of high-quality visual content to maintain user engagement and immersion. As such, it is necessary to use lightweight models that can predict the most important regions of a scene without incurring large computational cost. The contribution of this work is the development and evaluation of a lightweight model for visual attention prediction, which serves as a baseline on public datasets. We study various model design choices and their effects on the performance and efficiency. We also study the effect of a model compression technique, namely self-distillation.\",\"PeriodicalId\":518749,\"journal\":{\"name\":\"2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR)\",\"volume\":\"135 1\",\"pages\":\"50-59\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-01-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/AIxVR59861.2024.00014\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AIxVR59861.2024.00014","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Towards Efficient Visual Attention Prediction for 360 Degree Videos
Visual attention prediction refers to the ability to predict the most visually important or attention-grabbing areas in a scene, and emphasize them to create an engaging and realistic experience for the user. These technologies require real-time processing of high-quality visual content to maintain user engagement and immersion. As such, it is necessary to use lightweight models that can predict the most important regions of a scene without incurring large computational cost. The contribution of this work is the development and evaluation of a lightweight model for visual attention prediction, which serves as a baseline on public datasets. We study various model design choices and their effects on the performance and efficiency. We also study the effect of a model compression technique, namely self-distillation.