{"title":"X2gokdrive中多种图像编码方法的不同性能及协同集成","authors":"Shuang Qiu, Hao-Qiang Tan","doi":"10.1109/ISSSR58837.2023.00046","DOIUrl":null,"url":null,"abstract":"With the development of cloud computing, the delivery and usage patterns of IT infrastructure have become well-established, marking another revolution in computer science. Under the wave of cloud computing, virtual desktop technology has flourished, and the solution of server-side unified configuration management with a client-side remote connection to virtual desktops has become the fundamental principle of many virtual desktop implementations. However, multimedia applications, especially high-definition video playback, pose a major challenge in the process of implementing virtual desktops. X2gokdrive is a screensharing and remote operation software based on the X11 and Xephyr protocols. Its low bandwidth and CPU usage make it an excellent remote desktop-sharing software. However, the X2gokdrive protocol lacks good support for video, which fails to meet the requirements of playing videos on cloud platforms and clients’ demand for video viewing. During the use of remote cloud desktops, when the screen of the cloud desktop undergoes extensive changes over time, especially in scenarios such as full-screen video playback, using a cloud desktop protocol based solely on image encoding can result in frame loss, stuttering, obvious screen tearing, and even unresponsive keyboard and mouse events due to message congestion, especially in low bandwidth conditions. The purpose of this article is to improve this situation and attempt to find a suitable solution. This article compares different encoding methods based on the GStreamer multimedia framework and analyzes the advantages and disadvantages of H.264 encoding and JPEG encoding through experimental comparisons in different application scenarios. The experimental results show that in scenarios with high screen refresh rates, H.264 encoding has a significantly improved encoding time for individual frames compared to JPEG encoding. However, it consumes more CPU and memory resources. Overall, H.264 encoding has more advantages. In future research, we will attempt to simulate different user usage scenarios to compare the encoding speed and resource consumption of H265 and H.264, aiming to improve the user experience of remote desktops.","PeriodicalId":185173,"journal":{"name":"2023 9th International Symposium on System Security, Safety, and Reliability (ISSSR)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The Diverse Performance and Synergistic Integration of Multiple Image Coding Methods In X2gokdrive\",\"authors\":\"Shuang Qiu, Hao-Qiang Tan\",\"doi\":\"10.1109/ISSSR58837.2023.00046\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the development of cloud computing, the delivery and usage patterns of IT infrastructure have become well-established, marking another revolution in computer science. Under the wave of cloud computing, virtual desktop technology has flourished, and the solution of server-side unified configuration management with a client-side remote connection to virtual desktops has become the fundamental principle of many virtual desktop implementations. However, multimedia applications, especially high-definition video playback, pose a major challenge in the process of implementing virtual desktops. X2gokdrive is a screensharing and remote operation software based on the X11 and Xephyr protocols. Its low bandwidth and CPU usage make it an excellent remote desktop-sharing software. However, the X2gokdrive protocol lacks good support for video, which fails to meet the requirements of playing videos on cloud platforms and clients’ demand for video viewing. During the use of remote cloud desktops, when the screen of the cloud desktop undergoes extensive changes over time, especially in scenarios such as full-screen video playback, using a cloud desktop protocol based solely on image encoding can result in frame loss, stuttering, obvious screen tearing, and even unresponsive keyboard and mouse events due to message congestion, especially in low bandwidth conditions. The purpose of this article is to improve this situation and attempt to find a suitable solution. This article compares different encoding methods based on the GStreamer multimedia framework and analyzes the advantages and disadvantages of H.264 encoding and JPEG encoding through experimental comparisons in different application scenarios. The experimental results show that in scenarios with high screen refresh rates, H.264 encoding has a significantly improved encoding time for individual frames compared to JPEG encoding. However, it consumes more CPU and memory resources. Overall, H.264 encoding has more advantages. In future research, we will attempt to simulate different user usage scenarios to compare the encoding speed and resource consumption of H265 and H.264, aiming to improve the user experience of remote desktops.\",\"PeriodicalId\":185173,\"journal\":{\"name\":\"2023 9th International Symposium on System Security, Safety, and Reliability (ISSSR)\",\"volume\":\"8 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 9th International Symposium on System Security, Safety, and Reliability (ISSSR)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ISSSR58837.2023.00046\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 9th International Symposium on System Security, Safety, and Reliability (ISSSR)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISSSR58837.2023.00046","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
The Diverse Performance and Synergistic Integration of Multiple Image Coding Methods In X2gokdrive
With the development of cloud computing, the delivery and usage patterns of IT infrastructure have become well-established, marking another revolution in computer science. Under the wave of cloud computing, virtual desktop technology has flourished, and the solution of server-side unified configuration management with a client-side remote connection to virtual desktops has become the fundamental principle of many virtual desktop implementations. However, multimedia applications, especially high-definition video playback, pose a major challenge in the process of implementing virtual desktops. X2gokdrive is a screensharing and remote operation software based on the X11 and Xephyr protocols. Its low bandwidth and CPU usage make it an excellent remote desktop-sharing software. However, the X2gokdrive protocol lacks good support for video, which fails to meet the requirements of playing videos on cloud platforms and clients’ demand for video viewing. During the use of remote cloud desktops, when the screen of the cloud desktop undergoes extensive changes over time, especially in scenarios such as full-screen video playback, using a cloud desktop protocol based solely on image encoding can result in frame loss, stuttering, obvious screen tearing, and even unresponsive keyboard and mouse events due to message congestion, especially in low bandwidth conditions. The purpose of this article is to improve this situation and attempt to find a suitable solution. This article compares different encoding methods based on the GStreamer multimedia framework and analyzes the advantages and disadvantages of H.264 encoding and JPEG encoding through experimental comparisons in different application scenarios. The experimental results show that in scenarios with high screen refresh rates, H.264 encoding has a significantly improved encoding time for individual frames compared to JPEG encoding. However, it consumes more CPU and memory resources. Overall, H.264 encoding has more advantages. In future research, we will attempt to simulate different user usage scenarios to compare the encoding speed and resource consumption of H265 and H.264, aiming to improve the user experience of remote desktops.