{"title":"基于在线强化学习的HTTP自适应流方案","authors":"Jeong-Gu Kang, K. Chung","doi":"10.1109/ICTC55196.2022.9952767","DOIUrl":null,"url":null,"abstract":"DASH is an effective way to improve the Quality of Experience (QoE) in video streaming. However, most of the existing schemes depend on heuristic algorithms, and the learning-based methods that have recently started to appear also have a problem in that their performance deteriorates in a specific environment. In this paper, we propose an adaptive streaming scheme that utilizes online reinforcement learning. The proposed scheme adapts to changes in the client's environment by upgrading the ABR model while performing video streaming when QoE degradation is confirmed. In order to adapt the ABR model to the changing network environment, the neural network model is trained with the state-of-the-art reinforcement learning algorithm. The performance of the proposed scheme is evaluated through simulation-based experiments under various network conditions. Through the experimental results, it is confirmed that the proposed scheme shows better performance than the existing schemes.","PeriodicalId":441404,"journal":{"name":"2022 13th International Conference on Information and Communication Technology Convergence (ICTC)","volume":"181 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Online Reinforcement Learning Based HTTP Adaptive Streaming Scheme\",\"authors\":\"Jeong-Gu Kang, K. Chung\",\"doi\":\"10.1109/ICTC55196.2022.9952767\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"DASH is an effective way to improve the Quality of Experience (QoE) in video streaming. However, most of the existing schemes depend on heuristic algorithms, and the learning-based methods that have recently started to appear also have a problem in that their performance deteriorates in a specific environment. In this paper, we propose an adaptive streaming scheme that utilizes online reinforcement learning. The proposed scheme adapts to changes in the client's environment by upgrading the ABR model while performing video streaming when QoE degradation is confirmed. In order to adapt the ABR model to the changing network environment, the neural network model is trained with the state-of-the-art reinforcement learning algorithm. The performance of the proposed scheme is evaluated through simulation-based experiments under various network conditions. Through the experimental results, it is confirmed that the proposed scheme shows better performance than the existing schemes.\",\"PeriodicalId\":441404,\"journal\":{\"name\":\"2022 13th International Conference on Information and Communication Technology Convergence (ICTC)\",\"volume\":\"181 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 13th International Conference on Information and Communication Technology Convergence (ICTC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICTC55196.2022.9952767\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 13th International Conference on Information and Communication Technology Convergence (ICTC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICTC55196.2022.9952767","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Online Reinforcement Learning Based HTTP Adaptive Streaming Scheme
DASH is an effective way to improve the Quality of Experience (QoE) in video streaming. However, most of the existing schemes depend on heuristic algorithms, and the learning-based methods that have recently started to appear also have a problem in that their performance deteriorates in a specific environment. In this paper, we propose an adaptive streaming scheme that utilizes online reinforcement learning. The proposed scheme adapts to changes in the client's environment by upgrading the ABR model while performing video streaming when QoE degradation is confirmed. In order to adapt the ABR model to the changing network environment, the neural network model is trained with the state-of-the-art reinforcement learning algorithm. The performance of the proposed scheme is evaluated through simulation-based experiments under various network conditions. Through the experimental results, it is confirmed that the proposed scheme shows better performance than the existing schemes.