{"title":"基于深度强化学习的机动感知主动视频片段缓存","authors":"Xuefei Li, Jiawei Wang, Zhilong Zhang, Danpu Liu","doi":"10.1109/IC-NIDC54101.2021.9660434","DOIUrl":null,"url":null,"abstract":"Maintaining efficient and successive video streaming services in cellular networks is challenging due to user mobility and ever-increasing volume of data traffic. A promising solution is to cache popular contents at the edge of wireless networks. Although caching schemes have been widely discussed, few of them jointly considered the characteristics of streamed video data and user mobility. In this paper, we construct a dynamic caching decision framework based on Long Short-Term Memory (LSTM) and Deep Q-network (DQN). Based on this framework, a mobility-aware segment-level caching strategy is proposed to maximize the cache hit rate. Simulation results show that our proposed method can achieve 20% performance improvement by comparing with baseline caching algorithms.","PeriodicalId":264468,"journal":{"name":"2021 7th IEEE International Conference on Network Intelligence and Digital Content (IC-NIDC)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Mobility-Aware Proactive Video Segment Caching Based on Deep Reinforcement Learning\",\"authors\":\"Xuefei Li, Jiawei Wang, Zhilong Zhang, Danpu Liu\",\"doi\":\"10.1109/IC-NIDC54101.2021.9660434\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Maintaining efficient and successive video streaming services in cellular networks is challenging due to user mobility and ever-increasing volume of data traffic. A promising solution is to cache popular contents at the edge of wireless networks. Although caching schemes have been widely discussed, few of them jointly considered the characteristics of streamed video data and user mobility. In this paper, we construct a dynamic caching decision framework based on Long Short-Term Memory (LSTM) and Deep Q-network (DQN). Based on this framework, a mobility-aware segment-level caching strategy is proposed to maximize the cache hit rate. Simulation results show that our proposed method can achieve 20% performance improvement by comparing with baseline caching algorithms.\",\"PeriodicalId\":264468,\"journal\":{\"name\":\"2021 7th IEEE International Conference on Network Intelligence and Digital Content (IC-NIDC)\",\"volume\":\"11 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-11-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 7th IEEE International Conference on Network Intelligence and Digital Content (IC-NIDC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IC-NIDC54101.2021.9660434\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 7th IEEE International Conference on Network Intelligence and Digital Content (IC-NIDC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IC-NIDC54101.2021.9660434","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Mobility-Aware Proactive Video Segment Caching Based on Deep Reinforcement Learning
Maintaining efficient and successive video streaming services in cellular networks is challenging due to user mobility and ever-increasing volume of data traffic. A promising solution is to cache popular contents at the edge of wireless networks. Although caching schemes have been widely discussed, few of them jointly considered the characteristics of streamed video data and user mobility. In this paper, we construct a dynamic caching decision framework based on Long Short-Term Memory (LSTM) and Deep Q-network (DQN). Based on this framework, a mobility-aware segment-level caching strategy is proposed to maximize the cache hit rate. Simulation results show that our proposed method can achieve 20% performance improvement by comparing with baseline caching algorithms.