Ana Galindo-Serrano, L. Giupponi, Pol Blasco, M. Dohler
{"title":"向认知无线电网络中的专家学习:主动性范式","authors":"Ana Galindo-Serrano, L. Giupponi, Pol Blasco, M. Dohler","doi":"10.4108/ICST.CROWNCOM2010.9173","DOIUrl":null,"url":null,"abstract":"In this paper we introduce the novel paradigm of docition for cognitive radio (CR) networks. We consider that the CRs are intelligent radios implementing a learning process through which they interact with the surrounding environment to make self-adaptive decisions. However, in distributed settings the learning may be complex and slow, due to interactive decision making processes, which results in a non-stationary environment. The docitive paradigm proposes a timely solution based on knowledge sharing, which allows CRs to develop new capacities for selecting actions. We demonstrate that this improves the CRs' learning ability and accuracy, and gives them strategies for action selection in unvisited states. We evaluate the docitive paradigm in the context of a secondary system modeled as a multi-agent system, where the agents are IEEE 802.22 CR base stations, implementing a real-time multi-agent reinforcement learning technique known as decentralized Q-learning. Our goal is to solve the aggregated interference problem generated by multiple CR systems at the receivers of a primary system. We propose three different docitive algorithms and we show their superiority to the well know paradigm of independent learning in terms of speed of convergence and precision.","PeriodicalId":193648,"journal":{"name":"2010 Proceedings of the Fifth International Conference on Cognitive Radio Oriented Wireless Networks and Communications","volume":"16 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2010-06-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"23","resultStr":"{\"title\":\"Learning from experts in cognitive radio networks: The docitive paradigm\",\"authors\":\"Ana Galindo-Serrano, L. Giupponi, Pol Blasco, M. Dohler\",\"doi\":\"10.4108/ICST.CROWNCOM2010.9173\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper we introduce the novel paradigm of docition for cognitive radio (CR) networks. We consider that the CRs are intelligent radios implementing a learning process through which they interact with the surrounding environment to make self-adaptive decisions. However, in distributed settings the learning may be complex and slow, due to interactive decision making processes, which results in a non-stationary environment. The docitive paradigm proposes a timely solution based on knowledge sharing, which allows CRs to develop new capacities for selecting actions. We demonstrate that this improves the CRs' learning ability and accuracy, and gives them strategies for action selection in unvisited states. We evaluate the docitive paradigm in the context of a secondary system modeled as a multi-agent system, where the agents are IEEE 802.22 CR base stations, implementing a real-time multi-agent reinforcement learning technique known as decentralized Q-learning. Our goal is to solve the aggregated interference problem generated by multiple CR systems at the receivers of a primary system. We propose three different docitive algorithms and we show their superiority to the well know paradigm of independent learning in terms of speed of convergence and precision.\",\"PeriodicalId\":193648,\"journal\":{\"name\":\"2010 Proceedings of the Fifth International Conference on Cognitive Radio Oriented Wireless Networks and Communications\",\"volume\":\"16 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2010-06-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"23\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2010 Proceedings of the Fifth International Conference on Cognitive Radio Oriented Wireless Networks and Communications\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.4108/ICST.CROWNCOM2010.9173\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2010 Proceedings of the Fifth International Conference on Cognitive Radio Oriented Wireless Networks and Communications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4108/ICST.CROWNCOM2010.9173","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Learning from experts in cognitive radio networks: The docitive paradigm
In this paper we introduce the novel paradigm of docition for cognitive radio (CR) networks. We consider that the CRs are intelligent radios implementing a learning process through which they interact with the surrounding environment to make self-adaptive decisions. However, in distributed settings the learning may be complex and slow, due to interactive decision making processes, which results in a non-stationary environment. The docitive paradigm proposes a timely solution based on knowledge sharing, which allows CRs to develop new capacities for selecting actions. We demonstrate that this improves the CRs' learning ability and accuracy, and gives them strategies for action selection in unvisited states. We evaluate the docitive paradigm in the context of a secondary system modeled as a multi-agent system, where the agents are IEEE 802.22 CR base stations, implementing a real-time multi-agent reinforcement learning technique known as decentralized Q-learning. Our goal is to solve the aggregated interference problem generated by multiple CR systems at the receivers of a primary system. We propose three different docitive algorithms and we show their superiority to the well know paradigm of independent learning in terms of speed of convergence and precision.