{"title":"基于q学习的异构系统智能蚁群调度算法","authors":"N. Li, Bo Gao, Zongfu Xie, Fengyin Zhang, Ji Wan","doi":"10.1109/ICET51757.2021.9451002","DOIUrl":null,"url":null,"abstract":"In view of the variable task structure and complex scheduling environment of heterogeneous computing system, and the low efficiency of existing scheduling algorithms, this paper abstracts the system by establishing a directed acyclic graph and a target system model, and proposes a Q-learning based intelligent ant colony scheduling algorithm. The algorithm adapts the scene to the scheduling environment, dynamically calculates the Q matrix according to the reward function, and the Q matrix is used as the initial pheromone of the ant colony algorithm. According to the pseudo-random proportional rule to select the processor, and the scheduling list is formed by the constraint relationship between the components to complete the task allocation. Analysis by randomly generating task graphs shows that this algorithm is more suitable for heterogeneous computing systems and computationally intensive tasks. Compared with ACO、 QMTS and GA algorithms, this algorithm reduces the scheduling lengths by average of 35.22%、 27.41% and 20.41% respectively, can obtain better scheduling results.","PeriodicalId":316980,"journal":{"name":"2021 IEEE 4th International Conference on Electronics Technology (ICET)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-05-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Q-learning Based Intelligent Ant Colony Scheduling Algorithm in Heterogeneous System\",\"authors\":\"N. Li, Bo Gao, Zongfu Xie, Fengyin Zhang, Ji Wan\",\"doi\":\"10.1109/ICET51757.2021.9451002\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In view of the variable task structure and complex scheduling environment of heterogeneous computing system, and the low efficiency of existing scheduling algorithms, this paper abstracts the system by establishing a directed acyclic graph and a target system model, and proposes a Q-learning based intelligent ant colony scheduling algorithm. The algorithm adapts the scene to the scheduling environment, dynamically calculates the Q matrix according to the reward function, and the Q matrix is used as the initial pheromone of the ant colony algorithm. According to the pseudo-random proportional rule to select the processor, and the scheduling list is formed by the constraint relationship between the components to complete the task allocation. Analysis by randomly generating task graphs shows that this algorithm is more suitable for heterogeneous computing systems and computationally intensive tasks. Compared with ACO、 QMTS and GA algorithms, this algorithm reduces the scheduling lengths by average of 35.22%、 27.41% and 20.41% respectively, can obtain better scheduling results.\",\"PeriodicalId\":316980,\"journal\":{\"name\":\"2021 IEEE 4th International Conference on Electronics Technology (ICET)\",\"volume\":\"9 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-05-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE 4th International Conference on Electronics Technology (ICET)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICET51757.2021.9451002\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE 4th International Conference on Electronics Technology (ICET)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICET51757.2021.9451002","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Q-learning Based Intelligent Ant Colony Scheduling Algorithm in Heterogeneous System
In view of the variable task structure and complex scheduling environment of heterogeneous computing system, and the low efficiency of existing scheduling algorithms, this paper abstracts the system by establishing a directed acyclic graph and a target system model, and proposes a Q-learning based intelligent ant colony scheduling algorithm. The algorithm adapts the scene to the scheduling environment, dynamically calculates the Q matrix according to the reward function, and the Q matrix is used as the initial pheromone of the ant colony algorithm. According to the pseudo-random proportional rule to select the processor, and the scheduling list is formed by the constraint relationship between the components to complete the task allocation. Analysis by randomly generating task graphs shows that this algorithm is more suitable for heterogeneous computing systems and computationally intensive tasks. Compared with ACO、 QMTS and GA algorithms, this algorithm reduces the scheduling lengths by average of 35.22%、 27.41% and 20.41% respectively, can obtain better scheduling results.