{"title":"基于云间数据转换图的遥感应用工作流调度","authors":"Zhuojing Tian, Zhenchun Huang, Yinong Zhang","doi":"10.1109/ICAA53760.2021.00119","DOIUrl":null,"url":null,"abstract":"Inter-cloud environment provides massive computing resources to meet the increasing amount of data and computation for remote sensing applications. However, how to effectively map sub-tasks to different cloud service providers to achieve QoS(Quality of Service) index optimization is still a problem that needs to be studied. Remote sensing applications need to process trillions of bytes of data each time, unreasonable scheduling will lead to a large amount of data transmission across the cloud, which will seriously affect the performance of QoS indicators such as makespan and cost. By using data transformation graph(DTG) to study the data transmission process of global drought detection application, which is a remote sensing application, an optimized scientific workflow scheduling based on genetic algorithm is proposed for inter-cloud environment, which can minimize makespan and cost simultaneously. Experimental results show that this method can significantly optimize QoS index for data-intensive application like remote sense application and can effectively reduce the impact of performance bottlenecks.","PeriodicalId":121879,"journal":{"name":"2021 International Conference on Intelligent Computing, Automation and Applications (ICAA)","volume":"26 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Workflow Scheduling for Remote Sense Application Using Data Transformation Graph in Inter-cloud\",\"authors\":\"Zhuojing Tian, Zhenchun Huang, Yinong Zhang\",\"doi\":\"10.1109/ICAA53760.2021.00119\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Inter-cloud environment provides massive computing resources to meet the increasing amount of data and computation for remote sensing applications. However, how to effectively map sub-tasks to different cloud service providers to achieve QoS(Quality of Service) index optimization is still a problem that needs to be studied. Remote sensing applications need to process trillions of bytes of data each time, unreasonable scheduling will lead to a large amount of data transmission across the cloud, which will seriously affect the performance of QoS indicators such as makespan and cost. By using data transformation graph(DTG) to study the data transmission process of global drought detection application, which is a remote sensing application, an optimized scientific workflow scheduling based on genetic algorithm is proposed for inter-cloud environment, which can minimize makespan and cost simultaneously. Experimental results show that this method can significantly optimize QoS index for data-intensive application like remote sense application and can effectively reduce the impact of performance bottlenecks.\",\"PeriodicalId\":121879,\"journal\":{\"name\":\"2021 International Conference on Intelligent Computing, Automation and Applications (ICAA)\",\"volume\":\"26 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 International Conference on Intelligent Computing, Automation and Applications (ICAA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICAA53760.2021.00119\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 International Conference on Intelligent Computing, Automation and Applications (ICAA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICAA53760.2021.00119","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
云间环境提供了海量的计算资源,以满足遥感应用日益增长的数据量和计算量。然而,如何有效地将子任务映射到不同的云服务提供商,实现QoS(Quality of service)指标优化,仍然是一个需要研究的问题。遥感应用每次需要处理数万亿字节的数据,不合理的调度会导致大量数据跨云传输,严重影响makespan、cost等QoS指标的性能。通过利用数据转换图(DTG)研究全球干旱探测应用的数据传输过程,提出了一种基于遗传算法的云间环境下优化的科学工作流调度方法,使完工时间和成本同时最小化。实验结果表明,该方法可以显著优化遥感等数据密集型应用的QoS指标,有效降低性能瓶颈的影响。
Workflow Scheduling for Remote Sense Application Using Data Transformation Graph in Inter-cloud
Inter-cloud environment provides massive computing resources to meet the increasing amount of data and computation for remote sensing applications. However, how to effectively map sub-tasks to different cloud service providers to achieve QoS(Quality of Service) index optimization is still a problem that needs to be studied. Remote sensing applications need to process trillions of bytes of data each time, unreasonable scheduling will lead to a large amount of data transmission across the cloud, which will seriously affect the performance of QoS indicators such as makespan and cost. By using data transformation graph(DTG) to study the data transmission process of global drought detection application, which is a remote sensing application, an optimized scientific workflow scheduling based on genetic algorithm is proposed for inter-cloud environment, which can minimize makespan and cost simultaneously. Experimental results show that this method can significantly optimize QoS index for data-intensive application like remote sense application and can effectively reduce the impact of performance bottlenecks.