基于云间数据转换图的遥感应用工作流调度

Zhuojing Tian, Zhenchun Huang, Yinong Zhang
{"title":"基于云间数据转换图的遥感应用工作流调度","authors":"Zhuojing Tian, Zhenchun Huang, Yinong Zhang","doi":"10.1109/ICAA53760.2021.00119","DOIUrl":null,"url":null,"abstract":"Inter-cloud environment provides massive computing resources to meet the increasing amount of data and computation for remote sensing applications. However, how to effectively map sub-tasks to different cloud service providers to achieve QoS(Quality of Service) index optimization is still a problem that needs to be studied. Remote sensing applications need to process trillions of bytes of data each time, unreasonable scheduling will lead to a large amount of data transmission across the cloud, which will seriously affect the performance of QoS indicators such as makespan and cost. By using data transformation graph(DTG) to study the data transmission process of global drought detection application, which is a remote sensing application, an optimized scientific workflow scheduling based on genetic algorithm is proposed for inter-cloud environment, which can minimize makespan and cost simultaneously. Experimental results show that this method can significantly optimize QoS index for data-intensive application like remote sense application and can effectively reduce the impact of performance bottlenecks.","PeriodicalId":121879,"journal":{"name":"2021 International Conference on Intelligent Computing, Automation and Applications (ICAA)","volume":"26 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Workflow Scheduling for Remote Sense Application Using Data Transformation Graph in Inter-cloud\",\"authors\":\"Zhuojing Tian, Zhenchun Huang, Yinong Zhang\",\"doi\":\"10.1109/ICAA53760.2021.00119\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Inter-cloud environment provides massive computing resources to meet the increasing amount of data and computation for remote sensing applications. However, how to effectively map sub-tasks to different cloud service providers to achieve QoS(Quality of Service) index optimization is still a problem that needs to be studied. Remote sensing applications need to process trillions of bytes of data each time, unreasonable scheduling will lead to a large amount of data transmission across the cloud, which will seriously affect the performance of QoS indicators such as makespan and cost. By using data transformation graph(DTG) to study the data transmission process of global drought detection application, which is a remote sensing application, an optimized scientific workflow scheduling based on genetic algorithm is proposed for inter-cloud environment, which can minimize makespan and cost simultaneously. Experimental results show that this method can significantly optimize QoS index for data-intensive application like remote sense application and can effectively reduce the impact of performance bottlenecks.\",\"PeriodicalId\":121879,\"journal\":{\"name\":\"2021 International Conference on Intelligent Computing, Automation and Applications (ICAA)\",\"volume\":\"26 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 International Conference on Intelligent Computing, Automation and Applications (ICAA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICAA53760.2021.00119\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 International Conference on Intelligent Computing, Automation and Applications (ICAA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICAA53760.2021.00119","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

云间环境提供了海量的计算资源,以满足遥感应用日益增长的数据量和计算量。然而,如何有效地将子任务映射到不同的云服务提供商,实现QoS(Quality of service)指标优化,仍然是一个需要研究的问题。遥感应用每次需要处理数万亿字节的数据,不合理的调度会导致大量数据跨云传输,严重影响makespan、cost等QoS指标的性能。通过利用数据转换图(DTG)研究全球干旱探测应用的数据传输过程,提出了一种基于遗传算法的云间环境下优化的科学工作流调度方法,使完工时间和成本同时最小化。实验结果表明,该方法可以显著优化遥感等数据密集型应用的QoS指标,有效降低性能瓶颈的影响。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Workflow Scheduling for Remote Sense Application Using Data Transformation Graph in Inter-cloud
Inter-cloud environment provides massive computing resources to meet the increasing amount of data and computation for remote sensing applications. However, how to effectively map sub-tasks to different cloud service providers to achieve QoS(Quality of Service) index optimization is still a problem that needs to be studied. Remote sensing applications need to process trillions of bytes of data each time, unreasonable scheduling will lead to a large amount of data transmission across the cloud, which will seriously affect the performance of QoS indicators such as makespan and cost. By using data transformation graph(DTG) to study the data transmission process of global drought detection application, which is a remote sensing application, an optimized scientific workflow scheduling based on genetic algorithm is proposed for inter-cloud environment, which can minimize makespan and cost simultaneously. Experimental results show that this method can significantly optimize QoS index for data-intensive application like remote sense application and can effectively reduce the impact of performance bottlenecks.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信