Network resource selection for data transfer processes in scientific workflows

The 5th Workshop on Workflows in Support of Large-Scale Science Pub Date : 2010-12-17 DOI:10.1109/WORKS.2010.5671840

Zhiming Zhao, P. Grosso, R. Koning, J. van der Ham, C. de Laat

{"title":"Network resource selection for data transfer processes in scientific workflows","authors":"Zhiming Zhao, P. Grosso, R. Koning, J. van der Ham, C. de Laat","doi":"10.1109/WORKS.2010.5671840","DOIUrl":null,"url":null,"abstract":"Quality of the service (QoS) plays an important role in the life-cycle of scientific workflows for composing and executing applications. However, the quality of network services has so far rarely been considered in composing and executing scientific workflows. Currently, scientific applications tune the execution quality neglecting network resources, and by selecting only optimal software services and computing resources. One reason is that IP-based networks provide few possibilities for workflow systems to manage the service quality, and limit or prevent bandwidth reservation or network paths selection. We see nonetheless a strong need from scientific applications, and network operators, to include the network quality management in the workflow systems. In this paper, we discuss our ongoing research on this issue and present a semantic based solution to searching network resources with awareness of QoS requirements. The solution aims at complementing existing workflow systems on selecting network resources in the context of workflow composition, scheduling and execution when advanced network services are available. Our research is conducted in the context of the CineGrid project.","PeriodicalId":400999,"journal":{"name":"The 5th Workshop on Workflows in Support of Large-Scale Science","volume":"41 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2010-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"The 5th Workshop on Workflows in Support of Large-Scale Science","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/WORKS.2010.5671840","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 4

Abstract

Quality of the service (QoS) plays an important role in the life-cycle of scientific workflows for composing and executing applications. However, the quality of network services has so far rarely been considered in composing and executing scientific workflows. Currently, scientific applications tune the execution quality neglecting network resources, and by selecting only optimal software services and computing resources. One reason is that IP-based networks provide few possibilities for workflow systems to manage the service quality, and limit or prevent bandwidth reservation or network paths selection. We see nonetheless a strong need from scientific applications, and network operators, to include the network quality management in the workflow systems. In this paper, we discuss our ongoing research on this issue and present a semantic based solution to searching network resources with awareness of QoS requirements. The solution aims at complementing existing workflow systems on selecting network resources in the context of workflow composition, scheduling and execution when advanced network services are available. Our research is conducted in the context of the CineGrid project.

查看原文本刊更多论文

科学工作流中数据传输过程的网络资源选择

服务质量(QoS)在组成和执行应用程序的科学工作流的生命周期中起着重要作用。然而，到目前为止，在编写和执行科学工作流时很少考虑网络服务的质量。目前，科学应用对执行质量的调优忽略了网络资源，只选择最优的软件服务和计算资源。一个原因是基于ip的网络为工作流系统管理服务质量提供了很少的可能性，并且限制或阻止带宽预留或网络路径选择。然而，我们看到科学应用和网络运营商强烈需要将网络质量管理纳入工作流系统。在本文中，我们讨论了我们在这个问题上正在进行的研究，并提出了一个基于语义的解决方案来搜索具有QoS需求意识的网络资源。该解决方案旨在补充现有的工作流系统在工作流组成、调度和执行的背景下选择网络资源，当先进的网络服务可用时。我们的研究是在电影网格项目的背景下进行的。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

The 5th Workshop on Workflows in Support of Large-Scale Science

自引率

0.00%

发文量