2008 Third Workshop on Workflows in Support of Large-Scale Science最新文献

筛选
英文 中文
A general and scalable solution for heterogeneous workflow invocation and nesting 用于异构工作流调用和嵌套的通用且可扩展的解决方案
2008 Third Workshop on Workflows in Support of Large-Scale Science Pub Date : 2008-12-22 DOI: 10.1109/WORKS.2008.4723963
T. Kukla, T. Kiss, G. Terstyánszky, P. Kacsuk
{"title":"A general and scalable solution for heterogeneous workflow invocation and nesting","authors":"T. Kukla, T. Kiss, G. Terstyánszky, P. Kacsuk","doi":"10.1109/WORKS.2008.4723963","DOIUrl":"https://doi.org/10.1109/WORKS.2008.4723963","url":null,"abstract":"Several widely utilized, grid workflow management systems emerged in the last decade. These systems were developed by different scientific communities for various purposes. Enhancing these systems with the capability of invoking and nesting the workflows of other systems within their native workflows makes these communities to be able to carry out cross-organizational experiments and share non-native workflows. The novel solution described in this paper allows the integration of different workflow engines and makes them accessible for workflow systems in order to achieve this goal. The solution is based on an application repository and submitter, which exposes different workflow engines and executes them using the computational resources of the grid. In contrast with other approaches, our solution is scalable in terms of both number of workflows and amount of data, easily extendable in the sense that the integration of a new workflow engine does not require code re-engineering, and general, since it can be adopted by numerous workflow systems.","PeriodicalId":323716,"journal":{"name":"2008 Third Workshop on Workflows in Support of Large-Scale Science","volume":"460 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132970962","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 16
Pegasus on the virtual grid: a case study of workflow planning over captive resources 虚拟网格上的Pegasus:一个基于约束资源的工作流规划案例研究
2008 Third Workshop on Workflows in Support of Large-Scale Science Pub Date : 2008-12-22 DOI: 10.1109/WORKS.2008.4723961
Yang-Suk Kee, Eun-Kyu Byun, E. Deelman, K. Vahi, Jin-Soo Kim
{"title":"Pegasus on the virtual grid: a case study of workflow planning over captive resources","authors":"Yang-Suk Kee, Eun-Kyu Byun, E. Deelman, K. Vahi, Jin-Soo Kim","doi":"10.1109/WORKS.2008.4723961","DOIUrl":"https://doi.org/10.1109/WORKS.2008.4723961","url":null,"abstract":"As scientific applications in a variety of disciplines are being actively developed and computing environments become ever more complicated and dynamic, it is becoming challenging to leverage existing cyber-infrastructures and achieve robust and efficient computing. This paper presents a case study of planning and executing application workflows over provisioned resources. This work integrates the Pegasus workflow framework with the Virtual Grid resource provisioning system. Through this preliminary study, we have identified two key issues that need to be addressed: 1) developing a resource capacity estimate which synthesizes efficient resource descriptions for the Virtual Grid from application workflows and 2) execution site information publication which provides resource configurations for Pegasus through the devirtualization of provisioned resources. In addition, we discuss the challenges and research opportunities that we need to explore in order to exploit the advanced features of the systems.","PeriodicalId":323716,"journal":{"name":"2008 Third Workshop on Workflows in Support of Large-Scale Science","volume":"68 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124548886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
A Chemical Workflow Engine for scientific workflows with dynamicity support 具有动态支持的科学工作流的化学工作流引擎
2008 Third Workshop on Workflows in Support of Large-Scale Science Pub Date : 2008-12-22 DOI: 10.1109/WORKS.2008.4723956
M. Caeiro, Z. Németh, T. Priol
{"title":"A Chemical Workflow Engine for scientific workflows with dynamicity support","authors":"M. Caeiro, Z. Németh, T. Priol","doi":"10.1109/WORKS.2008.4723956","DOIUrl":"https://doi.org/10.1109/WORKS.2008.4723956","url":null,"abstract":"In this paper the notion of a chemical workflow engine (CWE) is introduced to support the enactment of scientific workflows, i.e. computationally intensive tasks involving large datasets. The execution of scientific workflows require the coordinated use of a large quantity of resources and scheduling of the activities. Furthermore, these workflows may pose various dynamic features that need a special elaboration, either due to the inherent structure of the workflow, changes in the environment or interaction. The concept of CWE introduced in this paper is focused on these issues with the aim of creating a highly abstract self-evolving coordination model for workflow execution. The model is based on the foundations of classical workflow formalisms, particularly, event-driven process chains, and realized through a completely new paradigm: the chemical computational model. The coordination is based on a nature metaphor and follows the principles of the chemical reactions. The proposed coordination model is inherently concurrent, exploits all potential parallelism, able to dynamically react to any changes in the environment or workflow structure.","PeriodicalId":323716,"journal":{"name":"2008 Third Workshop on Workflows in Support of Large-Scale Science","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129863226","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
CASJobs: A workflow environment designed for large scientific catalogs CASJobs:为大型科学目录设计的工作流环境
2008 Third Workshop on Workflows in Support of Large-Scale Science Pub Date : 2008-12-22 DOI: 10.1109/WORKS.2008.4723957
Nolan Li, A. Szalay
{"title":"CASJobs: A workflow environment designed for large scientific catalogs","authors":"Nolan Li, A. Szalay","doi":"10.1109/WORKS.2008.4723957","DOIUrl":"https://doi.org/10.1109/WORKS.2008.4723957","url":null,"abstract":"As some scientific data resources grow well past the terabyte mark, so do the technical challenges of analyzing and retrieving such data. When presented with such a large volume, prior data delivery techniques, such as the time-honored system of simply copying all data to local storage prior to analysis, become impractical. We present CASJobs, an online workbench that focuses on enabling server-side exploratory and analytical tasks on large sets of data.","PeriodicalId":323716,"journal":{"name":"2008 Third Workshop on Workflows in Support of Large-Scale Science","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133832157","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Advanced QoS methods for Grid workflows based on meta-negotiations and SLA-mappings 基于元协商和sla映射的网格工作流高级QoS方法
2008 Third Workshop on Workflows in Support of Large-Scale Science Pub Date : 2008-12-22 DOI: 10.1109/WORKS.2008.4723960
I. Brandić, Dejan Music, S. Dustdar, S. Venugopal, R. Buyya
{"title":"Advanced QoS methods for Grid workflows based on meta-negotiations and SLA-mappings","authors":"I. Brandić, Dejan Music, S. Dustdar, S. Venugopal, R. Buyya","doi":"10.1109/WORKS.2008.4723960","DOIUrl":"https://doi.org/10.1109/WORKS.2008.4723960","url":null,"abstract":"In novel market-oriented resource sharing models, resource consumers pay for the resource usage and expect that non-functional requirements for the application execution, termed as quality of service (QoS), are satisfied. QoS is negotiated between two parties following the specific negotiation protocols and is recorded using service level agreements (SLAs). However, most of the existing work assumes that the communication partners know about the SLA negotiation protocols and about the SLA templates before entering the negotiation. However, this is a contradictory assumption, if we consider computational grids and novel, commercially oriented computing clouds where consumers and providers meet each other dynamically. In this paper, we present novel meta-negotiation and SLA-mapping solutions for grid workflows bridging the gap between current QoS models and grid workflows, one of the most successful grid programming paradigms. We illustrate the open research issues with a real world case study. Thereafter, we present document models for the specification of meta-negotiations and SLA-mappings. We discuss the architecture for the management of meta-negotiations and SLA-mappings as well as integration of the architecture into a grid workflow management framework.","PeriodicalId":323716,"journal":{"name":"2008 Third Workshop on Workflows in Support of Large-Scale Science","volume":"79 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129400907","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 28
WS-PGRADE: Supporting parameter sweep applications in workflows WS-PGRADE:支持工作流中的参数扫描应用程序
2008 Third Workshop on Workflows in Support of Large-Scale Science Pub Date : 2008-12-22 DOI: 10.1109/WORKS.2008.4723955
P. Kacsuk, K. Karóczkai, G. Hermann, G. Sipos, J. Kovács
{"title":"WS-PGRADE: Supporting parameter sweep applications in workflows","authors":"P. Kacsuk, K. Karóczkai, G. Hermann, G. Sipos, J. Kovács","doi":"10.1109/WORKS.2008.4723955","DOIUrl":"https://doi.org/10.1109/WORKS.2008.4723955","url":null,"abstract":"Despite majority of production level grid applications are either parameter studies or workflows some of them cannot fit into these categories and implement more complex structures. Such an application class was found in the CancerGrid project, where several parameter study simulation must be connected together into a workflow and must be executed on various production grids. The paper introduces the structure of parameter study based grid applications and describes the WS-PGRADE system which provides support for the development and execution of this category of applications. The data generator, data collector and data processor components of WS-PGRADE provide easy to understand, flexible, though very powerful mechanisms to express involved grid application structures. The grid connector layer of WS-PGRADE can distribute application components to Desktop Grids, service grids, Web Service networks and local resources, thus can find the most efficient location to execute calculations. By using WS-PGRADE, the members of the CancerGrid consortium are able to create and execute grid applications that consist of millions of jobs.","PeriodicalId":323716,"journal":{"name":"2008 Third Workshop on Workflows in Support of Large-Scale Science","volume":"127 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131055596","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 42
Monitoring infrastructure for Grid scientific workflows 监测网格科学工作流的基础设施
2008 Third Workshop on Workflows in Support of Large-Scale Science Pub Date : 2008-12-22 DOI: 10.1109/WORKS.2008.4723959
B. Baliś, M. Bubak
{"title":"Monitoring infrastructure for Grid scientific workflows","authors":"B. Baliś, M. Bubak","doi":"10.1109/WORKS.2008.4723959","DOIUrl":"https://doi.org/10.1109/WORKS.2008.4723959","url":null,"abstract":"Scientific workflows, being heterogeneous, loosely coupled, large-scale and distributed, pose new challenges on application monitoring. In this paper, we identify the main challenges for a monitoring infrastructure for grid scientific workflows. In order to address those challenges, we describe key design elements of a monitoring infrastructure facilitating interoperability between diverse monitoring and instrumentation tools. We propose a standardized taxonomy for grid workflow monitoring events. Automatic resource discovery is identified as the key problem to enable on-line monitoring of grid workflows. The solution to this problem is proposed based on a DHT infrastructure federated with monitoring services. This solution is next evaluated using a model-based performance evaluation. We also propose an ontology-based monitoring information model to describe records of workflow runs.","PeriodicalId":323716,"journal":{"name":"2008 Third Workshop on Workflows in Support of Large-Scale Science","volume":"191 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116138549","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Characterization of scientific workflows 科学工作流程的特征
2008 Third Workshop on Workflows in Support of Large-Scale Science Pub Date : 2008-12-22 DOI: 10.1109/WORKS.2008.4723958
S. Bharathi, A. Chervenak, E. Deelman, Gaurang Mehta, Mei-Hui Su, K. Vahi
{"title":"Characterization of scientific workflows","authors":"S. Bharathi, A. Chervenak, E. Deelman, Gaurang Mehta, Mei-Hui Su, K. Vahi","doi":"10.1109/WORKS.2008.4723958","DOIUrl":"https://doi.org/10.1109/WORKS.2008.4723958","url":null,"abstract":"Researchers working on the planning, scheduling and execution of scientific workflows need access to a wide variety of scientific workflows to evaluate the performance of their implementations. We describe basic workflow structures that are composed into complex workflows by scientific communities. We provide a characterization of workflows from five diverse scientific applications, describing their composition and data and computational requirements. We also describe the effect of the size of the input datasets on the structure and execution profiles of these workflows. Finally, we describe a workflow generator that produces synthetic, parameterizable workflows that closely resemble the workflows that we characterize. We make these workflows available to the community to be used as benchmarks for evaluating various workflow systems and scheduling algorithms.","PeriodicalId":323716,"journal":{"name":"2008 Third Workshop on Workflows in Support of Large-Scale Science","volume":"115 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122261440","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 594
A semantic workflow mechanism to realise experimental goals and constraints 实现实验目标和约束的语义工作流机制
2008 Third Workshop on Workflows in Support of Large-Scale Science Pub Date : 2008-11-01 DOI: 10.1109/WORKS.2008.4723962
E. Pignotti, P. Edwards, J. Gareth Polhill, N. Gotts, A. Preece
{"title":"A semantic workflow mechanism to realise experimental goals and constraints","authors":"E. Pignotti, P. Edwards, J. Gareth Polhill, N. Gotts, A. Preece","doi":"10.1109/WORKS.2008.4723962","DOIUrl":"https://doi.org/10.1109/WORKS.2008.4723962","url":null,"abstract":"Workflow technologies provide scientific researchers with a flexible problem-solving environment, by facilitating the creation and execution of experiments from a pool of available services. In this paper we argue that in order to better characterise such experiments we need to go beyond low-level service composition and execution details by capturing higher-level descriptions of the scientific process. Current workflow technologies do not incorporate any representation of such experimental constraints and goals, which we refer to as the scientistpsilas intent. We have developed a framework based upon use of a number of semantic Web technologies, including the OWL ontology language and the semantic Web rule language (SWRL), to capture scientistpsilas intent. Through the use of a social simulation case study we illustrate the benefits of using this framework in terms of workflow monitoring, workflow provenance and enrichment of experimental results.","PeriodicalId":323716,"journal":{"name":"2008 Third Workshop on Workflows in Support of Large-Scale Science","volume":"12 4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134163136","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书