发布求助
文献互助 智能选刊 最新文献

2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud)最新文献

筛选
英文 中文
A Multi-tenant Fair Share Approach to Full-text Search Engine 全文搜索引擎的多租户公平共享方法
2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud) Pub Date : 2016-11-13 DOI: 10.1109/DATACLOUD.2016.10
Zong Peng, Beth Plale
{"title":"A Multi-tenant Fair Share Approach to Full-text Search Engine","authors":"Zong Peng, Beth Plale","doi":"10.1109/DATACLOUD.2016.10","DOIUrl":"https://doi.org/10.1109/DATACLOUD.2016.10","url":null,"abstract":"Full text search engines underly the search of major content providers, Google, Bing and Yahoo. Open source search engines, such as Solr and ElasticSearch, are highly scalable and","PeriodicalId":325593,"journal":{"name":"2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115769978","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Asterism: Pegasus and Dispel4py Hybrid Workflows for Data-Intensive Science Asterism:用于数据密集型科学的Pegasus和Dispel4py混合工作流
2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud) Pub Date : 2016-11-13 DOI: 10.1109/DATACLOUD.2016.4
Rosa Filgueira, Rafael Ferreira da Silva, A. Krause, E. Deelman, M. Atkinson
{"title":"Asterism: Pegasus and Dispel4py Hybrid Workflows for Data-Intensive Science","authors":"Rosa Filgueira, Rafael Ferreira da Silva, A. Krause, E. Deelman, M. Atkinson","doi":"10.1109/DATACLOUD.2016.4","DOIUrl":"https://doi.org/10.1109/DATACLOUD.2016.4","url":null,"abstract":"We present Asterism, an open source data-intensive framework, which combines the strengths of traditional workflow management systems with new parallel stream-based dataflow systems to run data-intensive applications across multiple heterogeneous resources, without users having to: re-formulate their methods according to different enactment engines; manage the data distribution across systems; parallelize their methods; co-place and schedule their methods with computing resources; and store and transfer large/small volumes of data. We also present the Data-Intensive workflows as a Service (DIaaS) model, which enables easy dataintensive workow composition and deployment on clouds using containers. The feasibility of Asterism and DIaaS model have been evaluated using a real domain application on the NSF-Chameleon cloud. Experimental results shows how Asterism successfully and efficiently exploits combinations of diverse computational platforms, whereas DIaaS delivers specialized software to execute data-intensive applications in a scalable, efficient, and robust way reducing the engineering time and computational cost.","PeriodicalId":325593,"journal":{"name":"2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud)","volume":"176 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122450540","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 18
Improved Data-Aware Task Dispatching for Batch Queuing Systems 批队列系统的改进数据感知任务调度
2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud) Pub Date : 2016-11-13 DOI: 10.1109/DATACLOUD.2016.9
Xieming Li, O. Tatebe
{"title":"Improved Data-Aware Task Dispatching for Batch Queuing Systems","authors":"Xieming Li, O. Tatebe","doi":"10.1109/DATACLOUD.2016.9","DOIUrl":"https://doi.org/10.1109/DATACLOUD.2016.9","url":null,"abstract":"This paper describes a data-aware task dispatching strategy called Improved Data-Aware Task Dispatching (IDAD). This approach exploits the high-performance of local file access in non-uniform storage-access (NUSA) file systems and is based on our previous work, Data-Aware Dispatch (DAD). In IDAD, the method of calculating data placement is revised, and the CPU factor is removed, as it has no major impact on performance but significantly reduces the difficulty for tweaking parameter.We evaluated our approach in comparison with DAD and the stock FIFO Torque scheduler using BLAST benchmarks. We observed makespan reductions of 10.40% and 35.05% compared with DAD and stock FIFO schedulers, respectively.","PeriodicalId":325593,"journal":{"name":"2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud)","volume":"36 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115038948","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Data-Intensive Supercomputing in the Cloud: Global Analytics for Satellite Imagery 云中的数据密集型超级计算:卫星图像的全球分析
2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud) Pub Date : 2016-11-13 DOI: 10.1109/DataCloud.2016.7
Michael S. Warren, S. Skillman, R. Chartrand, T. Kelton, R. Keisler, D. Raleigh, M. Turk
{"title":"Data-Intensive Supercomputing in the Cloud: Global Analytics for Satellite Imagery","authors":"Michael S. Warren, S. Skillman, R. Chartrand, T. Kelton, R. Keisler, D. Raleigh, M. Turk","doi":"10.1109/DataCloud.2016.7","DOIUrl":"https://doi.org/10.1109/DataCloud.2016.7","url":null,"abstract":"We present our experiences using cloud computing to support data-intensive analytics on satellite imagery for commercial applications. Drawing from our background in highperformance computing, we draw parallels between the early days of clustered computing systems and the current state of cloud computing and its potential to disrupt the HPC market. Using our own virtual file system layer on top of cloud remote object storage, we demonstrate aggregate read bandwidth of 230 gigabytes per second using 512 Google Compute Engine (GCE) nodes accessing a USA multi-region standard storage bucket. This figure is comparable to the best HPC storage systems in existence. We also present several of our application results, including the identification of field boundaries in Ukraine, and the generation of a global cloud-free base layer from Landsat imagery.","PeriodicalId":325593,"journal":{"name":"2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud)","volume":"48 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123312920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
Model Driven Advanced Hybrid Cloud Services for Big Data: Paradigm and Practice 模型驱动的大数据高级混合云服务:范式与实践
2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud) Pub Date : 2016-11-13 DOI: 10.1109/DATACLOUD.2016.8
Xi Yang, T. Lehman
{"title":"Model Driven Advanced Hybrid Cloud Services for Big Data: Paradigm and Practice","authors":"Xi Yang, T. Lehman","doi":"10.1109/DATACLOUD.2016.8","DOIUrl":"https://doi.org/10.1109/DATACLOUD.2016.8","url":null,"abstract":"Advanced hybrid cloud services aim to serve big data applications by bridging multi-provider high performance cloud resources including direct connects, hypervisor bypassing VM interfaces, on premise clusters, parallel storage and high speed inter-cloud networks. We present a new “full-stack model driven orchestration” paradigm to integrate these diverse resources through semantic modeling and provide complex highend services through dynamic orchestrated workflows. We also present architectural design of a real-world orchestration system, VersaStack, that implements the paradigm as well as a case study for providing full-scale advanced hybrid cloud services in practice.","PeriodicalId":325593,"journal":{"name":"2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129533770","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Pecos: A Scalable Solution for Analyzing and Managing Qualitative Data Pecos:用于分析和管理定性数据的可扩展解决方案
2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud) Pub Date : 2016-11-13 DOI: 10.1109/DATACLOUD.2016.6
R. Arora, Trung Nguyen Ba, Tiffany A. Connors
{"title":"Pecos: A Scalable Solution for Analyzing and Managing Qualitative Data","authors":"R. Arora, Trung Nguyen Ba, Tiffany A. Connors","doi":"10.1109/DATACLOUD.2016.6","DOIUrl":"https://doi.org/10.1109/DATACLOUD.2016.6","url":null,"abstract":"Large, heterogeneous, and complex data collections can be difficult to analyze and manage manually. There is a need for scalable and user-friendly approaches that can automate the","PeriodicalId":325593,"journal":{"name":"2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133117992","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
An Ensemble-Based Recommendation Engine for Scientific Data Transfers 基于集成的科学数据传输推荐引擎
2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud) Pub Date : 2016-11-13 DOI: 10.1109/DATACLOUD.2016.5
William Agnew, Michael Fischer, Ian T Foster, K. Chard
{"title":"An Ensemble-Based Recommendation Engine for Scientific Data Transfers","authors":"William Agnew, Michael Fischer, Ian T Foster, K. Chard","doi":"10.1109/DATACLOUD.2016.5","DOIUrl":"https://doi.org/10.1109/DATACLOUD.2016.5","url":null,"abstract":"Big data scientists face the challenge of locating valuable datasets across a network of distributed storage locations. We explore methods for recommending storage locations (“endpoints”) for users based on a range of prediction models including collaborative filtering and heuristics that consider available information such as user, institution, access history, endpoint ownership, and endpoint usage. We combine the strengths of these models by training a deep recurrent neural network on their predictions. Collectively we show, via analysis of historical usage from the Globus research data management service, that our approach can predict the next storage location accessed by users with 80.3% and 95.3% accuracy for top-1 and top-3 recommendations, respectively. Additionally, our heuristics can predict the endpoints that users will use in the future with over 75% precision and recall.","PeriodicalId":325593,"journal":{"name":"2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124106996","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
An Efficient Parallel Implementation of a Light-weight Data Privacy Method for Mobile Cloud Users 移动云用户轻量级数据保密方法的高效并行实现
2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud) Pub Date : 2016-11-13 DOI: 10.1109/DATACLOUD.2016.11
M. Bahrami, Dong Li, M. Singhal, A. Kundu
{"title":"An Efficient Parallel Implementation of a Light-weight Data Privacy Method for Mobile Cloud Users","authors":"M. Bahrami, Dong Li, M. Singhal, A. Kundu","doi":"10.1109/DATACLOUD.2016.11","DOIUrl":"https://doi.org/10.1109/DATACLOUD.2016.11","url":null,"abstract":"Cloud computing provides an opportunity to users to outsource their data and applications. However, data privacy is one of the key challenges for the users who are outsourcing data on some transparent cloud servers. Data encryption is the best option to protect users' data privacy on the cloud. However, computation overheads of encryption methods could be expensive to some small computing machines, such as mobile or IoT devices with limited resources, such as battery. In our previous study, we developed a light-weight Data Privacy Method (DPM) based on a chaos system that uses a Pseudo Random Permutation (PRP) to scramble the content of original data. Although the nature of PRP is against parallelization, we provide an efficient parallel algorithm to scramble a file while the file splits into multiple chunks. The parallel DPM avoids an adversary to access the original data (e.g., by using a brute-force attack), when the size of each scrambled data is large enough. In this paper, we accelerate DPM on a Graphic Processing Unit (GPU) by using NVIDIA CUDA platform for implementation. We assess the generated shuffle addresses from pseudo-random and the distribution of randomness when the computation on data is parallelized on a multiple GPU-cores. A set of rigorous evaluation results shows that the parallel DPM provides a superior performance over tradition DPM when the most time consuming of native CUDA parallel functions have monitored. We also perform a security analysis of parallel DPM to ensure it is secure and it is a cost effective model to protect users' data privacy in a cloud environment.","PeriodicalId":325593,"journal":{"name":"2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116773444","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整，为了账户安全，请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们：info@booksci.cn Book学术提供免费学术资源搜索服务，方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号：481959085
Book学术官方微信