发布求助
文献互助 智能选刊 最新文献

ADVCOMP ... the ... International Conference on Advanced Engineering Computing and Applications in Sciences最新文献

筛选
英文 中文
AMPRO-HPCC: A Machine-Learning Tool for Predicting Resources on Slurm HPC Clusters. AMPRO-HPCC:一个用于预测Slurm HPC集群资源的机器学习工具。
ADVCOMP ... the ... International Conference on Advanced Engineering Computing and Applications in Sciences Pub Date : 2021-10-01
Mohammed Tanash, Daniel Andresen, William Hsu
{"title":"AMPRO-HPCC: A Machine-Learning Tool for Predicting Resources on Slurm HPC Clusters.","authors":"Mohammed Tanash,&nbsp;Daniel Andresen,&nbsp;William Hsu","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Determining resource allocations (memory and time) for submitted jobs in High Performance Computing (HPC) systems is a challenging process even for computer scientists. HPC users are highly encouraged to overestimate resource allocation for their submitted jobs, so their jobs will not be killed due to insufficient resources. Overestimating resource allocations occurs because of the wide variety of HPC applications and environment configuration options, and the lack of knowledge of the complex structure of HPC systems. This causes a waste of HPC resources, a decreased utilization of HPC systems, and increased waiting and turnaround time for submitted jobs. In this paper, we introduce our first ever implemented fully-offline, fully-automated, stand-alone, and open-source Machine Learning (ML) tool to help users predict memory and time requirements for their submitted jobs on the cluster. Our tool involves implementing six ML discriminative models from the scikit-learn and Microsoft LightGBM applied on the historical data (sacct data) from Simple Linux Utility for Resource Management (Slurm). We have tested our tool using historical data (saact data) using HPC resources of Kansas State University (Beocat), which covers the years from January 2019 - March 2021, and contains around 17.6 million jobs. Our results show that our tool achieves high predictive accuracy <i>R</i> <sup>2</sup> (0.72 using LightGBM for predicting the memory and 0.74 using Random Forest for predicting the time), helps dramatically reduce computational average waiting-time and turnaround time for the submitted jobs, and increases utilization of the HPC resources. Hence, our tool decreases the power consumption of the HPC resources.</p>","PeriodicalId":72112,"journal":{"name":"ADVCOMP ... the ... International Conference on Advanced Engineering Computing and Applications in Sciences","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9906793/pdf/nihms-1831252.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10760547","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Facilitating large data management in research contexts. 促进研究环境中的大数据管理。
ADVCOMP ... the ... International Conference on Advanced Engineering Computing and Applications in Sciences Pub Date : 2021-01-01 Epub Date: 2021-10-03
Daniel Andresen, Gerrick Teague
{"title":"Facilitating large data management in research contexts.","authors":"Daniel Andresen,&nbsp;Gerrick Teague","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Research data management is becoming increasingly complex as the amount of data, metadata and code increases. Often, researchers must obtain multidisciplinary skills to acquire, transfer, share, and compute large datasets. In this paper we present the results of an investigation into providing a familiar web-based experience for researchers to manage their data and code, leveraging popular, well-funded tools and services. We show how researchers can save time and avoid mistakes, and we provide a detailed discussion of our system architecture and implementation, and summarize the new capabilities, and time savings which can be achieved.</p>","PeriodicalId":72112,"journal":{"name":"ADVCOMP ... the ... International Conference on Advanced Engineering Computing and Applications in Sciences","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9446462/pdf/nihms-1831850.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"33448466","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Message from the Program Chairs and Industry Panel Chairs 来自项目主席和行业小组主席的信息
ADVCOMP ... the ... International Conference on Advanced Engineering Computing and Applications in Sciences Pub Date : 2020-01-01 DOI: 10.1109/ACOMP50827.2020.00005
M. Marchese, Lam-Son Lê, Bob Dao, M. Toulouse, N. Thoai
{"title":"Message from the Program Chairs and Industry Panel Chairs","authors":"M. Marchese, Lam-Son Lê, Bob Dao, M. Toulouse, N. Thoai","doi":"10.1109/ACOMP50827.2020.00005","DOIUrl":"https://doi.org/10.1109/ACOMP50827.2020.00005","url":null,"abstract":"","PeriodicalId":72112,"journal":{"name":"ADVCOMP ... the ... International Conference on Advanced Engineering Computing and Applications in Sciences","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74407752","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Low-Complexity Encryption Algorithm Considering Energy Balance on Wireless Sensor Networks 考虑能量平衡的无线传感器网络低复杂度加密算法
ADVCOMP ... the ... International Conference on Advanced Engineering Computing and Applications in Sciences Pub Date : 2019-11-01 DOI: 10.1109/ACOMP.2019.00025
P. N. Huu, Q. Minh, Hieu Nguyen Trong
{"title":"Low-Complexity Encryption Algorithm Considering Energy Balance on Wireless Sensor Networks","authors":"P. N. Huu, Q. Minh, Hieu Nguyen Trong","doi":"10.1109/ACOMP.2019.00025","DOIUrl":"https://doi.org/10.1109/ACOMP.2019.00025","url":null,"abstract":"This paper proposes an effective key-generation scheme applying to data encryption standard (DES) algorithm for wireless sensor networks (WSNs). In the scheme, data encryption is divided into several tasks for multiple nodes along a path from a source node to the base station. We perform simulations to compare distribution and centralization models. The results show that the distributed model obtains more balances in energy consumption compared to the centralization model. The proposed key management method also improves the security level of data by increasing the number of keys with a simple algorithm in WSNs.","PeriodicalId":72112,"journal":{"name":"ADVCOMP ... the ... International Conference on Advanced Engineering Computing and Applications in Sciences","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74012966","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Building a Product Origins Tracking System Based on Blockchain and PoA Consensus Protocol 构建基于区块链和PoA共识协议的产品来源跟踪系统
ADVCOMP ... the ... International Conference on Advanced Engineering Computing and Applications in Sciences Pub Date : 2019-11-01 DOI: 10.1109/ACOMP.2019.00012
A. An, P. Diem, L. Lan, Tran Van Toi, Lam Quoc Huy Le Nguyen Binh
{"title":"Building a Product Origins Tracking System Based on Blockchain and PoA Consensus Protocol","authors":"A. An, P. Diem, L. Lan, Tran Van Toi, Lam Quoc Huy Le Nguyen Binh","doi":"10.1109/ACOMP.2019.00012","DOIUrl":"https://doi.org/10.1109/ACOMP.2019.00012","url":null,"abstract":"In recent years, the traceability of product origins is strongly concerned, particularly for food products as they directly influence human health. Therefore, there have been some efforts to develop product origins tracking systems. In this paper, we propose an approach to building a supply chain management system based on the blockchain technology for agriculture product origins tracking. The supply chain model is borrowed from Walmart's and it is implemented based on the Ethereum framework using the PoA (Proof of Authority) consensus algorithm. Our experiment shows that the proposed system not only fulfills the requirements of a product origins tracking but also takes the advantages of the blockchain technology such as the immutability and security of data, the low cost in making the transactions, and so on.","PeriodicalId":72112,"journal":{"name":"ADVCOMP ... the ... International Conference on Advanced Engineering Computing and Applications in Sciences","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75423339","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整，为了账户安全，请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们：info@booksci.cn Book学术提供免费学术资源搜索服务，方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号：481959085
Book学术官方微信