发布求助
文献互助 智能选刊 最新文献

Foundations and Trends in Machine Learning最新文献

筛选
英文 中文
Message from the AI4S Workshop Chairs 来自AI4S工作坊主席的信息
IF 32.8
Foundations and Trends in Machine Learning Pub Date : 2020-11-01 DOI: 10.1109/mlhpcai4s51975.2020.00005
{"title":"Message from the AI4S Workshop Chairs","authors":"","doi":"10.1109/mlhpcai4s51975.2020.00005","DOIUrl":"https://doi.org/10.1109/mlhpcai4s51975.2020.00005","url":null,"abstract":"","PeriodicalId":47667,"journal":{"name":"Foundations and Trends in Machine Learning","volume":"17 1","pages":""},"PeriodicalIF":32.8,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79769935","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Benders Decomposition Approach to Correlation Clustering 相关聚类的Benders分解方法
IF 32.8
Foundations and Trends in Machine Learning Pub Date : 2020-11-01 DOI: 10.1109/MLHPCAI4S51975.2020.00009
Jovita Lukasik, M. Keuper, M. Singh, Julian Yarkony
{"title":"A Benders Decomposition Approach to Correlation Clustering","authors":"Jovita Lukasik, M. Keuper, M. Singh, Julian Yarkony","doi":"10.1109/MLHPCAI4S51975.2020.00009","DOIUrl":"https://doi.org/10.1109/MLHPCAI4S51975.2020.00009","url":null,"abstract":"We tackle the problem of graph partitioning for image segmentation using correlation clustering (CC), which we treat as an integer linear program (ILP). We reformulate optimization in the ILP so as to admit efficient optimization via Benders decomposition, a classic technique from operations research. Our Benders decomposition formulation has many subproblems, each associated with a node in the CC instance’s graph, which can be solved in parallel. Each Benders subproblem enforces the cycle inequalities corresponding to edges with negative (repulsive) weights attached to its corresponding node in the CC instance. We generate Magnanti-Wong Benders rows in addition to standard Benders rows to accelerate optimization. Our Benders decomposition approach provides a promising new avenue to accelerate optimization for CC, and, in contrast to previous cutting plane approaches, theoretically allows for massive parallelization.","PeriodicalId":47667,"journal":{"name":"Foundations and Trends in Machine Learning","volume":"16 1","pages":"9-16"},"PeriodicalIF":32.8,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80642681","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
High-bypass Learning: Automated Detection of Tumor Cells That Significantly Impact Drug Response 高旁路学习:自动检测显著影响药物反应的肿瘤细胞
IF 32.8
Foundations and Trends in Machine Learning Pub Date : 2020-11-01 DOI: 10.1109/MLHPCAI4S51975.2020.00012
J. Wozniak, H. Yoo, J. Mohd-Yusof, Bogdan Nicolae, Nicholson T. Collier, J. Ozik, T. Brettin, Rick L. Stevens
{"title":"High-bypass Learning: Automated Detection of Tumor Cells That Significantly Impact Drug Response","authors":"J. Wozniak, H. Yoo, J. Mohd-Yusof, Bogdan Nicolae, Nicholson T. Collier, J. Ozik, T. Brettin, Rick L. Stevens","doi":"10.1109/MLHPCAI4S51975.2020.00012","DOIUrl":"https://doi.org/10.1109/MLHPCAI4S51975.2020.00012","url":null,"abstract":"Machine learning in biomedicine is reliant on the availability of large, high-quality data sets. These corpora are used for training statistical or deep learning-based models that can be validated against other data sets and ultimately used to guide decisions. The quality of these data sets is an essential component of the quality of the models and their decisions. Thus, identifying and inspecting outlier data is critical for evaluating, curating, and using biomedical data sets. Many techniques are available to look for outlier data, but it is not clear how to evaluate the impact on highly complex deep learning methods. In this paper, we use deep learning ensembles and workflows to construct a system for automatically identifying data subsets that have a large impact on the trained models. These effects can be quantified and presented to the user for further inspection, which could improve data quality overall. We then present results from running this method on the near-exascale Summit supercomputer.","PeriodicalId":47667,"journal":{"name":"Foundations and Trends in Machine Learning","volume":"82 1","pages":"1-10"},"PeriodicalIF":32.8,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89021495","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Accelerating GPU-based Machine Learning in Python using MPI Library: A Case Study with MVAPICH2-GDR 使用MPI库在Python中加速基于gpu的机器学习:MVAPICH2-GDR的案例研究
IF 32.8
Foundations and Trends in Machine Learning Pub Date : 2020-11-01 DOI: 10.1109/MLHPCAI4S51975.2020.00010
S. M. Ghazimirsaeed, Quentin G. Anthony, A. Shafi, H. Subramoni, D. Panda
{"title":"Accelerating GPU-based Machine Learning in Python using MPI Library: A Case Study with MVAPICH2-GDR","authors":"S. M. Ghazimirsaeed, Quentin G. Anthony, A. Shafi, H. Subramoni, D. Panda","doi":"10.1109/MLHPCAI4S51975.2020.00010","DOIUrl":"https://doi.org/10.1109/MLHPCAI4S51975.2020.00010","url":null,"abstract":"The growth of big data applications during the last decade has led to a surge in the deployment and popularity of machine learning (ML) libraries. On the other hand, the high performance offered by GPUs makes them well suited for ML problems. To take advantage of GPU performance for ML, NVIDIA has recently developed the cuML library. cuML is the GPU counterpart of Scikit-learn, and provides similar Pythonic interfaces to Scikit-learn while hiding the complexities of writing GPU compute kernels directly using CUDA. To support execution of ML workloads on Multi-Node Multi- GPU (MNMG) systems, the cuML library exploits the NVIDIA Collective Communications Library (NCCL) as a backend for collective communications between processes. On the other hand, MPI is a de facto standard for communication in HPC systems. Among various MPI libraries, MVAPICH2-GDR is the pioneer in optimizing GPU communication.This paper explores various aspects and challenges of providing MPI-based communication support for GPU-accelerated cuML applications. More specifically, it proposes a Python API to take advantage of MPI-based communications for cuML applications. It also gives an in-depth analysis, characterization, and benchmarking of the cuML algorithms such as K-Means, Nearest Neighbors, Random Forest, and tSVD. Moreover, it provides a comprehensive performance evaluation and profiling study for MPI-based versus NCCL-based communication for these algorithms. The evaluation results show that the proposed MPI-based communication approach achieves up to 1.6x, 1.25x, 1.25x, and 1.36x speedup for K-Means, Nearest Neighbors, Linear Regression, and tSVD, respectively on up to 32 GPUs.","PeriodicalId":47667,"journal":{"name":"Foundations and Trends in Machine Learning","volume":"31 1","pages":"1-12"},"PeriodicalIF":32.8,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72937514","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Reinforcement Learning-Based Solution to Power Grid Planning and Operation Under Uncertainties 基于强化学习的不确定条件下电网规划与运行解决方案
IF 32.8
Foundations and Trends in Machine Learning Pub Date : 2020-11-01 DOI: 10.1109/MLHPCAI4S51975.2020.00015
X. Shang, Ye Lin, Jing Zhang, Jingping Yang, Jianping Xu, Qin Lyu, R. Diao
{"title":"Reinforcement Learning-Based Solution to Power Grid Planning and Operation Under Uncertainties","authors":"X. Shang, Ye Lin, Jing Zhang, Jingping Yang, Jianping Xu, Qin Lyu, R. Diao","doi":"10.1109/MLHPCAI4S51975.2020.00015","DOIUrl":"https://doi.org/10.1109/MLHPCAI4S51975.2020.00015","url":null,"abstract":"With the ever-increasing stochastic and dynamic behavior observed in today’s bulk power systems, securely and economically planning future operational scenarios that meet all reliability standards under uncertainties becomes a challenging computational task, which typically involves searching feasible and suboptimal solutions in a highly dimensional space via massive numerical simulations. This paper presents a novel approach to achieving this goal by adopting the state-of-the-art reinforcement learning algorithm, Soft Actor Critic (SAC). First, the optimization problem of finding feasible solutions under uncertainties is formulated as Markov Decision Process (MDP). Second, a general and flexible framework is developed to train SAC agent by adjusting generator active power outputs for searching feasible operating conditions. A software prototype is developed that verifies the effectiveness of the proposed approach via numerical studies conducted on the planning cases of the SGCC Zhejiang Electric Power Company.","PeriodicalId":47667,"journal":{"name":"Foundations and Trends in Machine Learning","volume":"18 1","pages":"72-79"},"PeriodicalIF":32.8,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76655913","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Workshop Organization – AI4S 2020 研讨会组织- AI4S 2020
IF 32.8
Foundations and Trends in Machine Learning Pub Date : 2020-11-01 DOI: 10.1109/mlhpcai4s51975.2020.00007
{"title":"Workshop Organization – AI4S 2020","authors":"","doi":"10.1109/mlhpcai4s51975.2020.00007","DOIUrl":"https://doi.org/10.1109/mlhpcai4s51975.2020.00007","url":null,"abstract":"","PeriodicalId":47667,"journal":{"name":"Foundations and Trends in Machine Learning","volume":"30 1","pages":""},"PeriodicalIF":32.8,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87327453","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
EventGraD: Event-Triggered Communication in Parallel Stochastic Gradient Descent 并行随机梯度下降中的事件触发通信
IF 32.8
Foundations and Trends in Machine Learning Pub Date : 2020-11-01 DOI: 10.1109/MLHPCAI4S51975.2020.00008
Soumyadip Ghosh, V. Gupta
{"title":"EventGraD: Event-Triggered Communication in Parallel Stochastic Gradient Descent","authors":"Soumyadip Ghosh, V. Gupta","doi":"10.1109/MLHPCAI4S51975.2020.00008","DOIUrl":"https://doi.org/10.1109/MLHPCAI4S51975.2020.00008","url":null,"abstract":"Communication in parallel systems consumes significant amount of time and energy which often turns out to be a bottleneck in distributed machine learning. In this paper, we present EventGraD - an algorithm with event-triggered communication in parallel stochastic gradient descent. The main idea of this algorithm is to modify the requirement of communication at every epoch to communicating only in certain epochs when necessary. In particular, the parameters are communicated only in the event when the change in their values exceed a threshold. The threshold for a parameter is chosen adaptively based on the rate of change of the parameter. The adaptive threshold ensures that the algorithm can be applied to different models on different datasets without any change. We focus on data-parallel training of a popular convolutional neural network used for training the MNIST dataset and show that EventGraD can reduce the communication load by up to 70% while retaining the same level of accuracy.","PeriodicalId":47667,"journal":{"name":"Foundations and Trends in Machine Learning","volume":"41 1","pages":"1-8"},"PeriodicalIF":32.8,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74075894","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Accelerate Distributed Stochastic Descent for Nonconvex Optimization with Momentum 带动量的非凸优化的加速分布随机下降
IF 32.8
Foundations and Trends in Machine Learning Pub Date : 2020-11-01 DOI: 10.1109/MLHPCAI4S51975.2020.00011
Guojing Cong, Tianyi Liu
{"title":"Accelerate Distributed Stochastic Descent for Nonconvex Optimization with Momentum","authors":"Guojing Cong, Tianyi Liu","doi":"10.1109/MLHPCAI4S51975.2020.00011","DOIUrl":"https://doi.org/10.1109/MLHPCAI4S51975.2020.00011","url":null,"abstract":"Momentum method has been used extensively in optimizers for deep learning. Recent studies show that distributed training through K-step averaging has many nice properties. We propose a momentum method for such model averaging approaches. At each individual learner level traditional stochastic gradient is applied. At the meta-level (global learner level), one momentum term is applied and we call it block momentum. We analyze the convergence and scaling properties of such momentum methods. Our experimental results show that block momentum not only accelerates training, but also achieves better results.","PeriodicalId":47667,"journal":{"name":"Foundations and Trends in Machine Learning","volume":"517 1","pages":"29-39"},"PeriodicalIF":32.8,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77134740","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Workshop Organization – MLHPC 2020 研讨会组织- MLHPC 2020
IF 32.8
Foundations and Trends in Machine Learning Pub Date : 2020-11-01 DOI: 10.1109/mlhpcai4s51975.2020.00006
{"title":"Workshop Organization – MLHPC 2020","authors":"","doi":"10.1109/mlhpcai4s51975.2020.00006","DOIUrl":"https://doi.org/10.1109/mlhpcai4s51975.2020.00006","url":null,"abstract":"","PeriodicalId":47667,"journal":{"name":"Foundations and Trends in Machine Learning","volume":"23 1","pages":""},"PeriodicalIF":32.8,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72977015","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Message from the MLHPC Workshop Chairs 来自MLHPC研讨会主席的信息
IF 32.8
Foundations and Trends in Machine Learning Pub Date : 2020-11-01 DOI: 10.1109/mlhpcai4s51975.2020.00004
{"title":"Message from the MLHPC Workshop Chairs","authors":"","doi":"10.1109/mlhpcai4s51975.2020.00004","DOIUrl":"https://doi.org/10.1109/mlhpcai4s51975.2020.00004","url":null,"abstract":"","PeriodicalId":47667,"journal":{"name":"Foundations and Trends in Machine Learning","volume":"81 1","pages":""},"PeriodicalIF":32.8,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91104494","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
首页 上一页 下一页 尾页
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整，为了账户安全，请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们：info@booksci.cn Book学术提供免费学术资源搜索服务，方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号：481959085
Book学术官方微信