Shengyu Feng , Jaehyung Kim , Yiming Yang , Joseph Boudreau , Tasnuva Chowdhury , Adolfy Hoisie , Raees Khan , Ozgur O. Kilic , Scott Klasky , Tatiana Korchuganova , Paul Nilsson , Verena Ingrid Martinez Outschoorn , David K. Park , Norbert Podhorszki , Yihui Ren , Frédéric Suter , Sairam Sri Vatsavai , Wei Yang , Shinjae Yoo , Tadashi Maeno , Alexei Klimentov
{"title":"网格计算联合作业调度和数据分配的可选混合整数线性规划优化","authors":"Shengyu Feng , Jaehyung Kim , Yiming Yang , Joseph Boudreau , Tasnuva Chowdhury , Adolfy Hoisie , Raees Khan , Ozgur O. Kilic , Scott Klasky , Tatiana Korchuganova , Paul Nilsson , Verena Ingrid Martinez Outschoorn , David K. Park , Norbert Podhorszki , Yihui Ren , Frédéric Suter , Sairam Sri Vatsavai , Wei Yang , Shinjae Yoo , Tadashi Maeno , Alexei Klimentov","doi":"10.1016/j.future.2025.108075","DOIUrl":null,"url":null,"abstract":"<div><div>This paper presents a novel approach to the joint optimization of job scheduling and data allocation in grid computing environments. We formulate this joint optimization problem as a mixed integer quadratically constrained program. To tackle the nonlinearity in the constraint, we alternatively fix a subset of decision variables and optimize the remaining ones via Mixed Integer Linear Programming (MILP). We solve the MILP problem at each iteration via an off-the-shelf MILP solver. Our experimental results show that our method significantly outperforms existing heuristic methods, employing either independent optimization or joint optimization strategies. We have also verified the generalization ability of our method over grid environments with various sizes and its high robustness to the algorithm setting.</div></div>","PeriodicalId":55132,"journal":{"name":"Future Generation Computer Systems-The International Journal of Escience","volume":"175 ","pages":"Article 108075"},"PeriodicalIF":6.2000,"publicationDate":"2025-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Alternative mixed integer linear programming optimization for joint job scheduling and data allocation in grid computing\",\"authors\":\"Shengyu Feng , Jaehyung Kim , Yiming Yang , Joseph Boudreau , Tasnuva Chowdhury , Adolfy Hoisie , Raees Khan , Ozgur O. Kilic , Scott Klasky , Tatiana Korchuganova , Paul Nilsson , Verena Ingrid Martinez Outschoorn , David K. Park , Norbert Podhorszki , Yihui Ren , Frédéric Suter , Sairam Sri Vatsavai , Wei Yang , Shinjae Yoo , Tadashi Maeno , Alexei Klimentov\",\"doi\":\"10.1016/j.future.2025.108075\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>This paper presents a novel approach to the joint optimization of job scheduling and data allocation in grid computing environments. We formulate this joint optimization problem as a mixed integer quadratically constrained program. To tackle the nonlinearity in the constraint, we alternatively fix a subset of decision variables and optimize the remaining ones via Mixed Integer Linear Programming (MILP). We solve the MILP problem at each iteration via an off-the-shelf MILP solver. Our experimental results show that our method significantly outperforms existing heuristic methods, employing either independent optimization or joint optimization strategies. We have also verified the generalization ability of our method over grid environments with various sizes and its high robustness to the algorithm setting.</div></div>\",\"PeriodicalId\":55132,\"journal\":{\"name\":\"Future Generation Computer Systems-The International Journal of Escience\",\"volume\":\"175 \",\"pages\":\"Article 108075\"},\"PeriodicalIF\":6.2000,\"publicationDate\":\"2025-08-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Future Generation Computer Systems-The International Journal of Escience\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0167739X25003693\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, THEORY & METHODS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Future Generation Computer Systems-The International Journal of Escience","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0167739X25003693","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, THEORY & METHODS","Score":null,"Total":0}
Alternative mixed integer linear programming optimization for joint job scheduling and data allocation in grid computing
This paper presents a novel approach to the joint optimization of job scheduling and data allocation in grid computing environments. We formulate this joint optimization problem as a mixed integer quadratically constrained program. To tackle the nonlinearity in the constraint, we alternatively fix a subset of decision variables and optimize the remaining ones via Mixed Integer Linear Programming (MILP). We solve the MILP problem at each iteration via an off-the-shelf MILP solver. Our experimental results show that our method significantly outperforms existing heuristic methods, employing either independent optimization or joint optimization strategies. We have also verified the generalization ability of our method over grid environments with various sizes and its high robustness to the algorithm setting.
期刊介绍:
Computing infrastructures and systems are constantly evolving, resulting in increasingly complex and collaborative scientific applications. To cope with these advancements, there is a growing need for collaborative tools that can effectively map, control, and execute these applications.
Furthermore, with the explosion of Big Data, there is a requirement for innovative methods and infrastructures to collect, analyze, and derive meaningful insights from the vast amount of data generated. This necessitates the integration of computational and storage capabilities, databases, sensors, and human collaboration.
Future Generation Computer Systems aims to pioneer advancements in distributed systems, collaborative environments, high-performance computing, and Big Data analytics. It strives to stay at the forefront of developments in grids, clouds, and the Internet of Things (IoT) to effectively address the challenges posed by these wide-area, fully distributed sensing and computing systems.