{"title":"Extending the hypergradient descent technique to reduce the time of optimal solution achieved in hyperparameter optimization algorithms","authors":"F. Seifi, S. T. A. Niaki","doi":"10.5267/j.ijiec.2023.4.004","DOIUrl":"https://doi.org/10.5267/j.ijiec.2023.4.004","url":null,"abstract":"There have been many applications for machine learning algorithms in different fields. The importance of hyperparameters for machine learning algorithms is their control over the behaviors of training algorithms and their crucial impact on the performance of machine learning models. Tuning hyperparameters crucially affects the performance of machine learning algorithms, and future advances in this area mainly depend on well-tuned hyperparameters. Nevertheless, the high computational cost involved in evaluating the algorithms in large datasets or complicated models is a significant limitation that causes inefficiency of the tuning process. Besides, increased online applications of machine learning approaches have led to the requirement of producing good answers in less time. The present study first presents a novel classification of hyperparameter types based on their types to create high-quality solutions quickly. Then, based on this classification and using the hypergradient technique, some hyperparameters of deep learning algorithms are adjusted during the training process to decrease the search space and discover the optimal values of the hyperparameters. This method just needs only the parameters of the previous two steps and the gradient of the previous step. Finally, the proposed method is combined with other techniques in hyperparameter optimization, and the results are reviewed in two case studies. As confirmed by experimental results, the performance of the algorithms with the proposed method have been increased 36.62% and 23.16% (based on the best average accuracy) for Cifar10 and Cifar100 dataset respectively in early stages while the final produced answers with this method are equal to or better than the algorithms without it. Therefore, this method can be combined with hyperparameter optimization algorithms in order to improve their performance and make them more appropriate for online use by just using the parameters of the previous two steps and the gradient of the previous step.","PeriodicalId":51356,"journal":{"name":"International Journal of Industrial Engineering Computations","volume":"os-40 1","pages":""},"PeriodicalIF":3.3,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87228503","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The bid generation problem in combinatorial auctions for transportation service procurement","authors":"Fang Yang, Shengyin Li, Yao-Huei Huang","doi":"10.5267/j.ijiec.2023.4.003","DOIUrl":"https://doi.org/10.5267/j.ijiec.2023.4.003","url":null,"abstract":"In this work, a probabilistic bid generation problem with the pricing of a bundle of lanes and carrier’s vehicle routing is considered as it is an importation in transportation service procurement. Depending on the network of the vehicle, there exist multiple lanes for traveling between two locations. To solve the bid generation problem efficiently, a two-phase method approach is presented. At the core of the procedure a feasible vehicle routing problem on a multidigraph is solved by an exhaustive search algorithm to enumerate all routes concerning routing constraints and treat each route as a decision variable in the set partitioning formulation. We examine our model both analytically and empirically using a simulation-based analysis.","PeriodicalId":51356,"journal":{"name":"International Journal of Industrial Engineering Computations","volume":"9 1","pages":""},"PeriodicalIF":3.3,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85951589","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An integrated optimization for minimizing the operation cost of home delivery services in O2O retail","authors":"Xu Wang, Jian Zhong","doi":"10.5267/j.ijiec.2022.12.005","DOIUrl":"https://doi.org/10.5267/j.ijiec.2022.12.005","url":null,"abstract":"During the spread of the epidemic, the home delivery service (HDS) has been quickly introduced by retailers which helps customers avoid the risk of viral infection while shopping at offline stores. However, the operation cost of HDS is a huge investment for O2O retailers. How to minimize the operating costs of HDS is an urgent issue for the industry. To solve this problem, we outline those management decisions of HDS that have an impact on operating costs, including dynamic vehicle routing, driver sizing and scheduling, and propose an integrated optimization model by comprehensively considering these management decisions. Moreover, the dynamic feature of online orders and the heterogeneous workforces are also considered in this model. To solve this model, an efficient adaptive large neighborhood search (ALNS) and branch-and-cut algorithms are developed. In the case study, we collected real data from a leading O2O retailer in China to assess the effectiveness of our proposed model and algorithms. Experimental results show that our approach can effectively reduce the operating costs of HDS. Furthermore, a comprehensive analysis is conducted to reveal the changing patterns in operating costs, and some valuable management insights are provided for O2O retailers. The theoretical and numerical results would shed light on the management of HDS for O2O retailers.","PeriodicalId":51356,"journal":{"name":"International Journal of Industrial Engineering Computations","volume":"62 1","pages":""},"PeriodicalIF":3.3,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79025875","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Sales mode selection strategic analysis for risk-averse manufacturers under revenue sharing contracts","authors":"Gui‐Hua Lin, Xiaoli Xiong, Yuwei Li, Xide Zhu","doi":"10.5267/j.ijiec.2022.11.001","DOIUrl":"https://doi.org/10.5267/j.ijiec.2022.11.001","url":null,"abstract":"This paper considers a sales mode selection problem under revenue sharing contracts between resale and agency modes for risk-averse manufacturers with traditional retail channel, direct selling channel, and e-commerce platform channel. By considering the factors including price competition intensity, market share, revenue sharing ratio, commission rate, and degree of risk aversion, we construct leader-follower game models with manufacturers as leaders and traditional retailers and e-commerce platforms as followers. To obtain optimal solutions, we discuss conditions to ensure the upper and lower models to be convex and then give the optimal strategies for all members in the network. Through numerical experiments, we analyze the involved parameters’ impact on sales mode selection strategy and the changing trends of each member's optimal pricing and profit under different sales modes. The numerical results reveal the following revelations: The manufacturer should choose the agency mode when the commission rate is low and the direct selling channel has a large market share. If both the commission rate and degree of risk aversion are high, direct selling channels have a low market share, and price competition intensity is weak, the manufacturer should choose the resale mode. The degree of risk aversion has an effect on each member’s optimal decision. Regardless of which sales mode the manufacturer chooses, the optimal price of each member decreases as the degree of risk aversion increases. Under certain conditions, the manufacturer’s choice of agency mode can create win-win situations with supply chain members.","PeriodicalId":51356,"journal":{"name":"International Journal of Industrial Engineering Computations","volume":"29 1","pages":""},"PeriodicalIF":3.3,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82624392","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A joint replenishment problem with the (T,ki) policy under obsolescence","authors":"Ricardo Afonso, P. Godinho, J. Costa","doi":"10.5267/j.ijiec.2023.4.002","DOIUrl":"https://doi.org/10.5267/j.ijiec.2023.4.002","url":null,"abstract":"Companies are frequently confronted with the need to order different types of items from a single supplier or to manufacture the items in a production line. Indeed, coordinated ordering of multiple items may lead to important savings whenever a family of items can be ordered from a common supplier, produced in a common facility, or use a common mode of transportation. The Joint Replenishment Problem (JRP) tackles the coordinated replenishment of multiple items by minimizing the total cost, composed of ordering (or setup) costs and holding costs, while satisfying the demand. On the other hand, when items are subject to obsolescence, they may face an abrupt decline in demand as they are no longer needed. This decline can be caused by reasons such as rapid advancements in technology, going out of fashion, or ceasing to be economically viable. The present article develops an extension of the JRP where the items may suddenly become obsolete during an infinite planning horizon. The point at which an item becomes obsolete is uncertain. The lifetimes of the items are assumed to follow independent negative exponential distributions. A model is proposed by using the total expected discounted cost as the minimization criterion. The time value of money is considered through an appropriate discount rate. Extensive tests were performed to assess the impact of obsolescence rates and discount rates on the ordering policies. The progressive increase of the obsolescence rates determines smaller periods between successive replenishments, while the progressive increase of the discount rate determines smaller lot sizes.","PeriodicalId":51356,"journal":{"name":"International Journal of Industrial Engineering Computations","volume":"9 1","pages":""},"PeriodicalIF":3.3,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75216412","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Bi-Objective simplified swarm optimization for fog computing task scheduling","authors":"Wei-Chang Yeh, Zhenyao Liu, Kuan-Cheng Tseng","doi":"10.5267/j.ijiec.2023.7.004","DOIUrl":"https://doi.org/10.5267/j.ijiec.2023.7.004","url":null,"abstract":"In the face of burgeoning data volumes, latency issues present a formidable challenge to cloud computing. This problem has been strategically tackled through the advent of fog computing, shifting computations from central cloud data centers to local fog devices. This process minimizes data transmission to distant servers, resulting in significant cost savings and instantaneous responses for users. Despite the urgency of many fog computing applications, existing research falls short in providing time-effective and tailored algorithms for fog computing task scheduling. To bridge this gap, we introduce a unique local search mechanism, Card Sorting Local Search (CSLS), that augments the non-dominated solutions found by the Bi-objective Simplified Swarm Optimization (BSSO). We further propose Fast Elite Selecting (FES), a ground-breaking one-front non-dominated sorting method that curtails the time complexity of non-dominated sorting processes. By integrating BSSO, CSLS, and FES, we are unveiling a novel algorithm, Elite Swarm Simplified Optimization (EliteSSO), specifically developed to conquer time-efficiency and non-dominated solution issues, predominantly in large-scale fog computing task scheduling conundrums. Computational evidence reveals that our proposed algorithm is both highly efficient in terms of time and exceedingly effective, outstripping other algorithms on a significant scale.","PeriodicalId":51356,"journal":{"name":"International Journal of Industrial Engineering Computations","volume":"238 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135784230","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"General variable neighborhood search for electric vehicle routing problem with time-dependent speeds and soft time windows","authors":"Luka Matijević","doi":"10.5267/j.ijiec.2023.2.001","DOIUrl":"https://doi.org/10.5267/j.ijiec.2023.2.001","url":null,"abstract":"With the growing environmental concerns and the rising number of electric vehicles, researchers and companies are paying more and more attention to green logistics. This paper studies the Electric Vehicle Routing Problem with time-dependent speeds and soft time windows. The purpose is to minimize the total distance travelled, while penalizing early or late arrivals at the customers’ locations. For this purpose, we formulated the Mixed Integer Linear Program (MILP) and developed a General Variable Neighborhood Search (GVNS) metaheuristic, an efficient way to tackle this problem. To prove the efficiency of our approach, we tested the GVNS against the Adaptive Large Neighborhood Search (ALNS) algorithm and our MILP model, using a set of available benchmark instances. After an extensive experimental evaluation, we concluded that GVNS can find better quality solutions than other methods considered in this research or the same quality solution in less time.","PeriodicalId":51356,"journal":{"name":"International Journal of Industrial Engineering Computations","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135535137","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"To reduce maximum tardiness by Seru Production: model, cooperative algorithm combining reinforcement learning and insights","authors":"Guanghui Fu, Yang Yu, Wei Sun, I. Kaku","doi":"10.5267/j.ijiec.2022.10.002","DOIUrl":"https://doi.org/10.5267/j.ijiec.2022.10.002","url":null,"abstract":"The maximum tardiness reflects the worst level of service associated with customer needs; thus, the principle that seru production reduces the maximum tardiness is investigated, and a model to minimize the maximum tardiness of the seru production system is established. In order to obtain the exact solution, the non-linear seru production model with minimizing the maximum tardiness is split into a seru formation model and a linear seru scheduling model. We propose an efficient cooperative algorithm using a genetic algorithm and an innovative reinforcement learning algorithm (CAGARL) for large-scale problems. Specifically, the GA is designed for the seru formation problem. Moreover, the QL-seru algorithm (QLSA) is designed for the seru scheduling problem by combining the features of meta-heuristics and reinforcement learning. In the QLSA, we design an innovative QL-seru table and two state trimming rules to save computational time. After extensive experiments, compared with the previous algorithm, CAGARL improved by an average of 56.6%. Finally, several managerial insights on reducing maximum tardiness are proposed.","PeriodicalId":51356,"journal":{"name":"International Journal of Industrial Engineering Computations","volume":"91 1","pages":""},"PeriodicalIF":3.3,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83980563","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Unrelated parallel machine scheduling with machine processing cost","authors":"H. Safarzadeh, S. T. A. Niaki","doi":"10.5267/j.ijiec.2022.10.004","DOIUrl":"https://doi.org/10.5267/j.ijiec.2022.10.004","url":null,"abstract":"In practical scheduling problems, some factors such as depreciation cost, green costs like the amount of energy consumption or carbon emission, other resources consumption, raw material cost, etc., are not explicitly related to the machine processing times. Most of these factors can be generally considered as machine costs. Considering the machine cost as another objective alongside the other classical time-driven decision objectives can be an attractive work in scheduling problems. However, this subject has not been discussed thoroughly in the literature for the case the machines have fixed processing costs. This paper investigates a general unrelated parallel machine scheduling problem with the machine processing cost. In this problem, it is assumed that processing a job on a machine incurs a particular cost in addition to processing time. The considered objectives are the makespan and the total cost, which are minimized simultaneously to obtain Pareto optimal solutions. The efficacy of the mathematical programming approach to solve the considered problem is evaluated rigorously in this paper. In this respect, a multiobjective solution procedure is proposed to generate a set of appropriate Pareto solutions for the decision-maker based on the mathematical programming approach. In this procedure, the ϵ-constraint method is first used to convert the bi-objective optimization problem into single-objective problems by transferring the makespan to the set of constraints. Then, the single-objective problems are solved using the CPLEX software. Moreover, some strategies are also used to reduce the solution time of the problem. At the end of the paper, comprehensive numerical experiments are conducted to evaluate the performance of the proposed multiobjective solution procedure. A vast range of problem sizes is selected for the test problems, up to 50 machines and 500 jobs. Furthermore, some rigorous analyses are performed to significantly restrict the patterns of generating processing time and cost parameters for the problem instances. The experimental results demonstrate the mathematical programming solution approach's efficacy in solving the problem. It is observed that even for large-scale problems, a diverse set of uniformly distributed Pareto solutions can be generated in a reasonable time with the gaps from the optimality less than 0.03 most of the time.","PeriodicalId":51356,"journal":{"name":"International Journal of Industrial Engineering Computations","volume":"21 1","pages":""},"PeriodicalIF":3.3,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89709087","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Optimization for bi-objective express transportation network design under multiple topological structures","authors":"Jian Zhong, Xu Wang, Longxiao Li, Sergio García","doi":"10.5267/j.ijiec.2023.2.003","DOIUrl":"https://doi.org/10.5267/j.ijiec.2023.2.003","url":null,"abstract":"With the rapid development of the courier industry, customers are placing higher demands on the cost and delivery time of courier services. Therefore, this paper focuses on the bi-objective express transportation network design problem (BO-ETNDP) to minimize the operation cost and maximum arrival time. A multi-structure parallel design methodology (MS-PDM) is proposed to solve the BO-ETNDP. In this methodology, all topological structures commonly used in designing transportation networks are sorted out. For each topological structure, a novel bi-objective nonlinear mixed-integer optimization model for BO-ETNDP is developed considering the impact of the hub’s sorting efficiency on the operation cost and arrival time. To solve these models, a preference-based multi-objective algorithm (PB-MOA) is devised, which embeds the branch-and-cut algorithm and Pareto dominance theory in the framework of this ranking algorithm. In the case study, the applicability of the proposed methodology is verified in a real-world leading express company. The results show that our methodology can effectively avoid the limitation of solving the BO-ETNDP with a specific structure. Besides, the suitable topology for designing express transportation networks in different scenarios are explored through the sensitivity analysis.","PeriodicalId":51356,"journal":{"name":"International Journal of Industrial Engineering Computations","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135535136","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}