EURO Journal on Computational Optimization最新文献_第2页

Piecewise SOS-convex moment optimization and applications via exact semi-definite programs 通过精确半有限程序进行片断 SOS-凸矩优化及其应用

IF 2.6

EURO Journal on Computational Optimization Pub Date : 2024-01-01 DOI: 10.1016/j.ejco.2024.100094

Q.Y. Huang , V. Jeyakumar , G. Li

{"title":"Piecewise SOS-convex moment optimization and applications via exact semi-definite programs","authors":"Q.Y. Huang , V. Jeyakumar , G. Li","doi":"10.1016/j.ejco.2024.100094","DOIUrl":"https://doi.org/10.1016/j.ejco.2024.100094","url":null,"abstract":"<div><p>This paper presents exact Semi-Definite Program (SDP) reformulations for infinite-dimensional moment optimization problems involving a new class of piecewise Sum-of-Squares (SOS)-convex functions and projected spectrahedral support sets. These reformulations show that solving a single SDP finds the optimal value and an optimal probability measure of the original moment problem. This is done by establishing an SOS representation for the non-negativity of a piecewise SOS-convex function over a projected spectrahedron. Finally, as an application and a proof-of-concept illustration, the paper presents numerical results for the Newsvendor and revenue maximization problems with higher-order moments by solving their equivalent SDP reformulations. These reformulations promise a flexible and efficient approach to solving these models. The main novelty of the present work in relation to the recent research lies in finding the solution to moment problems, for the first time, with piecewise SOS-convex functions from their numerically tractable exact SDP reformulations.</p></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100094"},"PeriodicalIF":2.6,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S219244062400011X/pdfft?md5=a56c7d9f20401f8e18a8c36f5d31f0d6&pid=1-s2.0-S219244062400011X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141483109","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Unboxing Tree ensembles for interpretability: A hierarchical visualization tool and a multivariate optimal re-built tree 为可解释性开箱树集合：分层可视化工具和多元优化重构树

IF 2.4

EURO Journal on Computational Optimization Pub Date : 2024-01-01 DOI: 10.1016/j.ejco.2024.100084

Giulia Di Teodoro, Marta Monaci, Laura Palagi

{"title":"Unboxing Tree ensembles for interpretability: A hierarchical visualization tool and a multivariate optimal re-built tree","authors":"Giulia Di Teodoro, Marta Monaci, Laura Palagi","doi":"10.1016/j.ejco.2024.100084","DOIUrl":"https://doi.org/10.1016/j.ejco.2024.100084","url":null,"abstract":"<div><p>The interpretability of models has become a crucial issue in Machine Learning because of algorithmic decisions' growing impact on real-world applications. Tree ensemble methods, such as Random Forests or XgBoost, are powerful learning tools for classification tasks. However, while combining multiple trees may provide higher prediction quality than a single one, it sacrifices the interpretability property resulting in “black-box” models. In light of this, we aim to develop an interpretable representation of a tree-ensemble model that can provide valuable insights into its behavior. First, given a target tree-ensemble model, we develop a hierarchical visualization tool based on a heatmap representation of the forest's feature use, considering the frequency of a feature and the level at which it is selected as an indicator of importance. Next, we propose a mixed-integer linear programming (MILP) formulation for constructing a single optimal multivariate tree that accurately mimics the target model predictions. The goal is to provide an interpretable surrogate model based on oblique hyperplane splits, which uses only the most relevant features according to the defined forest's importance indicators. The MILP model includes a penalty on feature selection based on their frequency in the forest to further induce sparsity of the splits. The natural formulation has been strengthened to improve the computational performance of mixed-integer software. Computational experience is carried out on benchmark datasets from the UCI repository using a state-of-the-art off-the-shelf solver. Results show that the proposed model is effective in yielding a shallow interpretable tree approximating the tree-ensemble decision function.</p></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100084"},"PeriodicalIF":2.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2192440624000017/pdfft?md5=cf58d262d1df61a2f7105be2f4d9478d&pid=1-s2.0-S2192440624000017-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139503496","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Classifying with uncertain data envelopment analysis 利用不确定数据包络分析进行分类

IF 2.4

EURO Journal on Computational Optimization Pub Date : 2024-01-01 DOI: 10.1016/j.ejco.2024.100090

Casey Garner , Allen Holder

{"title":"Classifying with uncertain data envelopment analysis","authors":"Casey Garner , Allen Holder","doi":"10.1016/j.ejco.2024.100090","DOIUrl":"https://doi.org/10.1016/j.ejco.2024.100090","url":null,"abstract":"<div><p>Classifications organize entities into categories that identify similarities within a category and discern dissimilarities among categories, and they powerfully classify information in support of analysis. We propose a new classification scheme premised on the reality of imperfect data. Our computational model uses uncertain data envelopment analysis to define a classification's proximity to equitable efficiency, which is an aggregate measure of intra-similarity within a classification's categories. Our classification process has two overriding computational challenges, those being a loss of convexity and a combinatorially explosive search space. We overcome the first challenge by establishing lower and upper bounds on the proximity value, and then by searching this range with a first-order algorithm. We address the second challenge by adapting the p-median problem to initiate our exploration, and by then employing an iterative neighborhood search to finalize a classification. We conclude by classifying the thirty stocks in the Dow Jones Industrial average into performant tiers, by classifying prostate treatments into clinically effectual categories, and dividing airlines into peer groups.</p></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100090"},"PeriodicalIF":2.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2192440624000078/pdfft?md5=e5d692d70868e82bb22e6f67f85185e3&pid=1-s2.0-S2192440624000078-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140879764","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Advances in nonlinear optimization and equilibrium problems – Special issue editorial 非线性优化和平衡问题的进展 - 特刊社论

IF 2.4

EURO Journal on Computational Optimization Pub Date : 2024-01-01 DOI: 10.1016/j.ejco.2024.100086

Matteo Lapucci, Fabio Schoen

引用次数: 0

Optimal shapelets tree for time series interpretable classification 用于时间序列可解释分类的最优小形树

IF 2.4

EURO Journal on Computational Optimization Pub Date : 2024-01-01 DOI: 10.1016/j.ejco.2024.100091

Lorenzo Bonasera, Stefano Gualandi

{"title":"Optimal shapelets tree for time series interpretable classification","authors":"Lorenzo Bonasera, Stefano Gualandi","doi":"10.1016/j.ejco.2024.100091","DOIUrl":"https://doi.org/10.1016/j.ejco.2024.100091","url":null,"abstract":"<div><p>Time series shapelets are a state-of-the-art data mining technique that is applied to time series supervised classification tasks. Shapelets are defined as subsequences that retain the most discriminating power contained in time series. The main advantage of shapelets-based methods consists of their great interpretability. Indeed, shapelets can provide the end-user with very helpful insights about the most interesting subsequences. In this paper, we propose a novel Mixed-Integer Programming model to optimize shapelets discovery based on optimal binary decision trees. Our formulation provides a flexible and adaptable classification framework that is interpretable with respect to both the mathematical model and the final output. Computational results for a large class of datasets show that our approach achieves performance comparable with state-of-the-art shapelets-based classification methods. Our model is the first approach based on optimal decision tree induction for time series classification.</p></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100091"},"PeriodicalIF":2.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S219244062400008X/pdfft?md5=b14d7b43a7e4b626d023b6162ce84dcf&pid=1-s2.0-S219244062400008X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141241873","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

On improvements of multi-objective branch and bound 论多目标分支与约束的改进

IF 2.6

EURO Journal on Computational Optimization Pub Date : 2024-01-01 DOI: 10.1016/j.ejco.2024.100099

Julius Bauß , Sophie N. Parragh , Michael Stiglmayr

引用次数: 0

Resource constraint scheduling on two dedicated machines: Application to avionics 两台专用机上的资源约束调度：航空电子设备的应用

IF 2.6

EURO Journal on Computational Optimization Pub Date : 2024-01-01 DOI: 10.1016/j.ejco.2024.100093

Mesli-Kesraoui Ouissem , Ledreck Loic , Grolleau Emmanuel , Kesraoui Soraya , Berruet Pascal , Ouhammou Yassine , Girard Patrick

{"title":"Resource constraint scheduling on two dedicated machines: Application to avionics","authors":"Mesli-Kesraoui Ouissem , Ledreck Loic , Grolleau Emmanuel , Kesraoui Soraya , Berruet Pascal , Ouhammou Yassine , Girard Patrick","doi":"10.1016/j.ejco.2024.100093","DOIUrl":"10.1016/j.ejco.2024.100093","url":null,"abstract":"<div><p>In civil aircraft, two partially redundant hydraulic circuits typically power various systems. During assembly, a critical phase involves simultaneously rinsing and purging these hydraulic circuits using loops. Precedence constraints are necessary to prevent the recontamination of already rinsed loops, leading to increased rinsing time. This paper presents this problem as a unique instance of the Resource Constrained Parallel Machine Scheduling Problem, where each circuit represents a machine, pipe loops to be rinsed represent jobs, and machines share a hydraulic power source. For two dedicated processors and a single resource, an optimal schedule minimizing the makespan can be generated in polynomial time. However, due to the requirement of rinsing certain pipe loops on a circuit before others, there are precedence constraints between some jobs within the same circuit. By employing a reduction of the 3-partition problem, we demonstrate that this situation results in a problem that is NP-hard in the strong sense. We evaluate several Mixed-Integer Linear Programming and Constraint Programming formulations of the problem, using Cplex, CPO, Gurobi, and Z3, against several proposed heuristics. Given that the size of the instances we need to solve exceeds what can be solved in acceptable time by solvers, we propose a heuristic and compare its performance with the optimum.</p></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100093"},"PeriodicalIF":2.6,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2192440624000108/pdfft?md5=609c1088bd5eb7a592a2eadcb5134f21&pid=1-s2.0-S2192440624000108-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141407096","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A variable metric proximal stochastic gradient method: An application to classification problems 可变度量近似随机梯度法：分类问题的应用

IF 2.4

EURO Journal on Computational Optimization Pub Date : 2024-01-01 DOI: 10.1016/j.ejco.2024.100088

Pasquale Cascarano , Giorgia Franchini , Erich Kobler , Federica Porta , Andrea Sebastiani

{"title":"A variable metric proximal stochastic gradient method: An application to classification problems","authors":"Pasquale Cascarano , Giorgia Franchini , Erich Kobler , Federica Porta , Andrea Sebastiani","doi":"10.1016/j.ejco.2024.100088","DOIUrl":"https://doi.org/10.1016/j.ejco.2024.100088","url":null,"abstract":"<div><p>Due to the continued success of machine learning and deep learning in particular, supervised classification problems are ubiquitous in numerous scientific fields. Training these models typically involves the minimization of the empirical risk over large data sets along with a possibly non-differentiable regularization. In this paper, we introduce a stochastic gradient method for the considered classification problem. To control the variance of the objective's gradients, we use an automatic sample size selection along with a variable metric to precondition the stochastic gradient directions. Further, we utilize a non-monotone line search to automatize step size selection. Convergence results are provided for both convex and non-convex objective functions. Extensive numerical experiments verify that the suggested approach performs on par with state-of-the-art methods for training both statistical models for binary classification and artificial neural networks for multi-class image classification. The code is publicly available at <span>https://github.com/koblererich/lisavm</span><svg><path></path></svg>.</p></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100088"},"PeriodicalIF":2.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2192440624000054/pdfft?md5=738f38c0990532c2e5eec98c42a34bd4&pid=1-s2.0-S2192440624000054-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140647201","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Design of experiments for the stochastic unit commitment with economic dispatch models 采用经济调度模型的随机机组承诺试验设计

IF 2.4

EURO Journal on Computational Optimization Pub Date : 2024-01-01 DOI: 10.1016/j.ejco.2024.100089

Nahal Sakhavand , Jay Rosenberger , Victoria C.P. Chen , Harsha Gangammanavar

{"title":"Design of experiments for the stochastic unit commitment with economic dispatch models","authors":"Nahal Sakhavand , Jay Rosenberger , Victoria C.P. Chen , Harsha Gangammanavar","doi":"10.1016/j.ejco.2024.100089","DOIUrl":"https://doi.org/10.1016/j.ejco.2024.100089","url":null,"abstract":"<div><p>We develop a Design and Analysis of the Computer Experiments (DACE) approach to the stochastic unit commitment problem for power systems with significant renewable integration. For this purpose, we use a two-stage stochastic programming formulation of the stochastic unit commitment-economic dispatch problem. Typically, a sample average approximation of the true problem is solved using a cutting plane method (such as the L-shaped method) or scenario decomposition (such as Progressive Hedging) algorithms. However, when the number of scenarios increases, these solution methods become computationally prohibitive. To address this challenge, we develop a novel DACE approach that exploits the structure of the first-stage unit commitment decision space in a design of experiments, uses features based upon solar generation, and trains a multivariate adaptive regression splines model to approximate the second stage of the stochastic unit commitment-economic dispatch problem. We conduct experiments on two modified IEEE-57 and IEEE-118 test systems and assess the quality of the solutions obtained from both the DACE and the L-shaped methods in a replicated procedure. The results obtained from this approach attest to the significant improvement in the computational performance of the DACE approach over the traditional L-shaped method.</p></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100089"},"PeriodicalIF":2.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2192440624000066/pdfft?md5=734ce10eb038b678d854fede2426d31a&pid=1-s2.0-S2192440624000066-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140906327","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A two-point heuristic to calculate the stepsize in subgradient method with application to a network design problem 计算子梯度法步长的两点启发式，并应用于网络设计问题

IF 2.4

EURO Journal on Computational Optimization Pub Date : 2024-01-01 DOI: 10.1016/j.ejco.2024.100092

F. Carrabs , M. Gaudioso , G. Miglionico

{"title":"A two-point heuristic to calculate the stepsize in subgradient method with application to a network design problem","authors":"F. Carrabs , M. Gaudioso , G. Miglionico","doi":"10.1016/j.ejco.2024.100092","DOIUrl":"10.1016/j.ejco.2024.100092","url":null,"abstract":"<div><p>We introduce a heuristic rule for calculating the stepsize in the subgradient method for unconstrained convex nonsmooth optimization which, unlike the classic approach, is based on retaining some information from previous iteration. The rule is inspired by the well known two-point stepsize by Barzilai and Borwein (BB) <span>[6]</span> for smooth optimization and it coincides with (BB) in case the function to be minimised is convex quadratic.</p><p>Under the use of appropriate safeguards we demonstrate that the method terminates at a point that satisfies an approximate optimality condition.</p><p>The proposed approach is tested in the framework of Lagrangian relaxation for integer linear programming where the Lagrangian dual requires maximization of a concave and nonsmooth (piecewise affine) function. In particular we focus on the relaxation of the Minimum Spanning Tree problem with Conflicting Edge Pairs (MSTC). Comparison with classic subgradient method is presented. The results on some widely used academic test problems are provided too.</p></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100092"},"PeriodicalIF":2.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2192440624000091/pdfft?md5=8c30a5148ef2dc0e6dc45f8a7bbd0259&pid=1-s2.0-S2192440624000091-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141130830","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0