Ricardo M. Lima , Gonzalo E. Constante-Flores , Antonio J. Conejo , Omar M. Knio
{"title":"An effective hybrid decomposition approach to solve the network-constrained stochastic unit commitment problem in large-scale power systems","authors":"Ricardo M. Lima , Gonzalo E. Constante-Flores , Antonio J. Conejo , Omar M. Knio","doi":"10.1016/j.ejco.2024.100085","DOIUrl":"https://doi.org/10.1016/j.ejco.2024.100085","url":null,"abstract":"<div><p>We propose a novel hybrid method to solve the network-constrained stochastic unit commitment problem. We target realistic large-scale instances including hundreds of thermal generation units, thousands of transmission lines and nodes, and a large number of stochastic renewable generation units. This scheduling problem is formulated as a two-stage stochastic programming problem with continuous and binary variables in the first stage and only continuous variables in the second stage. We develop a hybrid solution method that decomposes the original problem into a master problem including unit commitment and dispatch decisions, and decomposed subproblems representing dispatch with transmission constraints per scenario. The proposed decomposition embeds a column-and-constraint generation step within the traditional Benders decomposition framework. The performance of the proposed decomposition technique is contrasted with the solution of the extensive form via branch-and-cut and Benders decomposition available in commercial solvers, and with conventional Benders decomposition variants. Our computational experiments show that the proposed method generates bounds of superior quality and finds solutions for instances where other approaches fail.</p></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100085"},"PeriodicalIF":2.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2192440624000029/pdfft?md5=6e5b9d1b9d47dcb072bff8ae23d37d2b&pid=1-s2.0-S2192440624000029-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139714415","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"New computational results for integrated production and outbound distribution scheduling problems for a product with a short lifespan","authors":"Markó Horváth","doi":"10.1016/j.ejco.2024.100095","DOIUrl":"https://doi.org/10.1016/j.ejco.2024.100095","url":null,"abstract":"<div><p>In this paper, we consider an integrated production and outbound distribution scheduling problem with a single production site, and its extension to multiple plants. A set of orders must be satisfied such that the required pieces from a single product must be first processed on a single machine in a plant, then must be delivered to the customers before their lifespan expire using a single vehicle. The goal is to minimize the makespan of the solution, which is the return time of the vehicle after its last trip. We propose an elementary variable neighborhood search to solve the problem, using two new local search operators. Our computational results show that this simple procedure outperforms the existing, sometimes complex approaches on the widely used benchmark dataset. We also review the existing computational results, and demonstrate that in some cases the comparisons in the literature are invalid due to the use of different rounding of the data. By re-evaluating the accessible solutions we provide a fair comparison for each rounding method. We also consider the extension of the problem to multiple plants, and adapt our solution approach for this extension. Our experiments show that our method is competitive in terms of solution quality with the existing solution approach for the problem.</p></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100095"},"PeriodicalIF":2.6,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2192440624000121/pdfft?md5=cf7e3d7b2aaa208cbc58be5f8cb0cff9&pid=1-s2.0-S2192440624000121-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141483110","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Communication-efficient ADMM using quantization-aware Gaussian process regression","authors":"Aldo Duarte , Truong X. Nghiem , Shuangqing Wei","doi":"10.1016/j.ejco.2024.100098","DOIUrl":"10.1016/j.ejco.2024.100098","url":null,"abstract":"<div><p>In networks consisting of agents communicating with a central coordinator and working together to solve a global optimization problem in a distributed manner, the agents are often required to solve private proximal minimization subproblems. Such a setting often requires a decomposition method to solve the global distributed problem, resulting in extensive communication overhead. In networks where communication is expensive, it is crucial to reduce the communication overhead of the distributed optimization scheme. Gaussian processes (GPs) are effective at learning the agents' local proximal operators, thereby reducing the communication between the agents and the coordinator. We propose combining this learning method with adaptive uniform quantization for a hybrid approach that can achieve further communication reduction. In our approach, due to data quantization, the GP algorithm is modified to account for the introduced quantization noise statistics. We further improve our approach by introducing an orthogonalization process to the quantizer's input to address the inherent correlation of the input components. We also use dithering to ensure uncorrelation between the quantizer's introduced noise and its input. We propose multiple measures to quantify the trade-off between the communication cost reduction and the optimization solution's accuracy/optimality. Under such metrics, our proposed algorithms can achieve significant communication reduction for distributed optimization with acceptable accuracy, even at low quantization resolutions. This result is demonstrated by simulations of a distributed sharing problem with quadratic cost functions for the agents.</p></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100098"},"PeriodicalIF":2.6,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2192440624000157/pdfft?md5=8fd7b21c89e782f11b9739c488b6329b&pid=1-s2.0-S2192440624000157-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142238586","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Finding quadratic underestimators for optimal value functions of nonconvex all-quadratic problems via copositive optimization","authors":"Markus Gabl , Immanuel M. Bomze","doi":"10.1016/j.ejco.2024.100100","DOIUrl":"10.1016/j.ejco.2024.100100","url":null,"abstract":"<div><div>Modeling parts of an optimization problem as an optimal value function that depends on a top-level decision variable is a regular occurrence in optimization and an essential ingredient for methods such as Benders Decomposition. It often allows for the disentanglement of computational complexity and exploitation of special structures in the lower-level problem that define the optimal value functions. If this problem is convex, duality theory can be used to build piecewise affine models of the optimal value function over which the top-level problem can be optimized efficiently. In this text, we are interested in the optimal value function of an all-quadratic problem (also called quadratically constrained quadratic problem, QCQP) which is not necessarily convex, so that duality theory can not be applied without introducing a generally unquantifiable relaxation error. This issue can be bypassed by employing copositive reformulations of the underlying QCQP. We investigate two ways to parametrize these by the top-level variable. The first one leads to a copositive characterization of an underestimator that is sandwiched between the convex envelope of the optimal value function and that envelope's lower-semicontinuous hull. The dual of that characterization allows us to derive affine underestimators. The second parametrization yields an alternative characterization of the optimal value function itself, which other than the original version has an exact dual counterpart. From the latter, we can derive convex and nonconvex quadratic underestimators of the optimal value function. In fact, we can show that any quadratic underestimator is associated with a dual feasible solution in a certain sense.</div></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100100"},"PeriodicalIF":2.6,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142748605","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Marguerite Frank Award for the best EJCO paper 2023","authors":"Immanuel Bomze (Editor-in-Chief)","doi":"10.1016/j.ejco.2024.100087","DOIUrl":"https://doi.org/10.1016/j.ejco.2024.100087","url":null,"abstract":"","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100087"},"PeriodicalIF":2.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2192440624000042/pdfft?md5=3ca95c18288e8c3fc289a7d12d73c8bb&pid=1-s2.0-S2192440624000042-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140179665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Piecewise SOS-convex moment optimization and applications via exact semi-definite programs","authors":"Q.Y. Huang , V. Jeyakumar , G. Li","doi":"10.1016/j.ejco.2024.100094","DOIUrl":"https://doi.org/10.1016/j.ejco.2024.100094","url":null,"abstract":"<div><p>This paper presents exact Semi-Definite Program (SDP) reformulations for infinite-dimensional moment optimization problems involving a new class of piecewise Sum-of-Squares (SOS)-convex functions and projected spectrahedral support sets. These reformulations show that solving a single SDP finds the optimal value and an optimal probability measure of the original moment problem. This is done by establishing an SOS representation for the non-negativity of a piecewise SOS-convex function over a projected spectrahedron. Finally, as an application and a proof-of-concept illustration, the paper presents numerical results for the Newsvendor and revenue maximization problems with higher-order moments by solving their equivalent SDP reformulations. These reformulations promise a flexible and efficient approach to solving these models. The main novelty of the present work in relation to the recent research lies in finding the solution to moment problems, for the first time, with piecewise SOS-convex functions from their numerically tractable exact SDP reformulations.</p></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100094"},"PeriodicalIF":2.6,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S219244062400011X/pdfft?md5=a56c7d9f20401f8e18a8c36f5d31f0d6&pid=1-s2.0-S219244062400011X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141483109","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Unboxing Tree ensembles for interpretability: A hierarchical visualization tool and a multivariate optimal re-built tree","authors":"Giulia Di Teodoro, Marta Monaci, Laura Palagi","doi":"10.1016/j.ejco.2024.100084","DOIUrl":"https://doi.org/10.1016/j.ejco.2024.100084","url":null,"abstract":"<div><p>The interpretability of models has become a crucial issue in Machine Learning because of algorithmic decisions' growing impact on real-world applications. Tree ensemble methods, such as Random Forests or XgBoost, are powerful learning tools for classification tasks. However, while combining multiple trees may provide higher prediction quality than a single one, it sacrifices the interpretability property resulting in “black-box” models. In light of this, we aim to develop an interpretable representation of a tree-ensemble model that can provide valuable insights into its behavior. First, given a target tree-ensemble model, we develop a hierarchical visualization tool based on a heatmap representation of the forest's feature use, considering the frequency of a feature and the level at which it is selected as an indicator of importance. Next, we propose a mixed-integer linear programming (MILP) formulation for constructing a single optimal multivariate tree that accurately mimics the target model predictions. The goal is to provide an interpretable surrogate model based on oblique hyperplane splits, which uses only the most relevant features according to the defined forest's importance indicators. The MILP model includes a penalty on feature selection based on their frequency in the forest to further induce sparsity of the splits. The natural formulation has been strengthened to improve the computational performance of mixed-integer software. Computational experience is carried out on benchmark datasets from the UCI repository using a state-of-the-art off-the-shelf solver. Results show that the proposed model is effective in yielding a shallow interpretable tree approximating the tree-ensemble decision function.</p></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100084"},"PeriodicalIF":2.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2192440624000017/pdfft?md5=cf58d262d1df61a2f7105be2f4d9478d&pid=1-s2.0-S2192440624000017-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139503496","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Classifying with uncertain data envelopment analysis","authors":"Casey Garner , Allen Holder","doi":"10.1016/j.ejco.2024.100090","DOIUrl":"https://doi.org/10.1016/j.ejco.2024.100090","url":null,"abstract":"<div><p>Classifications organize entities into categories that identify similarities within a category and discern dissimilarities among categories, and they powerfully classify information in support of analysis. We propose a new classification scheme premised on the reality of imperfect data. Our computational model uses uncertain data envelopment analysis to define a classification's proximity to equitable efficiency, which is an aggregate measure of intra-similarity within a classification's categories. Our classification process has two overriding computational challenges, those being a loss of convexity and a combinatorially explosive search space. We overcome the first challenge by establishing lower and upper bounds on the proximity value, and then by searching this range with a first-order algorithm. We address the second challenge by adapting the p-median problem to initiate our exploration, and by then employing an iterative neighborhood search to finalize a classification. We conclude by classifying the thirty stocks in the Dow Jones Industrial average into performant tiers, by classifying prostate treatments into clinically effectual categories, and dividing airlines into peer groups.</p></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100090"},"PeriodicalIF":2.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2192440624000078/pdfft?md5=e5d692d70868e82bb22e6f67f85185e3&pid=1-s2.0-S2192440624000078-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140879764","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Advances in nonlinear optimization and equilibrium problems – Special issue editorial","authors":"Matteo Lapucci, Fabio Schoen","doi":"10.1016/j.ejco.2024.100086","DOIUrl":"https://doi.org/10.1016/j.ejco.2024.100086","url":null,"abstract":"","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100086"},"PeriodicalIF":2.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2192440624000030/pdfft?md5=b1efa3cd3c3d32a39ced483bb81bf7b5&pid=1-s2.0-S2192440624000030-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140134480","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Optimal shapelets tree for time series interpretable classification","authors":"Lorenzo Bonasera, Stefano Gualandi","doi":"10.1016/j.ejco.2024.100091","DOIUrl":"https://doi.org/10.1016/j.ejco.2024.100091","url":null,"abstract":"<div><p>Time series shapelets are a state-of-the-art data mining technique that is applied to time series supervised classification tasks. Shapelets are defined as subsequences that retain the most discriminating power contained in time series. The main advantage of shapelets-based methods consists of their great interpretability. Indeed, shapelets can provide the end-user with very helpful insights about the most interesting subsequences. In this paper, we propose a novel Mixed-Integer Programming model to optimize shapelets discovery based on optimal binary decision trees. Our formulation provides a flexible and adaptable classification framework that is interpretable with respect to both the mathematical model and the final output. Computational results for a large class of datasets show that our approach achieves performance comparable with state-of-the-art shapelets-based classification methods. Our model is the first approach based on optimal decision tree induction for time series classification.</p></div>","PeriodicalId":51880,"journal":{"name":"EURO Journal on Computational Optimization","volume":"12 ","pages":"Article 100091"},"PeriodicalIF":2.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S219244062400008X/pdfft?md5=b14d7b43a7e4b626d023b6162ce84dcf&pid=1-s2.0-S219244062400008X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141241873","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}