Discrete Optimization最新文献

{"title":"Complexity of training ReLU neural network","authors":"Digvijay Boob,&nbsp;Santanu S. Dey,&nbsp;Guanghui Lan","doi":"10.1016/j.disopt.2020.100620","DOIUrl":"10.1016/j.disopt.2020.100620","url":null,"abstract":"<div><p>In this paper, we explore some basic questions on the complexity of training neural networks<span> with ReLU activation function. We show that it is NP-hard to train a two-hidden layer feedforward ReLU neural network. If dimension of the input data and the network topology is fixed, then we show that there exists a polynomial time algorithm for the same training problem. We also show that if sufficient over-parameterization is provided in the first hidden layer of ReLU neural network, then there is a polynomial time algorithm which finds weights such that output of the over-parameterized ReLU neural network matches with the output of the given data.</span></p></div>","PeriodicalId":50571,"journal":{"name":"Discrete Optimization","volume":"44 ","pages":"Article 100620"},"PeriodicalIF":1.1,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/j.disopt.2020.100620","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115398189","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Submodular reassignment problem for reallocating agents to tasks with synergy effects","authors":"Naonori Kakimura ,&nbsp;Naoyuki Kamiyama ,&nbsp;Yusuke Kobayashi ,&nbsp;Yoshio Okamoto","doi":"10.1016/j.disopt.2021.100631","DOIUrl":"10.1016/j.disopt.2021.100631","url":null,"abstract":"<div><p><span>We propose a new combinatorial optimization problem that we call the submodular reassignment problem. We are given </span><span><math><mi>k</mi></math></span><span><span> submodular functions over the same ground set, and we want to find a set that minimizes the sum of the distances to the sets of minimizers of all functions. The problem is motivated by a two-stage stochastic optimization problem with recourse summarized as follows. We are given two tasks to be processed and want to assign a set of workers to maximize the sum of profits. However, we do not know the value functions exactly, but only know a finite number of possible scenarios. Our goal is to determine the first-stage allocation of workers to minimize the expected number of reallocated workers after a scenario is realized at the second stage. This problem can be modeled by the submodular reassignment problem. We prove that the submodular reassignment problem can be solved in strongly polynomial time via submodular function minimization. We further provide a maximum-flow formulation of the problem that enables us to solve the problem without using a general submodular function minimization algorithm, and more efficiently both in theory and in practice. In our algorithm, we make use of Birkhoff’s </span>representation theorem<span> for distributive lattices.</span></span></p></div>","PeriodicalId":50571,"journal":{"name":"Discrete Optimization","volume":"44 ","pages":"Article 100631"},"PeriodicalIF":1.1,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/j.disopt.2021.100631","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127431038","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"GO-MOCE: Greedy Order Method of Conditional Expectations for Max Sat","authors":"Daniel Berend ,&nbsp;Shahar Golan ,&nbsp;Yochai Twitto","doi":"10.1016/j.disopt.2022.100685","DOIUrl":"10.1016/j.disopt.2022.100685","url":null,"abstract":"<div><p>In this paper we present and study a new algorithm for the Maximum Satisfiability (Max Sat) problem. The algorithm is based on the Method of Conditional Expectations (MOCE, also known as Johnson’s Algorithm) and applies a greedy variable ordering to MOCE. Thus, we name it Greedy Order MOCE (GO-MOCE). We also suggest a combination of GO-MOCE with CCLS, a state-of-the-art solver. We refer to this combined solver as GO-MOCE-CCLS.</p><p>We conduct a comprehensive comparative evaluation of GO-MOCE versus MOCE on random instances and on public competition benchmark instances. We show that GO-MOCE reduces the number of unsatisfied clauses by tens of percents, while keeping the runtime almost the same. The worst case time complexity of GO-MOCE is linear. We also show that GO-MOCE-CCLS improves on CCLS consistently by up to about 80%.</p><p>We study the asymptotic performance of GO-MOCE. To this end, we introduce three measures for evaluating the asymptotic performance of algorithms for Max Sat. We point out to further possible improvements of GO-MOCE, based on an empirical study of the main quantities managed by GO-MOCE during its execution.</p></div>","PeriodicalId":50571,"journal":{"name":"Discrete Optimization","volume":"43 ","pages":"Article 100685"},"PeriodicalIF":1.1,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125991195","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"An improved zig zag approach for competitive group testing","authors":"Jun Wu ,&nbsp;Yongxi Cheng ,&nbsp;Ding-Zhu Du","doi":"10.1016/j.disopt.2022.100687","DOIUrl":"https://doi.org/10.1016/j.disopt.2022.100687","url":null,"abstract":"<div><p><span>In many fault detection problems, we want to identify defective items from a set of </span><span><math><mi>n</mi></math></span><span> items using the minimum number of tests. Group testing is for the scenario where each test is on a subset of items, and tells whether the subset contains at least one defective item or not. In practice, the number </span><span><math><mi>d</mi></math></span> of defective items is often unknown in advance. In this paper, we improve the previously best algorithm for a central problem in combinatorial group testing with unknown number of defectives (Cheng et al., 2014), and prove that the number of tests used by our new algorithm is no more than <span><math><mrow><mi>d</mi><mo>log</mo><mfrac><mrow><mi>n</mi></mrow><mrow><mi>d</mi></mrow></mfrac><mo>+</mo><mrow><mo>(</mo><mn>5</mn><mo>−</mo><mo>log</mo><mn>5</mn><mo>)</mo></mrow><mi>d</mi><mo>+</mo><mi>O</mi><mrow><mo>(</mo><msup><mrow><mo>log</mo></mrow><mrow><mn>2</mn></mrow></msup><mi>d</mi><mo>)</mo></mrow></mrow></math></span>, where <span><math><mo>log</mo></math></span> is of base 2.</p></div>","PeriodicalId":50571,"journal":{"name":"Discrete Optimization","volume":"43 ","pages":"Article 100687"},"PeriodicalIF":1.1,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91757811","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Mathematical formulations and solution methods for the uncapacitated r-allocation p-hub maximal covering problem","authors":"Olivera Stančić ,&nbsp;Zorica Stanimirović ,&nbsp;Raca Todosijević ,&nbsp;Stefan Mišković","doi":"10.1016/j.disopt.2021.100672","DOIUrl":"10.1016/j.disopt.2021.100672","url":null,"abstract":"<div><p>This paper considers the uncapacitated <span><math><mi>r</mi></math></span>-allocation <span><math><mi>p</mi></math></span><span>-hub maximal covering problem (UrApHMCP), which represents a generalization of the well-known </span><span><math><mi>p</mi></math></span>-hub maximal covering problem, as it allows each non-hub node to send and receive flow via at most <span><math><mi>r</mi></math></span> hubs, <span><math><mrow><mi>r</mi><mo>≤</mo><mi>p</mi></mrow></math></span><span>. Two coverage criteria are considered in UrApHMCP — binary and, for the first time in the literature, partial coverage. Novel mathematical formulations of UrApHMCP for both coverage criteria are proposed. As the considered UrApHMCP is an NP-hard optimization problem, two efficient heuristic methods are proposed as solution approaches. The first one is a variant of General Variable Neighborhood Search (GVNS), and the second one is based on combining a Greedy Randomized Adaptive Search Procedure (GRASP) with Variable Neighborhood Descent (VND), resulting in a hybrid GRASP-VND method. Computational study is performed over the set of CAB and AP benchmark instances with up to 25 and 200 nodes, respectively, on TR instances including 81 nodes, as well as on the challenging USA423 and URAND hub instances with up 423 and 1000 nodes, respectively. Optimal or feasible solutions are obtained by CPLEX solver for instances with up to 50 nodes, while instances of larger dimensions are out of reach for CPLEX solver. On the other hand, both GVNS and GRASP-VND reach optimal solutions or improve lower bounds provided by CPLEX in short CPU times. In addition, both heuristics quickly return solutions on problem instances of large dimensions, thus indicating their potential to solve effectively large, realistic sized problem instances. The conducted non-parametric statistical tests confirm robustness of the proposed GVNS and GRASP-VND and demonstrate that the these two metaheuristics outperform other tested algorithms for UrApHMCP.</span></p></div>","PeriodicalId":50571,"journal":{"name":"Discrete Optimization","volume":"43 ","pages":"Article 100672"},"PeriodicalIF":1.1,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121816212","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A column generation approach to the discrete barycenter problem","authors":"Steffen Borgwardt ,&nbsp;Stephan Patterson","doi":"10.1016/j.disopt.2021.100674","DOIUrl":"https://doi.org/10.1016/j.disopt.2021.100674","url":null,"abstract":"<div><p><span>The discrete Wasserstein barycenter<span> problem is a minimum-cost mass transport problem for a set of discrete probability measures. Although an exact barycenter is computable through linear programming, the underlying linear program can be extremely large. For worst-case input, a best known linear programming formulation is exponential in the number of variables, but has a low number of constraints, making it an interesting candidate for </span></span>column generation.</p><p>In this paper, we devise and study two column generation strategies: a natural one based on a simplified computation of reduced costs, and one through a Dantzig–Wolfe decomposition. For the latter, we produce efficiently solvable subproblems, namely, a pricing problem in the form of a classical transportation problem. The two strategies begin with an efficient computation of an initial feasible solution. While the structure of the constraints leads to the computation of the reduced costs of all remaining variables for setup, both approaches may outperform a computation using the full program in speed, and dramatically so in memory requirement. In our computational experiments, we exhibit that, depending on the input, either strategy can become a best choice.</p></div>","PeriodicalId":50571,"journal":{"name":"Discrete Optimization","volume":"43 ","pages":"Article 100674"},"PeriodicalIF":1.1,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91757809","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Node-based valid inequalities for the optimal transmission switching problem","authors":"Santanu S. Dey ,&nbsp;Burak Kocuk ,&nbsp;Nicole Redder","doi":"10.1016/j.disopt.2021.100683","DOIUrl":"https://doi.org/10.1016/j.disopt.2021.100683","url":null,"abstract":"<div><p>The benefits of transmission line switching are well-known in terms of reducing operational cost and improving system reliability of power systems. However, finding the optimal power network configuration is a challenging task due to the combinatorial nature of the underlying optimization problem. In this work, we identify a certain “node-based” set that appears as substructure of the optimal transmission switching problem and then conduct a polyhedral study of this set. We construct an extended formulation of the integer hull of this set and present the inequality description of the integer hull in the original space in some cases. These inequalities in the original space can be used as cutting-planes for the transmission line switching problem. Finally, we present the results of our computational experiments using these cutting-planes on difficult test cases from the literature.</p></div>","PeriodicalId":50571,"journal":{"name":"Discrete Optimization","volume":"43 ","pages":"Article 100683"},"PeriodicalIF":1.1,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91757808","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Exact values of defective Ramsey numbers in graph classes","authors":"Yunus Emre Demirci ,&nbsp;Tınaz Ekim ,&nbsp;John Gimbel ,&nbsp;Mehmet Akif Yıldız","doi":"10.1016/j.disopt.2021.100673","DOIUrl":"10.1016/j.disopt.2021.100673","url":null,"abstract":"<div><p>Given a graph <span><math><mi>G</mi></math></span>, a <span><math><mi>k</mi></math></span><em>-sparse</em> <span><math><mi>j</mi></math></span><em>-set</em> is a set of <span><math><mi>j</mi></math></span><span> vertices inducing a subgraph with maximum degree at most </span><span><math><mi>k</mi></math></span>. A <span><math><mi>k</mi></math></span><em>-dense</em> <span><math><mi>i</mi></math></span><em>-set</em> is a set of <span><math><mi>i</mi></math></span> vertices that is <span><math><mi>k</mi></math></span>-sparse in the complement of <span><math><mi>G</mi></math></span>. As a generalization of Ramsey numbers, the <span><math><mi>k</mi></math></span>-defective Ramsey number <span><math><mrow><msubsup><mrow><mi>R</mi></mrow><mrow><mi>k</mi></mrow><mrow><mi>G</mi></mrow></msubsup><mrow><mo>(</mo><mi>i</mi><mo>,</mo><mi>j</mi><mo>)</mo></mrow></mrow></math></span> for the graph class <span><math><mi>G</mi></math></span> is defined as the smallest natural number <span><math><mi>n</mi></math></span> such that all graphs on <span><math><mi>n</mi></math></span> vertices in the class <span><math><mi>G</mi></math></span> have either a <span><math><mi>k</mi></math></span>-dense <span><math><mi>i</mi></math></span>-set or a <span><math><mi>k</mi></math></span>-sparse <span><math><mi>j</mi></math></span>-set. In this paper, we examine <span><math><mrow><msubsup><mrow><mi>R</mi></mrow><mrow><mi>k</mi></mrow><mrow><mi>G</mi></mrow></msubsup><mrow><mo>(</mo><mi>i</mi><mo>,</mo><mi>j</mi><mo>)</mo></mrow></mrow></math></span> where <span><math><mi>G</mi></math></span><span> represents various graph classes. For forests and cographs, we give exact formulas for all defective Ramsey numbers. For cacti, bipartite graphs and split graphs, we derive defective Ramsey numbers in most of the cases and point out open questions, formulated as conjectures if possible.</span></p></div>","PeriodicalId":50571,"journal":{"name":"Discrete Optimization","volume":"42 ","pages":"Article 100673"},"PeriodicalIF":1.1,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"54146644","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Efficient constructions of convex combinations for 2-edge-connected subgraphs on fundamental classes","authors":"Arash Haddadan ,&nbsp;Alantha Newman","doi":"10.1016/j.disopt.2021.100659","DOIUrl":"10.1016/j.disopt.2021.100659","url":null,"abstract":"<div><p>We present coloring-based algorithms for tree augmentation and use them to construct convex combinations of 2-edge-connected subgraphs. This classic tool has been applied previously to the problem, but our algorithms illustrate its flexibility, which – in coordination with the choice of spanning tree – can be used to obtain various properties (e.g., 2-vertex connectivity) that are useful in our applications.</p><p><span>We use these coloring algorithms to design approximation algorithms for the 2-edge-connected multigraph problem (2ECM) and the 2-edge-connected spanning subgraph problem (2ECS) on two well-studied types of LP solutions. The first type of points, half-integer square points, belong to a class of </span><em>fundamental extreme points</em>, which exhibit the same integrality gap as the general case. For half-integer square points, the integrality gap for 2ECM is known to be between <span><math><mfrac><mrow><mn>6</mn></mrow><mrow><mn>5</mn></mrow></mfrac></math></span> and <span><math><mfrac><mrow><mn>4</mn></mrow><mrow><mn>3</mn></mrow></mfrac></math></span>. We improve the upper bound to <span><math><mfrac><mrow><mn>9</mn></mrow><mrow><mn>7</mn></mrow></mfrac></math></span>. The second type of points we study are <em>uniform points</em> whose support is a 3-edge-connected graph and each entry is <span><math><mfrac><mrow><mn>2</mn></mrow><mrow><mn>3</mn></mrow></mfrac></math></span>. Although the best-known upper bound on the integrality gap of 2ECS for these points is less than <span><math><mfrac><mrow><mn>4</mn></mrow><mrow><mn>3</mn></mrow></mfrac></math></span>, previous results do not yield an efficient algorithm. We give the first approximation algorithm for 2ECS with ratio below <span><math><mfrac><mrow><mn>4</mn></mrow><mrow><mn>3</mn></mrow></mfrac></math></span> for this class of points.</p></div>","PeriodicalId":50571,"journal":{"name":"Discrete Optimization","volume":"42 ","pages":"Article 100659"},"PeriodicalIF":1.1,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/j.disopt.2021.100659","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127663909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"An exact cutting plane method for k-submodular function maximization","authors":"Qimeng Yu,&nbsp;Simge Küçükyavuz","doi":"10.1016/j.disopt.2021.100670","DOIUrl":"10.1016/j.disopt.2021.100670","url":null,"abstract":"<div><p>A natural and important generalization of submodularity – <span><math><mi>k</mi></math></span>-submodularity – applies to set functions with <span><math><mi>k</mi></math></span> arguments and appears in a broad range of applications, such as infrastructure design, machine learning, and healthcare. In this paper, we study maximization problems with <span><math><mi>k</mi></math></span><span>-submodular objective functions. We propose valid linear inequalities, namely the </span><span><math><mi>k</mi></math></span>-submodular inequalities, for the hypograph of any <span><math><mi>k</mi></math></span>-submodular function. This class of inequalities serves as a novel generalization of the well-known submodular inequalities. We show that maximizing a <span><math><mi>k</mi></math></span><span>-submodular function is equivalent to solving a mixed-integer linear program with exponentially many </span><span><math><mi>k</mi></math></span><span>-submodular inequalities. Using this representation in a delayed constraint generation framework, we design the first exact algorithm, that is not a complete enumeration method, to solve general </span><span><math><mi>k</mi></math></span>-submodular maximization problems. Our computational experiments on the multi-type sensor placement problems demonstrate the efficiency of our algorithm in constrained nonlinear <span><math><mi>k</mi></math></span>-submodular maximization problems for which no alternative compact mixed-integer linear formulations are available. The computational experiments show that our algorithm significantly outperforms the only available exact solution method—exhaustive search. Problems that would require over 13 years to solve by exhaustive search can be solved within ten minutes using our method.</p></div>","PeriodicalId":50571,"journal":{"name":"Discrete Optimization","volume":"42 ","pages":"Article 100670"},"PeriodicalIF":1.1,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/j.disopt.2021.100670","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"54146616","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}