{"title":"Robust-to-Dynamics Optimization","authors":"Amir Ali Ahmadi, Oktay Günlük","doi":"10.1287/moor.2023.0116","DOIUrl":"https://doi.org/10.1287/moor.2023.0116","url":null,"abstract":"A robust-to-dynamics optimization (RDO) problem is an optimization problem specified by two pieces of input: (i) a mathematical program (an objective function [Formula: see text] and a feasible set [Formula: see text]) and (ii) a dynamical system (a map [Formula: see text]). Its goal is to minimize f over the set [Formula: see text] of initial conditions that forever remain in [Formula: see text] under g. The focus of this paper is on the case where the mathematical program is a linear program and where the dynamical system is either a known linear map or an uncertain linear map that can change over time. In both cases, we study a converging sequence of polyhedral outer approximations and (lifted) spectrahedral inner approximations to [Formula: see text]. Our inner approximations are optimized with respect to the objective function f, and their semidefinite characterization—which has a semidefinite constraint of fixed size—is obtained by applying polar duality to convex sets that are invariant under (multiple) linear maps. We characterize three barriers that can stop convergence of the outer approximations to [Formula: see text] from being finite. We prove that once these barriers are removed, our inner and outer approximating procedures find an optimal solution and a certificate of optimality for the RDO problem in a finite number of steps. Moreover, in the case where the dynamics are linear, we show that this phenomenon occurs in a number of steps that can be computed in time polynomial in the bit size of the input data. Our analysis also leads to a polynomial-time algorithm for RDO instances where the spectral radius of the linear map is bounded above by any constant less than one. Finally, in our concluding section, we propose a broader research agenda for studying optimization problems with dynamical systems constraints, of which RDO is a special case.Funding: O. Günlük was partially supported by the Office of Naval Research [Grant N00014-21-1-2575]. This work was partially funded by the Alfred P. Sloan Foundation, the Air Force Office of Scientific Research, Defense Advanced Research Projects Agency [Young Faculty Award], the National Science Foundation [Faculty Early Career Development Program Award], and Google [Faculty Award].","PeriodicalId":49852,"journal":{"name":"Mathematics of Operations Research","volume":"85 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140612441","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Efficiency of Stochastic Coordinate Proximal Gradient Methods on Nonseparable Composite Optimization","authors":"Ion Necoara, Flavia Chorobura","doi":"10.1287/moor.2023.0044","DOIUrl":"https://doi.org/10.1287/moor.2023.0044","url":null,"abstract":"This paper deals with composite optimization problems having the objective function formed as the sum of two terms; one has a Lipschitz continuous gradient along random subspaces and may be nonconvex, and the second term is simple and differentiable but possibly nonconvex and nonseparable. Under these settings, we design a stochastic coordinate proximal gradient method that takes into account the nonseparable composite form of the objective function. This algorithm achieves scalability by constructing at each iteration a local approximation model of the whole nonseparable objective function along a random subspace with user-determined dimension. We outline efficient techniques for selecting the random subspace, yielding an implementation that has low cost per iteration, also achieving fast convergence rates. We present a probabilistic worst case complexity analysis for our stochastic coordinate proximal gradient method in convex and nonconvex settings; in particular, we prove high-probability bounds on the number of iterations before a given optimality is achieved. Extensive numerical results also confirm the efficiency of our algorithm.Funding: This work was supported by Norway Grants 2014-2021 [Grant ELO-Hyp 24/2020]; Unitatea Executiva pentru Finantarea Invatamantului Superior, a Cercetarii, Dezvoltarii si Inovarii [Grants PN-III-P4-PCE-2021-0720, L2O-MOC, nr 70/2022]; and the ITN-ETN project TraDE-OPT funded by the European Union’s Horizon 2020 Research and Innovation Programme under the Marie Skłodowska-Curie grant agreement [Grant 861137].","PeriodicalId":49852,"journal":{"name":"Mathematics of Operations Research","volume":"63 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140612454","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Practical Algorithms with Guaranteed Approximation Ratio for Traveling Tournament Problem with Maximum Tour Length 2","authors":"Jingyang Zhao, Mingyu Xiao","doi":"10.1287/moor.2022.0356","DOIUrl":"https://doi.org/10.1287/moor.2022.0356","url":null,"abstract":"The traveling tournament problem (TTP) is a hard but interesting sports scheduling problem inspired by Major League Baseball, which is to design a double round-robin schedule such that each pair of teams plays one game in each other’s home venue, minimizing the total distance traveled by all n teams (n is even). In this paper, we consider TTP-2 (i.e., TTP under the constraint that at most two consecutive home games or away games are allowed for each team). In this paper, we propose practical algorithms for TTP-2 with improved approximation ratios. Because of the different structural properties of the problem, all known algorithms for TTP-2 are different for n/2 being odd and even, and our algorithms are also different for these two cases. For even n/2, our approximation ratio is [Formula: see text], improving the previous result of [Formula: see text]. For odd n/2, our approximation ratio is [Formula: see text], improving the previous result of [Formula: see text]. In practice, our algorithms are easy to implement. Experiments on well-known benchmark sets show that our algorithms beat previously known solutions for all instances with an average improvement of 5.66%.Funding: This work was supported by the National Natural Science Foundation of China [Grants 62372095 and 62172077] and the Sichuan Natural Science Foundation [Grant 2023NSFSC0059].","PeriodicalId":49852,"journal":{"name":"Mathematics of Operations Research","volume":"36 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140582291","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"On Constrained Mixed-Integer DR-Submodular Minimization","authors":"Qimeng Yu, Simge Küçükyavuz","doi":"10.1287/moor.2022.0320","DOIUrl":"https://doi.org/10.1287/moor.2022.0320","url":null,"abstract":"Diminishing returns (DR)–submodular functions encompass a broad class of functions that are generally nonconvex and nonconcave. We study the problem of minimizing any DR-submodular function with continuous and general integer variables under box constraints and, possibly, additional monotonicity constraints. We propose valid linear inequalities for the epigraph of any DR-submodular function under the constraints. We further provide the complete convex hull of such an epigraph, which, surprisingly, turns out to be polyhedral. We propose a polynomial-time exact separation algorithm for our proposed valid inequalities with which we first establish the polynomial-time solvability of this class of mixed-integer nonlinear optimization problems.Funding: This work was supported by the Office of Naval Research Global [Grant N00014-22-1-2602].","PeriodicalId":49852,"journal":{"name":"Mathematics of Operations Research","volume":"58 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140582194","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Nicolas Fraiman, Tzu-Chi Lin, Mariana Olvera-Cravioto
{"title":"Opinion Dynamics on Directed Complex Networks","authors":"Nicolas Fraiman, Tzu-Chi Lin, Mariana Olvera-Cravioto","doi":"10.1287/moor.2022.0250","DOIUrl":"https://doi.org/10.1287/moor.2022.0250","url":null,"abstract":"We propose and analyze a mathematical model for the evolution of opinions on directed complex networks. Our model generalizes the popular DeGroot and Friedkin-Johnsen models by allowing vertices to have attributes that may influence the opinion dynamics. We start by establishing sufficient conditions for the existence of a stationary opinion distribution on any fixed graph, and then provide an increasingly detailed characterization of its behavior by considering a sequence of directed random graphs having a local weak limit. Our most explicit results are obtained for graph sequences whose local weak limit is a marked Galton-Watson tree, in which case our model can be used to explain a variety of phenomena, for example, conditions under which consensus can be achieved, mechanisms in which opinions can become polarized, and the effect of disruptive stubborn agents on the formation of opinions.Funding: This work was supported by the National Science Foundation [Grants NSF-DMS-1929298 and CMMI-2243261].","PeriodicalId":49852,"journal":{"name":"Mathematics of Operations Research","volume":"14 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-04-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140582286","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Simple and Explicit Bounds for Multiserver Queues with 11−ρ Scaling","authors":"Yuan Li, David A. Goldberg","doi":"10.1287/moor.2022.0131","DOIUrl":"https://doi.org/10.1287/moor.2022.0131","url":null,"abstract":"We consider the first-come-first-serve (FCFS) [Formula: see text] queue and prove the first simple and explicit bounds that scale as [Formula: see text] under only the assumption that interarrival times have finite second moment, and service times have finite [Formula: see text] moment for some [Formula: see text]. Here, ρ denotes the corresponding traffic intensity. Conceptually, our results can be viewed as a multiserver analogue of Kingman’s bound. Our main results are bounds for the tail of the steady-state queue length and the steady-state probability of delay. The strength of our bounds (e.g., in the form of tail decay rate) is a function of how many moments of the service distribution are assumed finite. Our bounds scale gracefully, even when the number of servers grows large and the traffic intensity converges to unity simultaneously, as in the Halfin-Whitt scaling regime. Some of our bounds scale better than [Formula: see text] in certain asymptotic regimes. In these same asymptotic regimes, we also prove bounds for the tail of the steady-state number in service. Our main proofs proceed by explicitly analyzing the bounding process that arises in the stochastic comparison bounds of Gamarnik and Goldberg for multiserver queues. Along the way, we derive several novel results for suprema of random walks and pooled renewal processes, which may be of independent interest. We also prove several additional bounds using drift arguments (which have much smaller prefactors) and point out a conjecture that would imply further related bounds and generalizations. We also show that when all moments of the service distribution are finite and satisfy a mild growth rate assumption, our bounds can be strengthened to yield explicit tail estimates decaying as [Formula: see text], with [Formula: see text], depending on the growth rate of these moments.Funding: Financial support from the National Science Foundation [Grant 1333457] is gratefully acknowledged.Supplemental Material: The supplemental appendix is available at https://doi.org/10.1287/moor.2022.0131 .","PeriodicalId":49852,"journal":{"name":"Mathematics of Operations Research","volume":"32 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-04-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140582287","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An Approximation to the Invariant Measure of the Limiting Diffusion of G/Ph/n + GI Queues in the Halfin–Whitt Regime and Related Asymptotics","authors":"Xinghu Jin, Guodong Pang, Lihu Xu, Xin Xu","doi":"10.1287/moor.2021.0241","DOIUrl":"https://doi.org/10.1287/moor.2021.0241","url":null,"abstract":"In this paper, we develop a stochastic algorithm based on the Euler–Maruyama scheme to approximate the invariant measure of the limiting multidimensional diffusion of [Formula: see text] queues in the Halfin–Whitt regime. Specifically, we prove a nonasymptotic error bound between the invariant measures of the approximate model from the algorithm and the limiting diffusion. To establish the error bound, we employ the recently developed Stein’s method for multidimensional diffusions, in which the regularity of Stein’s equation obtained by the partial differential equation (PDE) theory plays a crucial role. We further prove the central limit theorem (CLT) and the moderate deviation principle (MDP) for the occupation measures of the limiting diffusion of [Formula: see text] queues and its Euler–Maruyama scheme. In particular, the variances in the CLT and MDP associated with the limiting diffusion are determined by Stein’s equation and Malliavin calculus, in which properties of a mollified diffusion and an associated weighted occupation time play a crucial role.Funding: X. Jin is supported in part by the Fundamental Research Funds for the Central Universities [Grants JZ2022HGQA0148 and JZ2023HGTA0170]. G. Pang is supported in part by the U.S. National Science Foundation [Grants DMS-1715875 and DMS-2216765]. L. Xu is supported in part by the National Nature Science Foundation of China [Grant 12071499], Macao Special Administrative Region [Grant FDCT 0090/2019/A2], and the University of Macau [Grant MYRG2018-00133-FST]. This work was supported by U.S. National Science Foundation [Grant DMS-2108683].","PeriodicalId":49852,"journal":{"name":"Mathematics of Operations Research","volume":"42 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140582283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mihail Bazhba, Jose Blanchet, Chang-Han Rhee, Bert Zwart
{"title":"Sample-Path Large Deviations for Unbounded Additive Functionals of the Reflected Random Walk","authors":"Mihail Bazhba, Jose Blanchet, Chang-Han Rhee, Bert Zwart","doi":"10.1287/moor.2020.0094","DOIUrl":"https://doi.org/10.1287/moor.2020.0094","url":null,"abstract":"We prove a sample-path large deviation principle (LDP) with sublinear speed for unbounded functionals of certain Markov chains induced by the Lindley recursion. The LDP holds in the Skorokhod space [Formula: see text] equipped with the [Formula: see text] topology. Our technique hinges on a suitable decomposition of the Markov chain in terms of regeneration cycles. Each regeneration cycle denotes the area accumulated during the busy period of the reflected random walk. We prove a large deviation principle for the area under the busy period of the Markov random walk, and we show that it exhibits a heavy-tailed behavior.Funding: The research of B. Zwart and M. Bazhba is supported by the Nederlandse Organisatie voor Wetenschappelijk Onderzoek [Grant 639.033.413]. The research of J. Blanchet is supported by the National Science Foundation (NSF) [Grants 1915967, 1820942, and 1838576] as well as the Defense Advanced Research Projects Agency [Grant N660011824028]. The research of C.-H. Rhee is supported by the NSF [Grant CMMI-2146530].","PeriodicalId":49852,"journal":{"name":"Mathematics of Operations Research","volume":"1 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140582293","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Steiner Cut Dominants","authors":"Michele Conforti, Volker Kaibel","doi":"10.1287/moor.2022.0280","DOIUrl":"https://doi.org/10.1287/moor.2022.0280","url":null,"abstract":"For a subset T of nodes of an undirected graph G, a T-Steiner cut is a cut [Formula: see text] with [Formula: see text] and [Formula: see text]. The T-Steiner cut dominant of G is the dominant [Formula: see text] of the convex hull of the incidence vectors of the T-Steiner cuts of G. For [Formula: see text], this is the well-understood s-t-cut dominant. Choosing T as the set of all nodes of G, we obtain the cut dominant for which an outer description in the space of the original variables is still not known. We prove that for each integer τ, there is a finite set of inequalities such that for every pair (G, T) with [Formula: see text], the nontrivial facet-defining inequalities of [Formula: see text] are the inequalities that can be obtained via iterated applications of two simple operations, starting from that set. In particular, the absolute values of the coefficients and of the right-hand sides in a description of [Formula: see text] by integral inequalities can be bounded from above by a function of [Formula: see text]. For all [Formula: see text], we provide descriptions of [Formula: see text] by facet-defining inequalities, extending the known descriptions of s-t-cut dominants.","PeriodicalId":49852,"journal":{"name":"Mathematics of Operations Research","volume":"6 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140582186","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Fast Rates for the Regret of Offline Reinforcement Learning","authors":"Yichun Hu, Nathan Kallus, Masatoshi Uehara","doi":"10.1287/moor.2021.0167","DOIUrl":"https://doi.org/10.1287/moor.2021.0167","url":null,"abstract":"We study the regret of offline reinforcement learning in an infinite-horizon discounted Markov decision process (MDP). While existing analyses of common approaches, such as fitted Q-iteration (FQI), suggest root-n convergence for regret, empirical behavior exhibits much faster convergence. In this paper, we present a finer regret analysis that exactly characterizes this phenomenon by providing fast rates for the regret convergence. First, we show that given any estimate for the optimal quality function, the regret of the policy it defines converges at a rate given by the exponentiation of the estimate’s pointwise convergence rate, thus speeding up the rate. The level of exponentiation depends on the level of noise in the decision-making problem, rather than the estimation problem. We establish such noise levels for linear and tabular MDPs as examples. Second, we provide new analyses of FQI and Bellman residual minimization to establish the correct pointwise convergence guarantees. As specific cases, our results imply one-over-n rates in linear cases and exponential-in-n rates in tabular cases. We extend our findings to general function approximation by extending our results to regret guarantees based on L<jats:sub>p</jats:sub>-convergence rates for estimating the optimal quality function rather than pointwise rates, where L<jats:sub>2</jats:sub> guarantees for nonparametric estimation can be ensured under mild conditions.Funding: This work was supported by the Division of Information and Intelligent Systems, National Science Foundation [Grant 1846210].","PeriodicalId":49852,"journal":{"name":"Mathematics of Operations Research","volume":"47 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140297959","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}