arXiv Science⌕ Search

arXiv subjects

Jon Lee

Publications and source records attributed to Jon Lee.

At least 19 recordsLinked to original sources

On the facets of the Cayley polytope of Stanley's triangulation

Disjunctions over the cells of a triangulation arise in formulations of piecewise-linear functions. For a poset $P$ on $[d]$, we study the convex hull $D$ of the simplices of Stanley's triangulation of the order polytope of $P$, each lifted by its own indicator vector. Via the Cayley trick, for any disjunction of full-dimensional polytopes, the facets of the convex hull other than those described by the bounds on the indicator variables correspond to the facet normals of the Minkowski sum of the polytopes, and each is described by the full optimal big-M lifting of the supporting inequality with that normal of any one polytope. For Stanley's triangulation, with $M(P)$ the Minkowski sum of its simplices, lifting only the facet-describing inequalities of the simplices need not suffice, unlike some other cases; we show that it suffices if and only if $M(P)$ is alcoved, if and only if deleting one element of $P$ leaves a chain. Otherwise, the coefficients of the additional facet-describing inequalities are governed by the least number $\ell(P)$ of elements whose deletion leaves a chain: for fixed $\ell(P)$, the largest entry of a primitive facet normal grows like $d^{\ell(P)-1}$, and it can be exponential in $d$ if $\ell(P)$ grows with $d$. For $d \geq 3$ and $\ell(P)\leq2$ the sharp bound is $d-2$.

math.CO↗

Facet normals of Minkowski sums of staircase simplices

Staircase simplices are the simplices of the standard (Freudenthal--Kuhn) triangulation of $[0,1]^d$ and of Stanley's triangulations of order polytopes. We study the facet normals of their Minkowski sums and how the number of summands constrains the size of primitive integer normals. We characterize the normals attainable with a prescribed number of summands in terms of $d-1$ linearly independent zero-one vectors orthogonal to the normal, whose supports have an intersection graph that can be colored with one color per summand. This gives a combinatorial characterization of the least number of summands needed to realize a normal. For two summands, all primitive normals have entries in $\{-1,0,1\}$, and we determine which of them occur. For three summands we bound every entry in absolute value by $3^{(d-2)/3}$ and construct normals with entries of order $θ^d$, $θ$ the plastic number; for four summands a second construction gives entries of order $ψ^d$, $ψ$ the supergolden ratio. Since $ψ>3^{1/3}$, the largest coefficients for three and four summands are exponentially separated. For vectors with at most two distinct nonzero entry values, we determine the least number of summands exactly, using a matching-rank formula proved by exterior algebra and representations of symmetric groups. With no restriction on the number of summands, the maximum coefficient equals the classical maximum for facets of $0/1$-polytopes in the same dimension.

math.CO↗

A refinement of the edge theorem for order and chain polytopes

For a finite poset, we partition the edges of the order polytope and of the chain polytope into classes indexed by the connected convex subsets of the poset, and we establish that corresponding classes have the same cardinality. This yields a closed formula for the common number of edges, and it identifies the bijection of Hibi, Li, Sahara and Shikama as a disjoint union of simple bijections between corresponding classes, explaining why it is a bijection and how it acts on edge directions and lengths. As consequences, the two polytopes have equally many edge directions, with matching multiplicities, and, for every m, equally many pairs of vertices whose symmetric difference has m components; the chain polytope has at least as many edges parallel to each coordinate subspace as the order polytope; and the edge lengths of the chain polytope are dominated by those of the order polytope, with strict inequality in the last two comparisons exactly when the poset contains a three-element chain. We discuss implications for linear and convex combinatorial optimization over ideals and antichains. We also express the number of edges in terms of the comparability graph, extending to stable-set polytopes of all graphs; give a recursion for series-parallel posets and closed formulas for layered, zigzag and crown posets; and characterize the distributive lattices for which the two polytopes are unimodularly equivalent. Finally, either diameter can exceed the other arbitrarily; both are bounded by the width, and they coincide for series-parallel, zigzag and crown posets.

math.CO↗

On the 100% Rule of Linear Programming

The so-called ``100% rule'' is a somewhat classical and yet somehow obscure rule that gives some local sensitivity-analysis information based on the very limited local sensitivity-analysis information that is often made available by linear-programming software, derived from an optimal basis that is hidden from the user. Introduced in a classic undergraduate textbook in 1977, half a century ago, it was only picked up on by researchers in a very limited way, and while it appears in some undergraduate textbooks, it tends not to appear in most modern graduate-level textbooks. Our contributions are to celebrate and revive interest in the 100% rule and to extend it in a meaningful way. We introduce a cone rule that certifies primal feasibility for more right-hand sides than the 100% rule does, using the same information, and that can be applied in linear time. We then study when this cone rule is tight, that is, when it captures the entire cone of right-hand sides for which the basis remains feasible. We characterize tightness in every dimension for right-hand sides interior to that cone, make the characterization explicit for m=2 and m=3, and settle the question for tridiagonal bases in every dimension: tightness is impossible once m>=4, and for m=3 we give an explicit criterion in the entries of the basis. We give further results for symmetric, integer and unimodular bases. Finally, when tightness fails, we measure the fraction of the feasibility cone captured by the rule using normalized solid angles. For the autoregressive family at m=3, we obtain a closed-form candidate for the infimum of this fraction over all right-hand sides, whose optimality is supported numerically. We also obtain a closed-form expression for the best case over most of the correlation range, subject to two numerically verified properties, and estimate the best-case value numerically more generally.

math.OC↗

Faster dynamic programming for tridiagonal maximum-entropy sampling

The maximum-entropy sampling problem (MESP) seeks, for an order-$n$ covariance matrix $C$, a principal submatrix of order $s$ with maximum log-determinant. Mostly for convenience, we assume that $C$ is nonsingular. Al-Thani and Lee (2023) solved MESP in $O(n^5)$ time when $C$ or $C^{-1}$ is tridiagonal. We show that the inner maximization of their recursion depends only on a prefix of the index set and that no piece of a solution is longer than $s$; this gives an $O(ns^2)$-time algorithm that returns the optimal value for every budget $t\le s$. When $C^{-1}$ is tridiagonal, $C$ is, up to scaling, the covariance matrix of an Ornstein--Uhlenbeck process observed at unevenly spaced times, and MESP becomes choosing points on a line under a concave gap function with the Monge property; this gives an $O(ns)$-time algorithm and, in the first-order autoregressive case, a closed-form solution. Given only $C$, we solve MESP in $O(n^2)$ time whenever $C$ or $C^{-1}$ is tridiagonal, up to a symmetric permutation, and we recognize these cases within the same bound. For spiders, we make explicit, and sharpen, the dependence on the number of legs, and, drawing on a hardness result of Ohsaka for stars, we observe that, unless $\mathrm{P}=\mathrm{NP}$, the exponent of the running time must grow with the number of legs.

cs.DS↗

More on Disjunctive Convex Hulls of Generalized Cross Polytopes

We continue the study of the convex hull $D\subset\mathbb{R}^{d+n}$ of a disjunction of $n+1$ polytopes in $\mathbb{R}^d$, managed by $n$ binary indicator variables. Previously, $D$ had been characterized for arbitrary polytopes when $d\in\{1,2\}$, for polytopes sharing a common constraint matrix (under a technical condition, including hyper-rectangles), and for two generalized cross polytopes ($n=1$). Here we give a complete description of $D$ for arbitrary $n$ and $d$ when all $n+1$ polytopes are generalized cross polytopes. Every vertical facet is described by a normalized support inequality, and such an inequality is facet describing if and only if its equality graph, a bipartite graph on the polytopes and the coordinates, is connected; all vertical facets are generated explicitly from feasible spanning trees. We characterize when such a facet is one of the previously known pairwise inequalities, and we show that pairwise inequalities suffice when $d\leq3$, but not in general. We establish a bijection between the vertical facets and the maximal cells of a regular subdivision of $Δ_n\timesΔ_{d-1}$\,, which yields the sharp bound $n+1+2^d\binom{n+d-1}{n}$ on the number of facets of $D$, attained for generic data. We also give a polynomial-time separation algorithm that returns a violated facet, which is maximally violated among the normalized support inequalities. Computational experiments show that the facets that are not pairwise inequalities close a large part of the gap left by the pairwise inequalities.

math.OC↗

On solving integer bilevel optimization problems with a non-convex quadratic follower objective function using disjunctive cuts

In this work, we study bilevel optimization problems where all variables are integer, all constraints and the leader objective function are linear, and the follower objective function is non-convex quadratic. Relying on bilevel-free sets derived from improving directions, we develop a disjunctive cut approach to exclude bilevel-infeasible solutions within a branch-and-cut algorithm. We show that our disjunctive cuts can be obtained by solving a cut generating linear program. Furthermore, we discuss conditions that allow the number of disjuncts in the cut generating linear program to be reduced, and we propose several strategies to identify improving directions and generate disjunctive cuts efficiently. We evaluate various aspects of the proposed branch-and-cut algorithm on both convex instances from the literature that fit our setting and new non-convex instances and compare the performance of our best approach with existing state-of-the-art approaches, which we significantly outperform.

math.OC↗

Exact volume computation for Boolean quadric polytopes of series-parallel graphs

For a graph G, the Boolean quadric polytope P(G) is the convex hull of the binary solutions of $y_{ij}=x_ix_j$ for $ij\in E(G)$, and Q(G) is its standard linear relaxation. For series-parallel graphs, Q(G) together with the odd-cycle inequalities describes P(G). Lee and Skipper showed vol(Q(G)) is polynomial-time computable for bounded treewidth and gave a closed formula for vol(P(G)) when G is a cycle. We resolve their question of giving an efficient algorithm for vol(P(G)) on series-parallel graphs. With $d=|V(G)|+|E(G)|$, we compute it with $O(d^7)$ arithmetic operations, and $O(d^5)$ if G is a cactus. The algorithm is a dynamic program over the series-parallel decomposition. The same framework computes vol(Q(G)) (hence the number of linear extensions of the incidence poset of G) with $O(d^4)$ operations, and $O(d^3)$ for cacti. With every $x_v$ fixed at 1/2, the recursion reduces to convolutions of univariate polynomials and computes the cut polytope volume of every series-parallel graph with m edges in $O(m^3)$ operations. We also study how much of Q(G) the polytope P(G) occupies. Short odd cycles matter more than long ones: in every graph, the odd-cycle inequalities of a cycle of length $\ell$ cut off at most a fraction $2^{\ell-1}/\ell!$ of Q(G). Hence vol(P(G))/vol(Q(G)) $\ge 1-\sum_C 2^{|C|-1}/|C|!$ for series-parallel G, with C ranging over its cycles. The ratio does not factor over cycles sharing a vertex: in a flower of $k$ copies of $C_\ell$ it decays like $ρ_\ell^k$ for an explicit rational $ρ_\ell$ below the ratio of $C_\ell$. Nevertheless, the small fractions cut off by many long cycles compound: in the worst case, triangle inequalities, or odd-cycle inequalities up to any fixed length, close no fixed fraction of the gap between Q(G) and P(G), and the volume ratio can be exponentially small in d.

math.OC↗

On Circuit Imbalance and 0/1 Circuits for Coloring and Forest Problems

Circuits are fundamental objects in linear programming and oriented matroid theory, representing the elementary difference vectors of a polyhedron. A recent concept introduced by Dadush, Huiberts, Natura, and Végh, the circuit imbalance, serves as a complexity measure relevant to iteration bounds for circuit-based augmentation and circuit diameters, and the interpretability of circuits in terms of the underlying application. In this paper, we analyze linear programming formulations of relaxed combinatorial optimization problems to prove two contrasting types of results related to the circuit imbalance. First, we identify simple and polynomially-sized constraint structures, in particular arising in graph-theoretic problems, that lead to an exponential circuit imbalance. These constructions show that, in quite general situations, working with the entire set of circuits poses significant challenges for an application of circuit augmentation or the study of circuit diameters, even with a compact description of the underlying polytope. Second, through a case study of two classic graph-theoretic problems with exponential imbalance, the vertex graph coloring problem and the maximum weight forest problem, we exhibit the existence of sets of highly interpretable circuits within the set of 0/1 circuits of (best-case) imbalance 1. We prove that a restriction of circuit walks to these sets suffices to not only guarantee reachability of the integral extreme-points, but leads to a linear bound to walk between integral extreme-points for the fractional coloring polytope and a constant circuit diameter bound for the forest polytope, respectively. We conclude with a brief discussion of more general questions arising naturally from the use of 0/1 circuits in reachability and diameter studies.

math.OC↗

Volumes of the strong and weak relaxations of the uncapacitated facility-location polytope

Lee, Skipper, and Speakman (2018) asked for formulae or asymptotic expressions for the volumes of the strong and weak relaxations $\mathcal{P}_{m,n}\cap \mathcal{D}_{m,n}$ and $\mathcal{Q}_{m,n}\cap \mathcal{D}_{m,n}$ of the uncapacitated facility-location polytope with $m$ facilities and $n$ customers (their Problem~3, ``Texas Hot''). We give exact formulae for all $m$ and $n$, and we give asymptotics that hold uniformly as $m+n\to\infty$, whatever the relative growth of $m$ and $n$. The volume ratio satisfies $Vol(\mathcal{Q}_{m,n}\cap \mathcal{D}_{m,n})/Vol(\mathcal{P}_{m,n}\cap \mathcal{D}_{m,n})\sim \prod_{j=2}^{n}\mleft(1+\tfrac{1}{(m-1)j}\mright)^{m}$. From this, we read off the behavior in every growth regime of $m$, and we identify a sharp transition at $m\asymp\ln n$. Below it, in a uniformly random point of the strong relaxation, each facility variable is close to $1$ with high probability, and the ratio grows superlinearly in $n$. Above it, in a uniformly random point of either relaxation, each facility variable is asymptotically uniform on $[0,1]$, and the ratio grows linearly in $n$.

math.OC↗

New insights into the NLP-Id bound for maximum-entropy sampling

We establish new properties of the NLP-Id upper bound for the maxi\-mum-entropy sampling problem (MESP). In particular, we give a detailed look at the concavity of its objective function as a function of the scaling parameter employed for NLP bounds for MESP. This leads to more relaxed choices for the scaling parameter for NLP-Id and even improved upper bounds for MESP.

math.OC↗

On the relationship between MESP and 0/1 D-Opt and their upper bounds

We establish strong connections between two fundamental nonlinear 0/1 optimization problems coming from the area of experimental design, namely maximum-entropy sampling and 0/1 D-optimality. The connections are based on maps between instances, and we analyze the behavior of these maps. Using these maps, we transport basic upper-bounding methods between these two problems. Further, we establish results relating how different branch-and-bound schemes based on these maps compare. Additionally, we observe some surprising numerical results, where bounding methods that did not seem promising in their direct application to real-data MESP instances, are now useful for MESP instances that come from 0/1 D-optimality.

math.OC↗

On disjunction convex hulls for generalized cross polytopes

We continue the study of the natural polytope $\mathcal{D}$ in $\mathbb{R}^{n+d}$ associated with the disjunction of a set of $n+1$ polytopes in $\mathbb{R}^d$, managed by $n$ binary variables. Already $\mathcal{D}$ had been characterized for arbitrary $n\geq 1$ and (i) $d\in\{1,2\}$, and (ii) for a broad generalization of hyper-rectangles. In both cases, the complete characterization employs full optimal big-M lifting. Here, we give a complete description of $\mathcal{D}$ for the case of $n=1$ and arbitrary $d$, when the (two) polytopes are arbitrary generalized cross polytopes. Furthermore, we characterize when our complete description employs only optimal big-M lifting. For $n>1$, we generalize the family of facet-describing inequalities used for $n=1$. Finally, we carry out some computational experiments demonstrating the value of our theoretical results.

math.OC↗

ADMM for 0/1 D-optimality and Maximum-Entropy Sampling Relaxations

The 0/1 D-optimality problem and the Maximum-Entropy Sampling problem are two well-known NP-hard discrete maximization problems in experimental design. Algorithms for exact optimization (of moderate-sized instances) are based on branch-and-bound. The best upper-bounding methods are based on convex relaxation. We present ADMM (Alternating Direction Method of Multipliers) algorithms for solving these relaxations and experimentally demonstrate their practical value.

math.OC↗

On computing sparse universal solvers for key problems in statistics

We give sparsity results and present algorithms for calculating minimum (vector) 1-norm universal solvers connected to least-squares problems. In particular, besides universal least-squares solvers, we consider minimum-rank universal least-squares solvers, and simultaneous universal minimum-norm/least-squares solvers. For all of these, we present and compare several new alternative linear-programming formulations and very effective proximal-point algorithms. Overall, we found that our new Douglas-Rachford splitting algorithms for these problems performed best.

math.OC↗

The hyper-scaled NLP bound for maximum-entropy remote sampling

The maximum-entropy remote sampling problem (MERSP) is to select a subset of $s$ random variables from a set of $n$ random variables, so as to maximize the information concerning a set of target random variables that are not directly observable. We assume that the set of all of these random variables follows a joint Gaussian distribution, and that we have the covariance matrix available. Finally, we measure information using Shannon's differential entropy. The main approach for exact solution of moderate-sized instances of MERSP has been branch-and-bound (B\&B), and so previous work concentrated on upper bounds. Prior to our work, there were two upper-bounding methods for MERSP: the so-called ``complementary NLP bound'' and the ``spectral bound'', both introduced 25 years ago. We are able now to establish domination results between these two upper bounds. Further, we propose a novel and effective ``hyper-scaled NLP bound'' (hNLP bound) based on a subtle convex relaxation. The ``complementary'' version of hNLP bound for MERSP generalizes the previous complementary NLP bound for MERSP. We provide theoretical guarantees, giving sufficient conditions under which the complementary hNLP bound strictly dominates the complementary NLP bound. In addition, the hNLP formulation allows us to derive upper bounds for rank-deficient covariance matrices when they satisfy a technical condition. This is in contrast to the previous NLP bound that worked with only positive definite covariance matrices (because it was wedded to a complementary formulation). Additionally, we describe procedures for calculating hyper-scaling parameters. Finally, for B\&B, we provide a variable-fixing methodology and results guiding the best way to construct subproblems. Numerical experiments on benchmark instances demonstrate the effectiveness of our approaches in advancing the algorithmic state-of-the-art for MERSP.

math.OC↗

Sparse symmetric generalized inverses for sparse symmetric matrices

Generalized inverses play a fundamental role in numerical linear algebra, particularly when matrices are rectangular, singular, or rank deficient. Even when the input matrix is sparse, generalized inverses such as the M-P pseudoinverse are typically dense, leading to high storage requirements, expensive matrix-vector multiplications, and reduced efficiency. We investigate computing sparse symmetric generalized inverses for sparse symmetric matrices, extending previous work on sparse generalized inverses for rectangular rank-deficient matrices. We consider minimizing the vector 1-norm over the set of symmetric generalized inverses, using vector 1-norm minimization as a surrogate for sparsity promotion. We give a new characterization of symmetric generalized inverses of symmetric matrices, which yields a compact affine reformulation of the problem. From this, we develop a Douglas-Rachford splitting (DRS) algorithm equipped with a closed-form projection onto the feasible affine space. Computational experiments compare the proposed DRS approach with exact linear-optimization formulations solved by a commercial optimizer, as well as with local-search heuristics. The results demonstrate that the proposed formulation and algorithm produce generalized inverses that are substantially sparser than the Moore-Penrose pseudoinverse while maintaining significantly smaller 1-norms than competing approaches. Moreover, the DRS algorithm exhibits superior scalability relative to exact linear-optimization formulations, successfully solving instances far beyond the reach of commercial solvers. As an application, we investigate the computation of least-squares solutions for problems involving many right-hand-side vectors and sparse rank-deficient design matrices.

math.OC↗

Extended-variable relaxations for the constrained generalized maximum-entropy sampling problem

The constrained generalized maximum-entropy sampling problem (CGMESP) is to select an order-s principal submatrix from an order-n covariance matrix, subject to some linear side constraints, so as to maximize the product of its t greatest eigenvalues, 0 < t <= s <n. GMESP refers to the version with no side constraints. Introduced more than 25 years ago, CGMESP is a natural generalization of two fundamental problems in statistical design theory: (i) constrained maximum-entropy sampling problem (CMESP); (ii) binary D-optimality (D-Opt). In the general case, it can be motivated by a selection problem in the context of principal component analysis (PCA). We present novel non-convex extended variable formulations for CGMESP. Using these formulations as points of departure, we present, first non-convex and then convex, continuous relaxations for CGMESP. We demonstrate many relations between different upper bounds for CGMESP, including upper bounds from the literature and our new upper bounds. We investigate the behavior of our relaxations related to the constraints linking the natural variables with the extended variables. We propose and investigate a generalized scaling technique for bound improvement. In the context of branch-and-bound, we determine the better of two natural branching techniques for fixing variables to zero. Finally, we present numerical experiments illustrating the value of our methods.

math.OC↗