arXiv Science⌕ Search

arXiv subjects

Marcia Fampa

Publications and source records attributed to Marcia Fampa.

At least 19 recordsLinked to original sources
arXiv2026

Mixed-Integer Second-Order Cone Formulations for the Euclidean Bottleneck Steiner Tree Problem in $\mathbb{R}^d$

Given a set of terminals in $\mathbb{R}^d$ and an integer $k\ge0$, the Euclidean bottleneck Steiner tree problem (EBSTP) asks for a tree spanning the terminals with at most $k$ Steiner points that minimizes its longest edge. Although the planar case has been widely studied, exact optimization methods for arbitrary dimension remain scarce. We develop two exact mixed-integer second-order cone programming (MISOCP) formulations for the EBSTP: a single-commodity flow formulation and a formulation with connectivity cuts. Both formulations share a geometric core based on edge-conditional second-order cone constraints and are strengthened by problem-specific preprocessing, edge-dependent big-$M$ constants, symmetry-breaking constraints, constructive upper bounds, and new global lower bounds on the optimal value. We establish the correctness of the formulations and prove the validity of all strengthening techniques. Computational experiments on 1050 benchmark instances in dimensions $d\in\{2,3,4\}$, with up to $50$ terminals and $9$ Steiner points, show that the single-commodity flow formulation consistently outperforms the formulation with connectivity cuts, with an advantage { in solved instances} that grows with dimension. The proposed global lower bounds substantially strengthen the root relaxation, while the single-commodity flow formulation provides the most robust exact solution method across all test sets. These results establish the single-commodity flow formulation as an effective exact approach for the EBSTP in arbitrary fixed dimension.

math.OC↗
arXiv2026

On the 100% Rule of Linear Programming

The so-called ``100% rule'' is a somewhat classical and yet somehow obscure rule that gives some local sensitivity-analysis information based on the very limited local sensitivity-analysis information that is often made available by linear-programming software, derived from an optimal basis that is hidden from the user. Introduced in a classic undergraduate textbook in 1977, half a century ago, it was only picked up on by researchers in a very limited way, and while it appears in some undergraduate textbooks, it tends not to appear in most modern graduate-level textbooks. Our contributions are to celebrate and revive interest in the 100% rule and to extend it in a meaningful way. We introduce a cone rule that certifies primal feasibility for more right-hand sides than the 100% rule does, using the same information, and that can be applied in linear time. We then study when this cone rule is tight, that is, when it captures the entire cone of right-hand sides for which the basis remains feasible. We characterize tightness in every dimension for right-hand sides interior to that cone, make the characterization explicit for m=2 and m=3, and settle the question for tridiagonal bases in every dimension: tightness is impossible once m>=4, and for m=3 we give an explicit criterion in the entries of the basis. We give further results for symmetric, integer and unimodular bases. Finally, when tightness fails, we measure the fraction of the feasibility cone captured by the rule using normalized solid angles. For the autoregressive family at m=3, we obtain a closed-form candidate for the infimum of this fraction over all right-hand sides, whose optimality is supported numerically. We also obtain a closed-form expression for the best case over most of the correlation range, subject to two numerically verified properties, and estimate the best-case value numerically more generally.

math.OC↗
arXiv2026

Faster dynamic programming for tridiagonal maximum-entropy sampling

The maximum-entropy sampling problem (MESP) seeks, for an order-$n$ covariance matrix $C$, a principal submatrix of order $s$ with maximum log-determinant. Mostly for convenience, we assume that $C$ is nonsingular. Al-Thani and Lee (2023) solved MESP in $O(n^5)$ time when $C$ or $C^{-1}$ is tridiagonal. We show that the inner maximization of their recursion depends only on a prefix of the index set and that no piece of a solution is longer than $s$; this gives an $O(ns^2)$-time algorithm that returns the optimal value for every budget $t\le s$. When $C^{-1}$ is tridiagonal, $C$ is, up to scaling, the covariance matrix of an Ornstein--Uhlenbeck process observed at unevenly spaced times, and MESP becomes choosing points on a line under a concave gap function with the Monge property; this gives an $O(ns)$-time algorithm and, in the first-order autoregressive case, a closed-form solution. Given only $C$, we solve MESP in $O(n^2)$ time whenever $C$ or $C^{-1}$ is tridiagonal, up to a symmetric permutation, and we recognize these cases within the same bound. For spiders, we make explicit, and sharpen, the dependence on the number of legs, and, drawing on a hardness result of Ohsaka for stars, we observe that, unless $\mathrm{P}=\mathrm{NP}$, the exponent of the running time must grow with the number of legs.

cs.DS↗
arXiv2026

New insights into the NLP-Id bound for maximum-entropy sampling

We establish new properties of the NLP-Id upper bound for the maxi\-mum-entropy sampling problem (MESP). In particular, we give a detailed look at the concavity of its objective function as a function of the scaling parameter employed for NLP bounds for MESP. This leads to more relaxed choices for the scaling parameter for NLP-Id and even improved upper bounds for MESP.

math.OC↗
arXiv2026

On the relationship between MESP and 0/1 D-Opt and their upper bounds

We establish strong connections between two fundamental nonlinear 0/1 optimization problems coming from the area of experimental design, namely maximum-entropy sampling and 0/1 D-optimality. The connections are based on maps between instances, and we analyze the behavior of these maps. Using these maps, we transport basic upper-bounding methods between these two problems. Further, we establish results relating how different branch-and-bound schemes based on these maps compare. Additionally, we observe some surprising numerical results, where bounding methods that did not seem promising in their direct application to real-data MESP instances, are now useful for MESP instances that come from 0/1 D-optimality.

math.OC↗
arXiv2026

ADMM for 0/1 D-optimality and Maximum-Entropy Sampling Relaxations

The 0/1 D-optimality problem and the Maximum-Entropy Sampling problem are two well-known NP-hard discrete maximization problems in experimental design. Algorithms for exact optimization (of moderate-sized instances) are based on branch-and-bound. The best upper-bounding methods are based on convex relaxation. We present ADMM (Alternating Direction Method of Multipliers) algorithms for solving these relaxations and experimentally demonstrate their practical value.

math.OC↗
arXiv2026

On computing sparse universal solvers for key problems in statistics

We give sparsity results and present algorithms for calculating minimum (vector) 1-norm universal solvers connected to least-squares problems. In particular, besides universal least-squares solvers, we consider minimum-rank universal least-squares solvers, and simultaneous universal minimum-norm/least-squares solvers. For all of these, we present and compare several new alternative linear-programming formulations and very effective proximal-point algorithms. Overall, we found that our new Douglas-Rachford splitting algorithms for these problems performed best.

math.OC↗
arXiv2026

The hyper-scaled NLP bound for maximum-entropy remote sampling

The maximum-entropy remote sampling problem (MERSP) is to select a subset of $s$ random variables from a set of $n$ random variables, so as to maximize the information concerning a set of target random variables that are not directly observable. We assume that the set of all of these random variables follows a joint Gaussian distribution, and that we have the covariance matrix available. Finally, we measure information using Shannon's differential entropy. The main approach for exact solution of moderate-sized instances of MERSP has been branch-and-bound (B\&B), and so previous work concentrated on upper bounds. Prior to our work, there were two upper-bounding methods for MERSP: the so-called ``complementary NLP bound'' and the ``spectral bound'', both introduced 25 years ago. We are able now to establish domination results between these two upper bounds. Further, we propose a novel and effective ``hyper-scaled NLP bound'' (hNLP bound) based on a subtle convex relaxation. The ``complementary'' version of hNLP bound for MERSP generalizes the previous complementary NLP bound for MERSP. We provide theoretical guarantees, giving sufficient conditions under which the complementary hNLP bound strictly dominates the complementary NLP bound. In addition, the hNLP formulation allows us to derive upper bounds for rank-deficient covariance matrices when they satisfy a technical condition. This is in contrast to the previous NLP bound that worked with only positive definite covariance matrices (because it was wedded to a complementary formulation). Additionally, we describe procedures for calculating hyper-scaling parameters. Finally, for B\&B, we provide a variable-fixing methodology and results guiding the best way to construct subproblems. Numerical experiments on benchmark instances demonstrate the effectiveness of our approaches in advancing the algorithmic state-of-the-art for MERSP.

math.OC↗
arXiv2026

Sparse symmetric generalized inverses for sparse symmetric matrices

Generalized inverses play a fundamental role in numerical linear algebra, particularly when matrices are rectangular, singular, or rank deficient. Even when the input matrix is sparse, generalized inverses such as the M-P pseudoinverse are typically dense, leading to high storage requirements, expensive matrix-vector multiplications, and reduced efficiency. We investigate computing sparse symmetric generalized inverses for sparse symmetric matrices, extending previous work on sparse generalized inverses for rectangular rank-deficient matrices. We consider minimizing the vector 1-norm over the set of symmetric generalized inverses, using vector 1-norm minimization as a surrogate for sparsity promotion. We give a new characterization of symmetric generalized inverses of symmetric matrices, which yields a compact affine reformulation of the problem. From this, we develop a Douglas-Rachford splitting (DRS) algorithm equipped with a closed-form projection onto the feasible affine space. Computational experiments compare the proposed DRS approach with exact linear-optimization formulations solved by a commercial optimizer, as well as with local-search heuristics. The results demonstrate that the proposed formulation and algorithm produce generalized inverses that are substantially sparser than the Moore-Penrose pseudoinverse while maintaining significantly smaller 1-norms than competing approaches. Moreover, the DRS algorithm exhibits superior scalability relative to exact linear-optimization formulations, successfully solving instances far beyond the reach of commercial solvers. As an application, we investigate the computation of least-squares solutions for problems involving many right-hand-side vectors and sparse rank-deficient design matrices.

math.OC↗
arXiv2026

Extended-variable relaxations for the constrained generalized maximum-entropy sampling problem

The constrained generalized maximum-entropy sampling problem (CGMESP) is to select an order-s principal submatrix from an order-n covariance matrix, subject to some linear side constraints, so as to maximize the product of its t greatest eigenvalues, 0 < t <= s <n. GMESP refers to the version with no side constraints. Introduced more than 25 years ago, CGMESP is a natural generalization of two fundamental problems in statistical design theory: (i) constrained maximum-entropy sampling problem (CMESP); (ii) binary D-optimality (D-Opt). In the general case, it can be motivated by a selection problem in the context of principal component analysis (PCA). We present novel non-convex extended variable formulations for CGMESP. Using these formulations as points of departure, we present, first non-convex and then convex, continuous relaxations for CGMESP. We demonstrate many relations between different upper bounds for CGMESP, including upper bounds from the literature and our new upper bounds. We investigate the behavior of our relaxations related to the constraints linking the natural variables with the extended variables. We propose and investigate a generalized scaling technique for bound improvement. In the context of branch-and-bound, we determine the better of two natural branching techniques for fixing variables to zero. Finally, we present numerical experiments illustrating the value of our methods.

math.OC↗
arXiv2026

Convex relaxation for the generalized maximum-entropy sampling problem

The generalized maximum-entropy sampling problem (GMESP) is to select an order-$s$ principal submatrix from an order-$n$ covariance matrix, to maximize the product of its $t$ greatest eigenvalues, $0<t\leq s <n$. Introduced more than 25 years ago, GMESP is a natural generalization of two fundamental problems in statistical design theory: (i) maximum-entropy sampling problem (MESP); (ii) binary D-optimality (D-Opt). In the general case, it can be motivated by a selection problem in the context of principal component analysis (PCA). We introduce the first convex-optimization based relaxation for GMESP, study its behavior, compare it to an earlier spectral bound, and demonstrate its use in a branch-and-bound scheme. We find that such an approach is practical when $s-t$ is very small.

math.ST↗
arXiv2026

The dual-path fixing strategy and its application to the set-covering problem

We introduce the dual-path fixing strategy to exploit dual algorithms for solving relaxations of mixed-integer nonlinear-optimization problems. Such dual algorithms are naturally applied in the context of branch-and-bound, and eventual impact on the success of branch-and-bound is our strong motivation. Our fixing strategy aims to be more powerful than the common strategy of fixing variables based on a single dual-feasible solution (e.g., standard reduced-cost fixing for mixed-integer linear optimization), but to be much faster than ``strong fixing'', essentially requiring no more time than that of the dual algorithm that we exploit. We have successfully tested our ideas on mixed-integer linear-optimization set-covering instances from the literature, in the context of the dual-simplex method applied to the continuous relaxations.

math.OC↗
arXiv2025

Recent Advances in Maximum-Entropy Sampling

In 2022, we published the book Maximum-Entropy Sampling: Algorithms and Application (Springer). Since then, there have been several notable advancements on this topic. In this manuscript, we survey some recent highlights.

cs.DS↗
arXiv2025

On a geometric graph-covering problem related to optimal safety-landing-site location

We propose integer-programming formulations for an optimal safety-landing site (SLS) location problem that arises in the design of urban air-transportation networks. We first develop a set-cover based approach for the case where the candidate location set is finite and composed of points, and we link the problems to solvable cases that have been studied. We then use a mixed-integer second-order cone program to model the situation where the locations of SLSs are restricted to convex sets only. Finally, we introduce strong fixing, which we found to be very effective in reducing the size of integer programs.

math.OC↗
arXiv2025

Good and Fast Row-Sparse ah-Symmetric Reflexive Generalized Inverses

We present several algorithms aimed at constructing sparse and structured sparse (row-sparse) generalized inverses, with application to the efficient computation of least-squares solutions, for inconsistent systems of linear equations, in the setting of multiple right-hand sides and a rank-deficient constraint matrix. Leveraging our earlier formulations to minimize the 1- and 2,1- norms of generalized inverses that satisfy important properties of the Moore-Penrose pseudoinverse, we develop efficient and scalable ADMM algorithms to address these norm-minimization problems and to limit the number of nonzero rows in the solution. We establish a 2,1-norm approximation result for a local-search procedure that was originally designed for 1-norm minimization, and we compare the ADMM algorithms with the local-search procedure and with general-purpose optimization solvers.

math.OC↗
arXiv2024

Computing Experiment-Constrained D-Optimal Designs

In optimal experimental design, the objective is to select a limited set of experiments that maximizes information about unknown model parameters based on factor levels. This work addresses the generalized D-optimal design problem, allowing for nonlinear relationships in factor levels. We develop scalable algorithms suitable for cases where the number of candidate experiments grows exponentially with the factor dimension, focusing on both first- and second-order models under design constraints. Particularly, our approach integrates convex relaxation with pricing-based local search techniques, which can provide upper bounds and performance guarantees. Unlike traditional local search methods, such as the ``Fedorov exchange" and its variants, our method effectively accommodates arbitrary side constraints in the design space. Furthermore, it yields both a feasible solution and an upper bound on the optimal value derived from the convex relaxation. Numerical results highlight the efficiency and scalability of our algorithms, demonstrating superior performance compared to the state-of-the-art commercial software, JMP

cs.DS↗
arXiv2024

Generalized Scaling for the Constrained Maximum-Entropy Sampling Problem

The best practical techniques for exact solution of instances of the constrained maximum-entropy sampling problem, a discrete-optimization problem arising in the design of experiments, are via a branch-and-bound framework, working with a variety of concave continuous relaxations of the objective function. A standard and computationally-important bound-enhancement technique in this context is (ordinary) scaling, via a single positive parameter. Scaling adjusts the shape of continuous relaxations to reduce the gaps between the upper bounds and the optimal value. We extend this technique to generalized scaling, employing a positive vector of parameters, which allows much more flexibility and thus potentially reduces the gaps further. We give mathematical results aimed at supporting algorithmic methods for computing optimal generalized scalings, and we give computational results demonstrating the performance of generalized scaling on benchmark problem instances.

math.OC↗