arXiv subjects

Jean-Bernard Lasserre

Publications and source records attributed to Jean-Bernard Lasserre.

At least 73 records · Page 4Linked to original sources

arXiv2016

Lebesgue decomposition in action via semidefinite relaxations

Given all (finite) moments of two measures $μ$ and $λ$ on $\R^n$, we provide a numerical scheme to obtain the Lebesgue decomposition $μ=ν+ψ$ with $ν\llλ$ and $ψ\perpλ$. When$ν$ has a density in $L\_\infty(λ)$ then we obtain two sequences of finite moments vectorsof increasing size (the number of moments) which converge to the moments of $ν$ and $ψ$ respectively, as the number of moments increases. Importantly, {\it no} à priori knowledge on the supports of $μ, ν$ and $ψ$ is required.

math.OC↗

arXiv2015

A max-cut formulation of 0/1 programs

We show that the linear or quadratic 0/1 program\[P:\quad\min\{ c^Tx+x^TFx : \:A\,x =b;\:x\in\{0,1\}^n\},\]can be formulated as a MAX-CUT problem whose associated graph is simply related to the matrices $\F$ and $\A^T\A$.Hence the whole arsenal of approximation techniques for MAX-CUT can be applied. We also compare the lower boundof the resulting semidefinite (or Shor) relaxation with that of the standard LP-relaxation and the first semidefinite relaxationsassociated with the Lasserre hierarchy and the copositive formulations of $P$.

math.OC↗

arXiv2015

Semidefinite approximations of the polynomial abscissa

Given a univariate polynomial, its abscissa is the maximum real part of its roots. The abscissa arises naturally when controlling linear differential equations. As a function of the polynomial coefficients, the abscissa is H{ö}lder continuous, and not locally Lipschitz in general, which is a source of numerical difficulties for designing and optimizing control laws. In this paper we propose simple approximations of the abscissa given by polynomials of fixed degree, and hence controlled complexity. Our approximations are computed by a hierarchy of finite-dimensional convex semidefinite programming problems. When their degree tends to infinity, the polynomial approximations converge in norm to the abcissa, either from above or from below.

math.OC↗

arXiv2015

Semidefinite approximations of projections and polynomial images of semialgebraic sets

Given a compact semialgebraic set S of R^n and a polynomial map f from R^n to R^m, we consider the problem of approximating the image set F = f(S) in R^m. This includes in particular the projection of S on R^m for n greater than m. Assuming that F is included in a set B which is "simple" (e.g. a box or a ball), we provide two methods to compute certified outer approximations of F. Method 1 exploits the fact that F can be defined with an existential quantifier, while Method 2 computes approximations of the support of image measures.The two methods output a sequence of superlevel sets defined with a single polynomial that yield explicit outer approximations of F. Finding the coefficients of this polynomial boils down to computing an optimal solution of a convex semidefinite program. We provide guarantees of strong convergence to F in L^1 norm on B, when the degree of the polynomial approximation tends to infinity. Several examples of applications are provided, together with numerical experiments.

math.OC↗

arXiv2015

A bounded degree SOS hierarchy for polynomial optimization

We consider a new hierarchy of semidefinite relaxations for the general polynomial optimization problem $(P):\:f^{\ast}=\min \{\,f(x):x\in K\,\}$ on a compact basic semi-algebraic set $K\subset\R^n$. This hierarchy combines some advantages of the standard LP-relaxations associated with Krivine's positivity certificate and some advantages of the standard SOS-hierarchy. In particular it has the following attractive features: (a) In contrast to the standard SOS-hierarchy, for each relaxation in the hierarchy, the size of the matrix associated with the semidefinite constraint is the same and fixed in advance by the user. (b) In contrast to the LP-hierarchy, finite convergence occurs at the first step of the hierarchy for an important class of convex problems. Finally (c) some important techniques related to the use of point evaluations for declaring a polynomial to be zero and to the use of rank-one matrices make an efficient implementation possible. Preliminary results on a sample of non convex problems are encouraging.

math.OC↗

arXiv2014

A generalization of Löwner-John's ellipsoid theorem

We address the following generalization $P$ of the Lowner-John ellipsoid problem. Given a (non necessarily convex) compact set $K\subset R^n$ and an even integer $d$, find an homogeneous polynomial $g$ of degree $d$ such that $K\subset G:=\{x:g(x)\leq1\}$ and $G$ has minimum volume among all such sets. We show that $P$ is a convex optimization problem even if neither $K$ nor $G$ are convex! We next show that $P$ has a unique optimal solution and a characterization with at most ${n+d-1\choose d}$ contacts points in $K\cap G$ is also provided. This is the analogue for $d\textgreater{}2$ of the Lowner-John's theorem in the quadratic case $d=2$, but importantly, we neither require the set $K$ nor the sublevel set $G$ to be convex. More generally, there is also an homogeneous polynomial $g$ of even degree $d$ and a point $a\in R^n$ such that $K\subset G\_a:=\{x:g(x-a)\leq1\}$ and $G\_a$ has minimum volume among all such sets (but uniqueness is not guaranteed). Finally, we also outline a numerical scheme to approximate as closely as desired the optimal value and an optimal solution. It consists of solving a hierarchy of convex optimization problems with strictly convex objective function and Linear Matrix Inequality (LMI) constraints.

math.OC↗

arXiv2014

Unit balls of constant volume: which one has optimal representation?

In the family of unit balls with constant volume we look at the ones whose algebraic representation has some extremal property. We consider the family of nonnegative homogeneous polynomials of even degree $d$ whose sublevel set $\G=\{\x: g(\x)\leq 1\}$ (a unit ball) has same fixed volume and want to find in this family the one that minimizes either the $\ell_1$-norm or the $\ell_2$-norm of its vector of coefficients. Equivalently, among all degree-$d$ polynomials of constant $\ell_1-$ or $\ell_2$-norm, which one minimizes the volume of its level set $\G$. We first show that in both cases this is a convex optimization problem with a unique optimal solution $g^*_1$ and $g^*_2$ respectively. We also show that $g^*_1$ is the $L_p$-norm polynomial $\x\mapsto\sum_{i=1}^n x_i^{p}$, thus recovering a parsimony property of the $L_p$-norm via $\ell_1$-norm minimization. (Indeed $n=\Vert g^*_1\Vert_0$ is the minimum number of non-zero coefficient for $\G$ to have finite volume.) This once again illustrates the power and versatility of the $\ell_1$-norm relaxation strategy in optimization when one searches for an optimal solution with parsimony properties. Next we show that $g^*_2$ is not sparse at all (and so differs from $g^*_1$) but is still a sum of $p$-powers of linear forms. We also characterize the unique optimal solution of the same problem where one searches for an SOS homogeneous polynomial that minimizes the trace of its associated (psd) Gram matrix, hence aiming at finding a solution which is a sum of a few squares only. Finally, we also extend these results to generalized homogeneous polynomials, which includes $L_p$-norms when $0

math.OC↗

arXiv2014

A unified framework for solving a general class of conditional and robust set-membership estimation problems

In this paper we present a unified framework for solving a general class of problems arising in the context of set-membership estimation/identification theory. More precisely, the paper aims at providing an original approach for the computation of optimal conditional and robust projection estimates in a nonlinear estimation setting where the operator relating the data and the parameter to be estimated is assumed to be a generic multivariate polynomial function and the uncertainties affecting the data are assumed to belong to semialgebraic sets. By noticing that the computation of both the conditional and the robust projection optimal estimators requires the solution to min-max optimization problems that share the same structure, we propose a unified two-stage approach based on semidefinite-relaxation techniques for solving such estimation problems. The key idea of the proposed procedure is to recognize that the optimal functional of the inner optimization problems can be approximated to any desired precision by a multivariate polynomial function by suitably exploiting recently proposed results in the field of parametric optimization. Two simulation examples are reported to show the effectiveness of the proposed approach.

eess.SY↗

arXiv2014

Approximating Pareto Curves using Semidefinite Relaxations

We consider the problem of constructing an approximation of the Pareto curve associated with the multiobjective optimization problem $\min_{\mathbf{x} \in \mathbf{S}}\{ (f_1(\mathbf{x}), f_2(\mathbf{x})) \}$, where $f_1$ and $f_2$ are two conflicting polynomial criteria and $\mathbf{S} \subset \mathbb{R}^n$ is a compact basic semialgebraic set. We provide a systematic numerical scheme to approximate the Pareto curve. We start by reducing the initial problem into a scalarized polynomial optimization problem (POP). Three scalarization methods lead to consider different parametric POPs, namely (a) a weighted convex sum approximation, (b) a weighted Chebyshev approximation, and (c) a parametric sublevel set approximation. For each case, we have to solve a semidefinite programming (SDP) hierarchy parametrized by the number of moments or equivalently the degree of a polynomial sums of squares approximation of the Pareto curve. When the degree of the polynomial approximation tends to infinity, we provide guarantees of convergence to the Pareto curve in $L^2$-norm for methods (a) and (b), and $L^1$-norm for method (c).

math.OC↗

arXiv2014

Rank-constrained fundamental matrix estimation by polynomial global optimization versus the eight-point algorithm

The fundamental matrix can be estimated from point matches. The current gold standard is to bootstrap the eight-point algorithm and two-view projective bundle adjustment. The eight-point algorithm first computes a simple linear least squares solution by minimizing an algebraic cost and then projects the result to the closest rank-deficient matrix. We propose a single-step method that solves both steps of the eight-point algorithm. Using recent results from polynomial global optimization, our method finds the rank-deficient matrix that exactly minimizes the algebraic cost. In this special case, the optimization method is reduced to the resolution of very short sequences of convex linear problems which are computationally efficient and numerically stable. The current gold standard is known to be extremely effective but is nonetheless outperformed by our rank-constrained method for bootstrapping bundle adjustment. This is here demonstrated on simulated and standard real datasets. With our initialization, bundle adjustment consistently finds a better local minimum (achieves a lower reprojection error) and takes less iterations to converge.

math.OC↗

arXiv2014

Reconstruction of algebraic-exponential data from moments

Let $G$ be a bounded open subset of Euclidean space with real algebraic boundary $Γ$. Under the assumption that the degree $d$ of $Γ$ is given, and the power moments of the Lebesgue measure on $G$ are known up to order $3d$, we describe an algorithmic procedure for obtaining a polynomial vanishing on $Γ$. The particular case of semi-algebraic sets defined by a single polynomial inequality raises an intriguing question related to the finite determinateness of the full moment sequence. The more general case of a measure with density equal to the exponential of a polynomial is treated in parallel. Our approach relies on Stokes theorem and simple Hankel-type matrix identities.

math.OC↗

arXiv2014

On Convex optimization without convex representation

We consider the convex optimization problem P: min {f(x): x in K} where "f" is convex continuously differentiable, and K is a compact convex set in Rn with representation {x: g_j(x) >=0, j=1,;;,m} for some continuously differentiable functions (g_j). We discuss the case where the g_j's are not all concave (in contrast with convex programming where they all are). In particular, even if the g_j's are not concave, we consider the log-barrier function phi_μwith parameter μ, associated with P, usually defined for concave functions (g_j). We then show that any limit point of any sequence (x_μ) of stationary points of phi_μ, μ->0, is a Karush-Kuhn-Tucker point of problem P and a global minimizer of f on K.

math.OC↗

arXiv2013

Borel measures with a density on a compact semi-algebraic set

Let $K\subset R^n$ be a compact basic semi-algebraic set. We provide a necessary and sufficient condition (with no a priori bounding parameter) for a real sequence $y=(y_α)$, $α\in N^n$, to have a finite representing Borel measure absolutely continuous w.r.t. the Lebesgue measure on $K$, and with a density in $\cap_{p=1}^\infty L_p(K)$. With an additional condition involving a bounding parameter, the condition is necessary and sufficient for existence of a density in $L_\infty(K)$. Moreover, nonexistence of such a density can be detected by solving finitely many of a hierarchy of semidefinite programs. In particular, if the semidefinite program at step $d$ of the hierarchy has no solution then the sequence cannot have a representing measure on $K$ with a density in $L_p(K)$ for any $p\geq 2d$.

math.OC↗

arXiv2013

On Polynomial Optimization over Non-compact Semi-algebraic Sets

We consider the class of polynomial optimization problems $\inf \{f(x):x\in K\}$ for which the quadratic module generated by the polynomials that define $K$ and the polynomial $c-f$ (for some scalar $c$) is Archimedean. For such problems, the optimal value can be approximated as closely as desired by solving a hierarchy of semidefinite programs and the convergence is finite generically. Moreover, the Archimedean condition (as well as a sufficient coercivity condition) can also be checked numerically by solving a similar hierarchy of semidefinite programs. In other words, under reasonable assumptions the now standard hierarchy of SDP-relaxations extends to the non-compact case via a suitable modification.

math.OC↗

arXiv2013

Moment LMI approach to LTV impulsive control

In the 1960s, a moment approach to linear time varying (LTV) minimal norm impulsive optimal control was developed, as an alternative to direct approaches (based on discretization of the equations of motion and linear programming) or indirect approaches (based on Pontryagin's maximum principle). This paper revisits these classical results in the light of recent advances in convex optimization, in particular the use of measures jointly with hierarchy of linear matrix inequality (LMI) relaxations. Linearity of the dynamics allows us to integrate system trajectories and to come up with a simplified LMI hierarchy where the only unknowns are moments of a vector of control measures of time. In particular, occupation measures of state and control variables do not appear in this formulation. This is in stark contrast with LMI relaxations arising usually in polynomial optimal control, where size grows quickly as a function of the relaxation order. Jointly with the use of Chebyshev polynomials (as a numerically more stable polynomial basis), this allows LMI relaxations of high order (up to a few hundreds) to be solved numerically.

math.OC↗

arXiv2012

The truncated K-Moment problem for closure of open sets

We solve the truncated K-moment problem when $K\subseteq R^n$ is the closure of a, not necessarily bounded, open set (which includes the important cases $K=R^n$ and $K=R^n_+$). That is, we completely characterize the interior of the convex cone of finite sequences that have a representing measure on $K\subseteq R^n$. It is in fact the domain of the Legendre-Fenchel transform associated with a certain convex function. And so in this context, detecting whether a sequence is in the interior of this cone reduces to solving a finite-dimensional convex optimization problem. This latter problem is related to maximum entropy methods for approximating an unknown density from knowing only finitely many of its moments. Interestingly, the proposed approach is essentially geometric and of independent interest, as it also addresses the abstract problem of characterizing the interior of a convex cone C which is the conical hull of a set continuously parametrized by a compact set $M\subset R^n$ or $M \subseteq S^{n-1}$, where $M$ is the closure of an open subset of $R^n$ (resp. $S^{n-1}$). As a by-product we also obtain a barrier function for the cone C.

math.OC↗

arXiv2012

Inverse polynomial optimization

We consider the inverse optimization problem associated with the polynomial program f^*=\min \{f(x): x\in K\}$ and a given current feasible solution $y\in K$. We provide a systematic numerical scheme to compute an inverse optimal solution. That is, we compute a polynomial $\tilde{f}$ (which may be of same degree as $f$ if desired) with the following properties: (a) $y$ is a global minimizer of $\tilde{f}$ on $K$ with a Putinar's certificate with an a priori degree bound $d$ fixed, and (b), $\tilde{f}$ minimizes $\Vert f-\tilde{f}\Vert$ (which can be the $\ell_1$, $\ell_2$ or $\ell_\infty$-norm of the coefficients) over all polynomials with such properties. Computing $\tilde{f}_d$ reduces to solving a semidefinite program whose optimal value also provides a bound on how far is $f(\y)$ from the unknown optimal value $f^*$. The size of the semidefinite program can be adapted to the computational capabilities available. Moreover, if one uses the $\ell_1$-norm, then $\tilde{f}$ takes a simple and explicit canonical form. Some variations are also discussed.

math.OC↗

arXiv2011

Moment Matrices, Border Bases and Real Radical Computation

In this paper, we describe new methods to compute the radical (resp. real radical) of an ideal, assuming it complex (resp. real) variety is finite. The aim is to combine approaches for solving a system of polynomial equations with dual methods which involve moment matrices and semi-definite programming. While the border basis algorithms of [17] are efficient and numerically stable for computing complex roots, algorithms based on moment matrices [12] allow the incorporation of additional polynomials, e.g., to re- strict the computation to real roots or to eliminate multiple solutions. The proposed algorithm can be used to compute a border basis of the input ideal and, as opposed to other approaches, it can also compute the quotient structure of the (real) radical ideal directly, i.e., without prior algebraic techniques such as Gröbner bases. It thus combines the strength of existing algorithms and provides a unified treatment for the computation of border bases for the ideal, the radical ideal and the real radical ideal.

math.AG↗