arXiv ScienceSearch

arXiv subjects

Manuel Radons

Publications and source records attributed to Manuel Radons.

At least 19 recordsLinked to original sources

Synthetic Data Generation and Differential Privacy using Tensor Networks' Matrix Product States (MPS)

Synthetic data generation is a key technique in modern artificial intelligence, addressing data scarcity, privacy constraints, and the need for diverse datasets in training robust models. In this work, we propose a method for generating privacy-preserving high-quality synthetic tabular data using Tensor Networks, specifically Matrix Product States (MPS). We benchmark the MPS-based generative model against state-of-the-art models such as CTGAN, VAE, and PrivBayes, focusing on both fidelity and privacy-preserving capabilities. To ensure differential privacy (DP), we integrate noise injection and gradient clipping during training, enabling privacy guarantees via R\'enyi Differential Privacy accounting. Across multiple metrics analyzing data fidelity and downstream machine learning task performance, our results show that MPS outperforms classical models, particularly under strict privacy constraints. This work highlights MPS as a promising tool for privacy-aware synthetic data generation. By combining the expressive power of tensor network representations with formal privacy mechanisms, the proposed approach offers an interpretable and scalable alternative for secure data sharing. Its structured design facilitates integration into sensitive domains where both data quality and confidentiality are critical.

cs.LG

Quantum reinforcement learning in dynamic environments

Combining quantum computing techniques in the form of amplitude amplification with classical reinforcement learning has led to the so-called "hybrid agent for quantum-accessible reinforcement learning", which achieves a quadratic speedup in sample complexity for certain learning problems. So far, this hybrid agent has only been applied to stationary learning problems, that is, learning problems without any time dependency within components of the Markov decision process. In this work, we investigate the applicability of the hybrid agent to dynamic RL environments. To this end, we enhance the hybrid agent by introducing a dissipation mechanism and, with the resulting learning agent, perform an empirical comparison with a classical RL agent in an RL environment with a time-dependent reward function. Our findings suggest that the modified hybrid agent can adapt its behavior to changes in the environment quickly, leading to a higher average success probability compared to its classical counterpart.

quant-ph

Introducing the Kernel Descent Optimizer for Variational Quantum Algorithms

In recent years, variational quantum algorithms have garnered significant attention as a candidate approach for near-term quantum advantage using noisy intermediate-scale quantum (NISQ) devices. In this article we introduce kernel descent, a novel algorithm for minimizing the functions underlying variational quantum algorithms. We compare kernel descent to existing methods and carry out extensive experiments to demonstrate its effectiveness. In particular, we showcase scenarios in which kernel descent outperforms gradient descent and quantum analytic descent. The algorithm follows the well-established scheme of iteratively computing classical local approximations to the objective function and subsequently executing several classical optimization steps with respect to the former. Kernel descent sets itself apart with its employment of reproducing kernel Hilbert space techniques in the construction of the local approximations, which leads to the observed advantages.

quant-ph

Denoising Gradient Descent in Variational Quantum Algorithms

In this article we introduce an algorithm for mitigating the adverse effects of noise on gradient descent in variational quantum algorithms. This is accomplished by computing a {\emph{regularized}} local classical approximation to the objective function at every gradient descent step. The computational overhead of our algorithm is entirely classical, i.e., the number of circuit evaluations is exactly the same as when carrying out gradient descent using the parameter-shift rules. We empirically demonstrate the advantages offered by our algorithm on randomized parametrized quantum circuits.

quant-ph

Interpolating Parametrized Quantum Circuits using Blackbox Queries

This article focuses on developing classical surrogates for parametrized quantum circuits using interpolation via (trigonometric) polynomials. We develop two algorithms for the construction of such surrogates and prove performance guarantees. The constructions are based on circuit evaluations which are blackbox in the sense that no structural specifics of the circuits are exploited. While acknowledging the limitations of the blackbox approach compared to whitebox evaluations, which exploit specific circuit properties, we demonstrate scenarios in which the blackbox approach might prove beneficial. Sample applications include but are not restricted to the approximation of VQEs and the alleviaton of the barren plateau problem.

quant-ph

On Neural Quantum Support Vector Machines

In \cite{simon2023algorithms} we introduced four algorithms for the training of neural support vector machines (NSVMs) and demonstrated their feasibility. In this note we introduce neural quantum support vector machines, that is, NSVMs with a quantum kernel, and extend our results to this setting.

quant-ph

Algorithms for the Training of Neural Support Vector Machines

Neural support vector machines (NSVMs) allow for the incorporation of domain knowledge in the design of the model architecture. In this article we introduce a set of training algorithms for NSVMs that leverage the Pegasos algorithm and provide a proof of concept by solving a set of standard machine learning tasks.

cs.LG

Edge-unfolding nested prismatoids

A $3$-Prismatoid is the convex hull of two convex polygons $A$ and $B$ which lie in parallel planes $H_A, H_B\subset\mathbb{R}^3$. Let $A'$ be the orthogonal projection of $A$ onto $H_B$. A prismatoid is called nested if $A'$ is properly contained in $B$, or vice versa. We show that every nested prismatoid has an edge-unfolding to a non-overlapping polygon in the plane.

math.MG

Convergence results for some piecewise linear solvers

Let $A$ be a real $n\times n$ matrix and $z,b\in \mathbb R^n$. The piecewise linear equation system $z-A\vert z\vert = b$ is called an \textit{absolute value equation}. We consider two solvers for this problem, one direct, one semi-iterative, and extend their previously known ranges of convergence.

math.NA

Generalized Perron Roots and Solvability of the Absolute Value Equation

Let $A$ be a $n\times n$ real matrix. The piecewise linear equation system $z-A\vert z\vert =b$ is called an absolute value equation (AVE). It is well-known to be equivalent to the linear complementarity problem. Unique solvability of the AVE is known to be characterized in terms of a generalized Perron root called the sign-real spectral radius of $A$. For mere, possibly non-unique, solvability no such characterization exists. We narrow this gap in the theory. That is, we define the concept of the aligned spectrum of $A$ and prove, under some mild genericity assumptions on $A$, that the mapping degree of the piecewise linear function $F_A:\mathbb{R}^n\to\mathbb{R}^n\,, z\mapsto z-A\lvert z\rvert$ is congruent to $(k+1)\mod 2$, where $k$ is the number of aligned values of $A$ which are larger than $1$. We also derive an exact--but more technical--formula for the degree of $F_A$ in terms of the aligned spectrum. Finally, we derive the analogous quantities and results for the LCP.

math.OC

An Open Newton Method for Piecewise Smooth Functions

Recent research has shown that piecewise smooth (PS) functions can be approximated by piecewise linear functions with second order error in the distance to a given reference point. A semismooth Newton type algorithm based on successive application of these piecewise linearizations was subsequently developed for the solution of PS equation systems. For local bijectivity of the linearization at a root, a radius of quadratic convergence was explicitly calculated in terms of local Lipschitz constants of the underlying PS function. In the present work we relax the criterium of local bijectivity of the linearization to local openness. For this purpose a weak implicit function theorem is proved via local mapping degree theory. It is shown that there exist PS functions $f:\mathbb R^2\rightarrow\mathbb R^2$ satisfying the weaker criterium where every neighborhood of the root of $f$ contains a point $x$ such that all elements of the Clarke Jacobian at $x$ are singular. In such neighborhoods the steps of classical semismooth Newton are not defined, which establishes the new method as an independent algorithm. To further clarify the relation between a PS function and its piecewise linearization, several statements about structure correspondences between the two are proved. Moreover, the influence of the specific representation of the local piecewise linear models on the robustness of our method is studied. An example application from cardiovascular mathematics is given.

math.OC

Semi-automatically optimized calibration of internal combustion engines

Modern combustion engines incorporate a number of actuators and sensors that can be used to control and optimize the performance and emissions. We describe a semi-automatic method to simultaneously measure and calibrate the actuator settings and the resulting behavior of the engine. The method includes an adaptive process for refining the measurements, a data cleaning step, and an optimization procedure. The optimization works in a discretized space and incorporates the conditions to describe the dependence between the actuators and the engine behavior as well as emission bounds. We demonstrate our method on practical examples.

math.OC

Sign controlled solvers for the absolute value equation with an application to support vector machines

Let $A$ be a real $n\times n$ matrix and $z,b\in \mathbb R^n$. The piecewise linear equation system $z-A\vert z\vert = b$ is called an absolute value equation. It is equivalent to the general linear complementarity problem, and thus NP hard in general. Concerning the latter problem, three solvers are presented: One direct, one semi-iterative and one discrete variant of damped Newton. Their previously proved ranges of correctness and convergence, respectively, are extended. Their performance is compared on instances of the XOR separation problem for support vector machines which can be reformulated as an absolute value equation.

math.NA

A note on surjectivity of piecewise affine mappings

A standard theorem in nonsmooth analysis states that a piecewise affine function $F:\mathbb R^n\rightarrow\mathbb R^n$ is surjective if it is coherently oriented in that the linear parts of its selection functions all have the same nonzero determinant sign. In this note we prove that surjectivity already follows from coherent orientation of the selection functions which are active on the unbounded sets of a polyhedral subdivision of the domain corresponding to $F$. A side bonus of the argumentation is a short proof of the classical statement that an injective piecewise affine function is coherently oriented.

math.OC

Piecewise linear secant approximation via Algorithmic Piecewise Differentiation

It is shown how piecewise differentiable functions $F: \mathbb R^n \mapsto \mathbb R^m $ that are defined by evaluation programs can be approximated locally by a piecewise linear model based on a pair of sample points $\check x$ and $\hat x$. We show that the discrepancy between function and model at any point $x$ is of the bilinear order $O(\|x-\check x\| \|x-\hat x\|)$. This is a little surprising since $x \in \mathbb R^n$ may vary over the whole Euclidean space, and we utilize only two function samples $\check F=F(\check x)$ and $\hat F=F(\hat x)$, as well as the intermediates computed during their evaluation. As an application of the piecewise linearization procedure we devise a generalized Newton's method based on successive piecewise linearization and prove for it sufficient conditions for convergence and convergence rates equaling those of semismooth Newton. We conclude with the derivation of formulas for the numerically stable implementation of the aforedeveloped piecewise linearization methods.

math.NA

Integrating Lipschitzian Dynamical Systems using Piecewise Algorithmic Differentiation

In this article we analyze a generalized trapezoidal rule for initial value problems with piecewise smooth right hand side \(F:\R^n\to\R^n\). When applied to such a problem the classical trapezoidal rule suffers from a loss of accuracy if the solution trajectory intersects a nondifferentiability of \(F\). The advantage of the proposed generalized trapezoidal rule is threefold: Firstly we can achieve a higher convergence order than with the classical method. Moreover, the method is energy preserving for piecewise linear Hamiltonian systems. Finally, in analogy to the classical case we derive a third order interpolation polynomial for the numerical trajectory. In the smooth case the generalized rule reduces to the classical one. Hence, it is a proper extension of the classical theory. An error estimator is given and numerical results are presented.

math.NA

Solving piecewise linear equations in abs-normal form

With the ultimate goal of iteratively solving piecewise smooth (PS) systems, we consider the solution of piecewise linear (PL) equations. PL models can be derived in the fashion of automatic or algorithmic differentiation as local approximations of PS functions with a second order error in the distance to a given reference point. The resulting PL functions are obtained quite naturally in what we call the abs-normal form, a variant of the state representation proposed by Bokhoven in his dissertation. Apart from the tradition of PL modeling by electrical engineers, which dates back to the Master thesis of Thomas Stern in 1956, we take into account more recent results on linear complementarity problems and semi-smooth equations originating in the optimization community. We analyze simultaneously the original PL problem (OPL) in abs-normal form and a corresponding complementary system (CPL), which is closely related to the absolute value equation (AVE) studied by Mangasarian et al and a corresponding linear complementarity problem (LCP). We show that the CPL, like KKT conditions and other simply switched systems, cannot be open without being injective. Hence some of the intriguing PL structure described by Scholtes is lost in the transformation from OPL to CPL. To both problems one may apply Newton variants with appropriate generalized Jacobians directly computable from the abs-normal representation. Alternatively, the CPL can be solved by Bokhoven's modulus method and related fixed point iterations. We compile the properties of the various schemes and highlight the connection to the properties of the Schur complement matrix, in particular its signed real spectral radius as analyzed by Rump. Numerical experiments and suitable combinations of the fixed point solvers and stabilized generalized Newton variants remain to be realized.

math.NA

Direct solution of piecewise linear systems

Let $S$ be a real $n\times n$ matrix, $z,\hat c\in \mathbb R^n$, and $| z|$ the componentwise modulus of $z$. Then the piecewise linear equation system $$z-S| z| = \hat c$$ is called an \textit{absolute value equation} (AVE). It has been proven to be equivalent to the general \textit{linear complementarity problem}, which means that it is NP hard in general. We will show that for several system classes the AVE essentially retains the good natured solvability properties of regular linear systems. I.e., it can be solved directly by a slightly modified Gaussian elimination that we call the signed Gaussian elimination. For dense matrices $S$ this algorithm has the same operations count as the classical Gaussian elimination with symmetric pivoting. For tridiagonal systems in $n$ variables its computational cost is roughly that of sorting $n$ floating point numbers. The sharpness of the proposed restrictions on $S$ will be established.

math.OC