arXiv ScienceSearch

arXiv subjects

Martin Redmann

Publications and source records attributed to Martin Redmann.

At least 19 recordsLinked to original sources

Tree-based solution representations for quadratic bilinear systems and their consequences in model order reduction

We investigate quadratic bilinear systems by developing novel tree-based representations of their solutions. The proposed framework decomposes the solution into a sequence of coupled bilinear subsystems whose components admit explicit expansions indexed by full binary trees. These representations yield sufficient conditions for the existence of global solutions and lead to new output bounds in terms of reachability Gramians. Motivated by these estimates, we introduce time-limited and infinite-horizon reachability and observability Gramians, establish sufficient conditions for their existence, and characterize them through nonlinear matrix equations. The associated Gramians are employed to identify dominant state-spaces and to derive exact reduced-order models obtained by removing Gramian kernels. Building on these results, we develop a balanced truncation method for quadratic bilinear systems and prove an error bound for the reduced-order approximation. The proposed framework provides a unified connection between tree-based solution representations, nonlinear Gramian theory, and balanced truncation for quadratic bilinear systems, closing several theoretical gaps in the analysis of Gramian-based model reduction for this class of systems.

math.OC

Signature-Based Universal Bilinear Approximations for Nonlinear Systems and Model Order Reduction

This paper deals with non-Lipschitz nonlinear systems. Such systems can be approximated by a linear map of so-called signatures, which play a crucial role in the theory of rough paths and can be interpreted as collections of iterated integrals involving the control process. As a consequence, we identify a universal bilinear system, solved by the signature, that can approximate the state or output of the original nonlinear dynamics arbitrarily well. In contrast to other (bi)linearization techniques, the signature approach remains feasible in large-scale settings, as the dimension of the associated bilinear system grows only with the number of inputs. However, the signature model is typically of high order, requiring an optimization process based on model order reduction (MOR). We derive an MOR method for unstable bilinear systems with non-zero initial states and apply it to the signature, yielding a potentially low-dimensional bilinear model. An advantage of our method is that the original nonlinear system need not be known explicitly, since only data are required to learn the linear map of the signature. The subsequent MOR procedure is model-oriented and specifically designed for the signature process. Consequently, this work has two main applications: (1) efficient modeling/data fitting using small-scale bilinear systems, and (2) MOR for nonlinear systems. We illustrate the effectiveness of our approach in the second application through numerical experiments.

math.OC

Model reduction for fully nonlinear stochastic systems

This paper presents a novel model order reduction framework tailored for fully nonlinear stochastic dynamics without lifting them to quadratic systems and without using linearization techniques. By directly leveraging structural properties of the nonlinearities -- such as local and one-sided Lipschitz continuity or one-sided linear growth conditions -- the approach defines generalized reachability and observability Gramians through Lyapunov-type differential operators. These Gramians enable projection-based reduction while preserving essential dynamics and stochastic characteristics. The paper provides sufficient conditions for the existence of these Gramians, including a Lyapunov-based mean square stability criterion, and derives explicit output error bounds for the reduced order models. Furthermore, the work introduces a balancing and truncation procedure for obtaining reduced systems and demonstrates how dominant subspaces can be identified from the spectrum of the Gramians. The theoretical findings are grounded in rigorous stochastic analysis, extending balanced truncation techniques to a broad class of nonlinear systems under stochastic excitation.

math.PR

Dimension reduction for path signatures

This paper focuses on the mathematical framework for reducing the complexity of models using path signatures. The structure of these signatures, which can be interpreted as collections of iterated integrals along paths, is discussed and their applications in areas such as stochastic differential equations (SDEs) and financial modeling are pointed out. In particular, exploiting the rough paths view, solutions of SDEs continuously depend on the lift of the driver. Such continuous mappings can be approximated using (truncated) signatures, which are solutions of high-dimensional linear systems. In order to lower the complexity of these models, this paper presents methods for reducing the order of high-dimensional truncated signature models while retaining essential characteristics. The derivation of reduced models and the universal approximation property of (truncated) signatures are treated in detail. Numerical examples, including applications to the (rough) Bergomi model in financial markets, illustrate the proposed reduction techniques and highlight their effectiveness.

math.PR

Dimension reduction for large-scale stochastic systems with non-zero initial states and controlled diffusion

In this paper, we establish new strategies to reduce the dimension of large-scale controlled stochastic differential equations with non-zero initial states. The first approach transforms the original setting into a stochastic system with zero initial states. This transformation naturally leads to equations with controlled diffusion. A detailed analysis of dominant subspaces and bounds for the reduction error is provided in this controlled diffusion framework. Subsequently, we introduce a reduced system for the original framework and prove an a-priori error bound for the first ansatz. This bound involves so-called Hankel singular values that are linked to a new pair of Gramians. A second strategy is presented that is based on the idea of reducing control and initial state dynamics separately. Here, different Gramians are used in order to derive a reduced model and their relation to dominant subspaces are pointed out. We also show an a posteriori error bound for the second approach involving two types of Hankel singular values.

math.NA

(Empirical) Gramian-based dimension reduction for stochastic differential equations driven by fractional Brownian motion

In this paper, we investigate large-scale linear systems driven by a fractional Brownian motion (fBm) with Hurst parameter $H\in [1/2, 1)$. We interpret these equations either in the sense of Young ($H>1/2$) or Stratonovich ($H=1/2$). Especially fractional Young differential equations are well suited for modeling real-world phenomena as they capture memory effects. Although it is very complex to solve them in high dimensions, model reduction schemes for Young or Stratonovich settings have not yet been studied much. To address this gap, we analyze important features of fundamental solutions associated to the underlying systems. We prove a weak type of semigroup property which is the foundation of studying system Gramians. From the introduced Gramians, dominant subspace can be identified which is shown in this paper as well. The difficulty for fractional drivers with $H>1/2$ is that there is no link of the corresponding Gramians to algebraic equations making the computation very difficult. Therefore, we further propose empirical Gramians that can be learned from simulation data. Subsequently, we introduce projection-based reduced order models (ROMs) using the dominant subspace information. We point out that such projections are not always optimal for Stratonovich equations as stability might not be preserved and since the error might be larger than expected. Therefore, an improved ROM is proposed for $H=1/2$. We validate our techniques conducting numerical experiments on some large-scale stochastic differential equations driven by fBm resulting from spatial discretizations of fractional stochastic PDEs. Overall, our study provides useful insights into the applicability and effectiveness of reduced order methods for stochastic systems with fractional noise, which can potentially aid in the development of more efficient computational strategies for practical applications.

math.NA

Exact dimension reduction for rough differential equations

In this paper, practically computable low-order approximations of potentially high-dimensional differential equations driven by geometric rough paths are proposed and investigated. In particular, equations are studied that cover the linear setting, but we allow for a certain type of dissipative nonlinearity in the drift as well. In a first step, a linear subspace is found that contains the solution space of the underlying rough differential equation (RDE). This subspace is associated to covariances of linear Ito-stochastic differential equations which is shown exploiting a Gronwall lemma for matrix differential equations. Orthogonal projections onto the identified subspace lead to a first exact reduced order system. Secondly, a linear map of the RDE solution (quantity of interest) is analyzed in terms of redundant information meaning that state variables are found that do not contribute to the quantity of interest. Once more, a link to Ito-stochastic differential equations is used. Removing such unnecessary information from the RDE provides a further dimension reduction without causing an error. Finally, we discretize a linear parabolic rough partial differential equation in space. The resulting large-order RDE is subsequently tackled with the exact reduction techniques studied in this paper. We illustrate the enormous complexity reduction potential in the corresponding numerical experiments.

math.NA

Complexity reduction of large-scale stochastic systems using linear quadratic Gaussian balancing

In this paper, we consider a model reduction technique for stabilizable and detectable stochastic systems. It is based on a pair of Gramians that we analyze in terms of well-posedness. Subsequently, dominant subspaces of the stochastic systems are identified exploiting these Gramians. An associated balancing related scheme is proposed that removes unimportant information from the stochastic dynamics in order to obtain a reduced system. We show that this reduced model preserves important features like stabilizability and detectability. Additionally, a comprehensive error analysis based on eigenvalues of the Gramian pair product is conducted. This provides an a-priori criterion for the reduction quality which we illustrate in numerical experiments.

math.OC

Model reduction for stochastic systems with nonlinear drift

In this paper, we study dimension reduction techniques for large-scale controlled stochastic differential equations (SDEs). The drift of the considered SDEs contains a polynomial term satisfying a one-sided growth condition. Such nonlinearities in high dimensional settings occur, e.g., when stochastic reaction diffusion equations are discretized in space. We provide a brief discussion around existence, uniqueness and stability of solutions. (Almost) stability then is the basis for new concepts of Gramians that we introduce and study in this work. With the help of these Gramians, dominant subspace are identified leading to a balancing related highly accurate reduced order SDE. We provide an algebraic error criterion and an error analysis of the propose model reduction schemes. The paper is concluded by applying our method to spatially discretized reaction diffusion equations.

math.PR

Solving high-dimensional optimal stopping problems using optimization based model order reduction

Solving optimal stopping problems by backward induction in high dimensions is often very complex since the computation of conditional expectations is required. Typically, such computations are based on regression, a method that suffers from the curse of dimensionality. Therefore, the objective of this paper is to establish dimension reduction schemes for large-scale asset price models and to solve related optimal stopping problems (e.g. Bermudan option pricing) in the reduced setting, where regression is feasible. The proposed algorithm is based on an error measure between linear stochastic differential equations. We establish optimality conditions for this error measure with respect to the reduce system coefficients and propose a particular method that satisfies these conditions up to a small deviation. We illustrate the benefit of our approach in several numerical experiments, in which Bermudan option prices are determined.

math.PR

Gramian-based model reduction for unstable stochastic systems

This paper considers large-scale linear stochastic systems representing, e.g., spatially discretized stochastic partial differential equations. Since asymptotic stability can often not be ensured in such a stochastic setting (e.g. due to larger noise), the main focus is on establishing model order reduction (MOR) schemes applicable to unstable systems. MOR is vital to reduce the dimension of the problem in order to lower the enormous computational complexity of for instance sampling methods in high dimensions. In particular, a new type of Gramian-based MOR approach is proposed in this paper that can be used in very general settings. The considered Gramians are constructed to identify dominant subspaces of the stochastic system as pointed out in this work. Moreover, they can be computed via Lyapunov equations. However, covariance information of the underlying systems enters these equations which is not directly available. Therefore, efficient sampling based methods relying on variance reduction techniques are established to derive the required covariances and hence the Gramians. Alternatively, an ansatz to compute the Gramians by deterministic approximations of covariance functions is investigated. An error bound for the studied MOR methods is proved yielding an a-priori criterion for the choice of the reduced system dimension. This bound is new and beneficial even in the deterministic case. The paper is concluded by numerical experiments showing the efficiency of the proposed MOR schemes.

math.NA

Model order reduction for bilinear systems with non-zero initial states -- different approaches with error bounds

In this paper, we consider model order reduction for bilinear systems with non-zero initial conditions. We discuss choices of Gramians for both the homogeneous and the inhomogeneous parts of the system individually and prove how these Gramians characterize the respective dominant subspaces of each of the two subsystems. Proposing different, not necessarily structure preserving, reduced order methods for each subsystem, we establish several strategies to reduce the dimension of the full system. For all these approaches, error bounds are shown depending on the truncated Hankel singular values of the subsystems. Besides the error analysis, stability is discussed. In particular, a focus is on a new criterion for the homogeneous subsystem guaranteeing the existence of the associated Gramians and an asymptotically stable realization of the system.

math.NA

Full state approximation by Galerkin projection reduced order models for stochastic and bilinear systems

In this paper, the problem of full state approximation by model reduction is studied for stochastic and bilinear systems. Our proposed approach relies on identifying the dominant subspaces based on the reachability Gramian of a system. Once the desired subspace is computed, the reduced order model is then obtained by a Galerkin projection. We prove that, in the stochastic case, this approach either preserves mean square asymptotic stability or leads to reduced models whose minimal realization is mean square asymptotically stable. This stability preservation guarantees the existence of the reduced system reachability Gramian which is the basis for the full state error bounds that we derive. This error bound depends on the neglected eigenvalues of the reachability Gramian and hence shows that these values are a good indicator for the expected error in the dimension reduction procedure. Subsequently, we establish the stability preservation result and the error bound for a full state approximation to bilinear systems in a similar manner. These latter results are based on a recently proved link between stochastic and bilinear systems. We conclude the paper by numerical experiments using a benchmark problem. We compare this approach with balanced truncation and show that it performs well in reproducing the full state of the system. \end{abstract}

math.NA

Optimization based model order reduction for stochastic systems

In this paper, we bring together the worlds of model order reduction for stochastic linear systems and $\mathcal H_2$-optimal model order reduction for deterministic systems. In particular, we supplement and complete the theory of error bounds for model order reduction of stochastic differential equations. With these error bounds, we establish a link between the output error for stochastic systems (with additive and multiplicative noise) and modified versions of the $\mathcal H_2$-norm for both linear and bilinear deterministic systems. When deriving the respective optimality conditions for minimizing the error bounds, we see that model order reduction techniques related to iterative rational Krylov algorithms (IRKA) are very natural and effective methods for reducing the dimension of large-scale stochastic systems with additive and/or multiplicative noise. We apply modified versions of (linear and bilinear) IRKA to stochastic linear systems and show their efficiency in numerical experiments.

math.NA

Runge-Kutta methods for rough differential equations

We study Runge-Kutta methods for rough differential equations which can be used to calculate solutions to stochastic differential equations driven by processes that are rougher than a Brownian motion. We use a Taylor series representation (B-series) for both the numerical scheme and the solution of the rough differential equation in order to determine conditions that guarantee the desired order of the local error for the underlying Runge-Kutta method. Subsequently, we prove the order of the global error given the local rate. In addition, we simplify the numerical approximation by introducing a Runge-Kutta scheme that is based on the increments of the driver of the rough differential equation. This simplified method can be easily implemented and is computational cheap since it is derivative-free. We provide a full characterization of this implementable Runge-Kutta method meaning that we provide necessary and sufficient algebraic conditions for an optimal order of convergence in case that the driver, e.g., is a fractional Brownian motion with Hurst index $\frac{1}{4} < H \leq \frac{1}{2}$. We conclude this paper by conducting numerical experiments verifying the theoretical rate of convergence.

math.NA

Low-dimensional approximations of high-dimensional asset price models

We consider high-dimensional asset price models that are reduced in their dimension in order to reduce the complexity of the problem or the effect of the curse of dimensionality in the context of option pricing. We apply model order reduction (MOR) to obtain a reduced system. MOR has been previously studied for asymptotically stable controlled stochastic systems with zero initial conditions. However, stochastic differential equations modeling price processes are uncontrolled, have non-zero initial states and are often unstable. Therefore, we extend MOR schemes and combine ideas of techniques known for deterministic systems. This leads to a method providing a good pathwise approximation. After explaining the reduction procedure, the error of the approximation is analyzed and the performance of the algorithm is shown conducting several numerical experiments. Within the numerics section, the benefit of the algorithm in the context of option pricing is pointed out.

math.PR

Error bounds for model reduction of feedback-controlled linear stochastic dynamics on Hilbert spaces

We analyze structure-preserving model order reduction methods for Ornstein-Uhlenbeck processes and linear S(P)DEs with multiplicative noise based on balanced truncation. For the first time, we include in this study the analysis of non-zero initial conditions. We moreover allow for feedback-controlled dynamics for solving stochastic optimal control problems with reduced-order models and prove novel error bounds for a class of linear quadratic regulator problems. We provide numerical evidence for the bounds and discuss the application of our approach to enhanced sampling methods from non-equilibrium statistical mechanics.

math.OC

Bilinear systems -- A new link to $\mathcal H_2$-norms, relations to stochastic systems and further properties

In this paper, we prove several new results that give new insights into bilinear systems. We discuss conditions for asymptotic stability using probabilistic arguments. Moreover, we provide a global characterization of reachability in bilinear systems based on a certain Gramian. Reachability energy estimates using the same Gramian have only been local so far. The main result of this paper, however, is a new link between the output error and the $\mathcal H_2$-error of two bilinear systems. This result has several consequences in the field of model order reduction. It explains why $\mathcal H_2$-optimal model order reduction leads to good approximations in terms of the output error. Moreover, output errors based on the $\mathcal H_2$-norm can now be proved for balancing related model order reduction schemes in this paper. All these new results are based on a Gronwall lemma for matrix differential equations that is established here.

math.NA