arXiv Science⌕ Search

arXiv subjects

Philipp Braun

Publications and source records attributed to Philipp Braun.

At least 19 recordsLinked to original sources

Bandit Online Submodular Minimisation Using Zeroth-Order Oracles

We consider online submodular minimisation under bandit feedback, where at each round a decision maker plays a subset and observes only its cost, while the cost functions, and hence their minimiser, change over time. Existing bandit methods only guarantee static regret, which compares against a single fixed subset and is a weak benchmark when the minimiser moves. This paper provides, to the best of our knowledge, the first method with guarantees for tracking a moving minimiser in this setting. We propose a zeroth-order method built on a two-point oracle for the Lovász extension whose two evaluations are both subsets that can be played. The perturbed and base points are rounded by a common random threshold, and drawing the smoothing direction from the unit sphere makes the base evaluation a zero-mean control variate, so the oracle is an unbiased estimator of the smoothed gradient. We establish dynamic regret bounds of order $O\big((1+\sqrt{P^\ast_N})N^{3/4}\big)$ in general and $O\big((1+\sqrt{P^\ast_N})N^{2/3}\big)$ under a sufficiently small drift, where $P^\ast_N$ is the path length of the minimiser sequence, together with the corresponding $O(N^{3/4})$ and $O(N^{2/3})$ static regret bounds. Numerically, the method attains lower regret than the algorithm of (Hazan and Kale (2012)), with the advantage growing with the path length.

stat.ML↗

On the Stability Connection Between Discrete-Time Algorithms and Their Resolution ODEs: Applications to Min-Max Optimisation

We establish a connection between the stability of discrete-time algorithms (DTAs) and continuous-time dynamical systems, in particular their $O(s^r)$-resolution ordinary differential equations (ODEs). We show that exponential stability of a common equilibrium transfers to the DTA whenever the one-step error is small relative to the distance to the equilibrium and the one-step Lyapunov decay. This condition is sharp in order, and one-step consistency alone is insufficient. The result is local and allows step-size-dependent ODEs and Lyapunov functions, covering $O(s)$-resolution ODEs whose decay rate vanishes as the step size tends to zero. Asymptotic stability is not inherited in general, but a comparison criterion and a checkable compatibility condition ensure it carries over for equilibria and compact sets. For resolution ODEs, joint regularity of the update map guarantees the required error bound. We apply the framework to two-timescale gradient descent ascent (TT-GDA), generalised extragradient, two-timescale proximal point, and (regularised) damped Newton, showing that for small step sizes and suitable parameters, every saddle point with invertible Hessian is locally exponentially stable for all but TT-GDA. For degenerate saddle points, the framework yields asymptotic stability and convergence rates.

math.OC↗

Spherical-Design Oracles for Zeroth-Order Optimisation: Deterministic, Variance-Free Gradient Estimation

In this work, we develop a zeroth-order (ZO) method that estimates the gradient with minimal bias and variance. Instead of the random directions often used in the ZO literature, we consider central differences with directions given by a fixed spherical $t$-design, a finite point set that integrates every polynomial of degree at most $t$ exactly. The oracle is deterministic and thus does not induce any variance.We also propose a general finite difference method in the higher-order-smoothness regime and show the bias of both finite difference methods. We then show the convergence of the proposed ZO method via the input-to-state stability concept. Numerical experiments show the superiority of our proposed method over the existing random ZO methods.

math.OC↗

Solving the Offline and Online Min-Max Problem of Non-smooth Submodular-Concave Functions: A Zeroth-Order Approach

We consider max-min and min-max problems with objective functions that are possibly non-smooth, submodular with respect to the minimiser and concave with respect to the maximiser. We investigate the performance of a zeroth-order method applied to this problem. The method is based on the subgradient of the Lovász extension of the objective function with respect to the minimiser and based on Gaussian smoothing to estimate the smoothed function gradient with respect to the maximiser. In expectation sense, we prove the convergence of the algorithm to an $ε$-saddle point in the offline case. Moreover, we show that, in the expectation sense, in the online setting, the algorithm achieves $O(\sqrt{N(1+\bar{P}_N)})$ online duality gap, where $N$ is the number of iterations and $\bar{P}_N$ is the path length of the sequence of optimal decisions. The complexity analysis and hyperparameter selection are presented for all the cases. The theoretical results are illustrated via numerical examples.

math.OC↗

Predicting the Elastic Properties of a Cemented Granular Material during Chemical Damage (Debonding)

While underground reservoirs emerge as essential elements to face global warming, these systems represent complex multi-physical and multiscale problems. The considered injection of fluids during hydrogen storage, carbon dioxide sequestration, or geothermal energy recovery involves a modification of the chemical equilibrium of the fluid in the porous reservoir. Chemical reactions can induce microstructural changes of the rock matrix, leading to a reduction of elastic properties of the material, and to potential settlement or stress redistribution. Consequently, it becomes pivotal to establish predictive behavior laws to describe the effect of chemical damage on elastic properties. Facing the difficulties to estimate experimentally the impact of chemical damage on mechanical properties, a Digital Rock Physics approach is proposed in this contribution. This numerical homogenization scheme is used to compare two distinct types of microstructure models: the first one consists in a Discrete Element Model, while the second one employs a continuous description. This continuous formulation is based on a Phase-Field description to predict the evolution of the microstructure subjected to chemical alterations and on the Fast Fourier Transform to estimate the macroscopic properties of the material. Finally, these frameworks establish different softening laws that can be used as constitutive ingredients for a cemented material during its weathering.

physics.geo-ph↗

Semi-Explicit Solutions to the Prying-Pedestrian Surveillance-Evasion Differential Game and Extensions to Two Pursuers

In [1], the authors recently proposed and solved a surveillance-evasion differential game in which an agile pursuer (the prying pedestrian) seeks to remain within a given surveillance range of a less agile evader for as long as possible while the evader seeks to escape as quickly as possible. In this paper, we provide initial results that extend this game from the 1 versus 1 (1v1) setting to a 2 versus 1 (2v1) setting with two pursuers and one evader. By deriving and exploiting semi-explicit or geometric reinterpretations of the existing 1v1 results, we derive partial solutions to the 2v1 game for the case of static pursuers and for the case of an evader that is at least twice as fast as the pursuers. While the 2v1 results of this paper build on the 1v1 results of [1], a different solution approach is developed to avoid a coordinate transformation that reduces the 1v1 game to two dimensions but which is ineffective at simplifying the 2v1 game. Beyond enabling progress on the 2v1 game, our new approach yields new geometric interpretations of the optimal pursuer and evader strategies in the 1v1 game, and opens further possible extensions.

eess.SY↗

Minimisation of Quasar-Convex Functions Using Random Zeroth-Order Oracles

This paper explores the performance of a random Gaussian smoothing zeroth-order (ZO) scheme for minimising quasar-convex (QC) and strongly quasar-convex (SQC) functions in both unconstrained and constrained settings. For the unconstrained problem, we establish the ZO algorithm's convergence to a global minimum along with its complexity when applied to both QC and SQC functions. For the constrained problem, we introduce the new notion of proximal-quasar-convexity and prove analogous results to the unconstrained case. Specifically, we derive complexity bounds and prove convergence of the algorithm to a neighbourhood of a global minimum whose size can be controlled under a variance reduction scheme. Beyond the theoretical guarantees, we demonstrate the practical implications of our results on several machine learning problems where quasar-convexity naturally arises, including linear dynamical system identification and generalised linear models.

math.OC↗

From open-loop representations to closed-loop feedback implementations in differential games: A numerical case study

Solutions to pursuit-evasion and surveillance-evasion differential games are typically computed and expressed using open-loop representations, with the synthesis of feedback strategies significantly less common. We propose a numerical scheme for obtaining feedback strategies for the recently introduced prying-pedestrian surveillance-evasion differential game. The scheme involves computing feedback strategies as input-output maps approximated via neural networks trained using data obtained from open-loop representations of solutions. Simulations show the effectiveness of neural networks trained with an appropriate learning-loss function. Since optimal feedback strategies are discontinuous, as a second contribution, the potential loss/gain of individual players is subsequently studied for players using sample-and-hold feedback compared to continuous-time feedback.

eess.SY↗

From Cursed to Competitive: Closing the ZO-FO Gap via Input-to-State Stability

While it is generally understood that zeroth-order (ZO) algorithms have an extra dependency on their number of iterations for any choice of parameters, compared to their first-order (FO) counterparts, in this work, we show that under several conditions, in expectation, ZO methods do not suffer from extra dimension dependencies in their convergence rates with respect to their FO counterparts. We look at optimisation algorithms from the dynamical systems perspective and analyse the conditions under which one can formulate the average of a ZO algorithm as the average of its FO counterpart with bounded perturbations with values dependent on design parameters. Then, using input-to-state stability properties, we show ZO methods follow the same decay rate as their FO counterparts and converge to a neighbourhood of the fixed point of FO methods, where its radius depends on the bound of the norm of the perturbations, which can be made arbitrarily small. The theoretical findings are illustrated via numerical examples.

math.OC↗

Symmetry Is Almost All You Need: Robust Stability with Uncertainty Induced by Symmetric SRG Regions

This paper investigates the robust stability problem of a feedback system in the presence of uncertainties induced by graphical regions in the plane where the scaled relative graphs (SRGs) reside. Our main results are developed using a novel and intuitive concept, the Davis-Wielandt shell, together with its connection to SRGs and related variants. We first study a matrix robust nonsingularity (MRN) problem for two types of graphically induced uncertainty sets: one with prior information on $θ$ and one without. In the former case, we show that, whenever the uncertainty-inducing region is mirror symmetric about the $θ$-axis, the separation between a specific variant of the SRG and the region provides a necessary and sufficient condition for MRN. When the region is asymmetric, the necessity generally fails. This recovers the necessity of the small gain condition, and reveals the necessity of small angle conditions and sectored-disc conditions at the matrix level. In the latter case, we show that an additional $θ$-circular connectivity property is required to obtain necessary and sufficient conditions. Building on these MRN results, we then derive sufficient conditions for robust stability of multi-input multi-output (MIMO) linear time-invariant (LTI) systems under frequencywise symmetric uncertainties. In addition, connections with existing system characteristics such as disc-boundedness are discussed and exploited to obtain state-space characterisations for angle-bounded and mixed gain-angle-bounded systems. Based on these results, we construct a $θ$-angle-gain profile of a system that provides an intuitive visualisation of its feedback robustness against conic and sectorial uncertainties.

eess.SY↗

Minimisation of Submodular Functions Using Gaussian Zeroth-Order Random Oracles

We consider the minimisation problem of submodular functions and investigate the application of a zeroth-order method to this problem. The method is based on exploiting a Gaussian smoothing random oracle to estimate the smoothed function gradient. We prove the convergence of the algorithm to a global $ε$-approximate solution in the offline case and show that the algorithm is Hannan-consistent in the online case with respect to static regret. Moreover, we show that the algorithm achieves $O(\sqrt{NP_N^\ast})$ dynamic regret, where $N$ is the number of iterations and $P_N^\ast$ is the path length. The complexity analysis and hyperparameter selection are presented for all the cases. The theoretical results are illustrated via numerical examples.

math.OC↗

Min-Max Optimisation for Nonconvex-Nonconcave Functions Using a Random Zeroth-Order Extragradient Algorithm

This study explores the performance of the random Gaussian smoothing Zeroth-Order ExtraGradient (ZO-EG) scheme considering \Af{deterministic} min-max optimisation problems with possibly NonConvex-NonConcave (NC-NC) objective functions. We consider both unconstrained and constrained, differentiable and non-differentiable settings. We discuss the min-max problem from the point of view of variational inequalities. For the unconstrained problem, we establish the convergence of the ZO-EG algorithm to the neighbourhood of an $ε$-stationary point of the NC-NC objective function, whose radius can be controlled under a variance reduction scheme, along with its complexity. For the constrained problem, we introduce the new notion of proximal variational inequalities and give examples of functions satisfying this property. Moreover, we prove analogous results to the unconstrained case for the constrained problem. For the non-differentiable case, we prove the convergence of the ZO-EG algorithm to a neighbourhood of an $ε$-stationary point of the smoothed version of the objective function, where the radius of the neighbourhood can be controlled, which can be related to the ($δ,ε$)-Goldstein stationary point of the original objective function.

math.OC↗

Properties of Fixed Points of Generalised Extra Gradient Methods Applied to Min-Max Problems

This paper studies properties of fixed points of generalised Extra-gradient (GEG) algorithms applied to min-max problems. We discuss connections between saddle points of the objective function of the min-max problem and GEG fixed points. We show that, under appropriate step-size selections, the set of saddle points (Nash equilibria) is a subset of stable fixed points of GEG. Convergence properties of the GEG algorithm are obtained through a stability analysis of a discrete-time dynamical system. The results and benefits when compared to existing methods are illustrated through numerical examples.

math.OC↗

MAGO-SP: Detection and Correction of Water-Fat Swaps in Magnitude-Only VIBE MRI

Volume Interpolated Breath-Hold Examination (VIBE) MRI generates images suitable for water and fat signal composition estimation. While the two-point VIBE provides water-fat-separated images, the six-point VIBE allows estimation of the effective transversal relaxation rate R2* and the proton density fat fraction (PDFF), which are imaging markers for health and disease. Ambiguity during signal reconstruction can lead to water-fat swaps. This shortcoming challenges the application of VIBE-MRI for automated PDFF analyses of large-scale clinical data and of population studies. This study develops an automated pipeline to detect and correct water-fat swaps in non-contrast-enhanced VIBE images. Our three-step pipeline begins with training a segmentation network to classify volumes as "fat-like" or "water-like," using synthetic water-fat swaps generated by merging fat and water volumes with Perlin noise. Next, a denoising diffusion image-to-image network predicts water volumes as signal priors for correction. Finally, we integrate this prior into a physics-constrained model to recover accurate water and fat signals. Our approach achieves a < 1% error rate in water-fat swap detection for a 6-point VIBE. Notably, swaps disproportionately affect individuals in the Underweight and Class 3 Obesity BMI categories. Our correction algorithm ensures accurate solution selection in chemical phase MRIs, enabling reliable PDFF estimation. This forms a solid technical foundation for automated large-scale population imaging analysis.

cs.CV↗

Lyapunov based dynamic controller designs for reach-and-avoid problems

Safe obstacle avoidance and target set stabilization for nonlinear systems using reactive feedback control is under consideration. Based only on local information and by considering virtual dynamics, a safe path is generated online. The control law for the virtual dynamics is combined with a feedback controller for the dynamics of interest, where Lyapunov arguments and forward invariance are used to ensure that the state of the system remains in a vicinity of the path. To allow for discrete decisions in the avoidance controller design, the closed-loop dynamics are formulated using the hybrid systems framework. The results are illustrated by a numerical example for unicycle dynamics.

eess.SY↗

Prying Pedestrian Surveillance-Evasion: Minimum-Time Evasion from an Agile Pursuer

A new surveillance-evasion differential game is posed and solved in which an agile pursuer (the prying pedestrian) seeks to remain within a given surveillance range of a less agile evader that aims to escape. In contrast to previous surveillance-evasion games, the pursuer is agile in the sense of being able to instantaneously change the direction of its velocity vector, whilst the evader is constrained to have a finite maximum turn rate. Both the game of kind concerned with conditions under which the evader can escape, and the game of degree concerned with the evader seeking to minimize the escape time whilst the pursuer seeks to maximize it, are considered. The game-of-degree solution is surprisingly complex compared to solutions to analogous pursuit-evasion games with an agile pursuer since it exhibits dependence on the ratio of the pursuer's speed to the evader's speed. It is, however, surprisingly simple compared to solutions to classic surveillance-evasion games with a turn-limited pursuer.

eess.SY↗

Inducing tensile failure of claystone through thermal pressurization in a novel triaxial device

Complex coupled thermo-hydromechanical (THM) loading paths are expected to occur in clay rocks which serve as host formations for geological radioactive waste repositories. Exothermic waste packages heat the rock, causing thermal strains and temperature induced pore pressure build-up. The drifts are designed in such a way as to limit these effects. One has to anticipate failure and fracturing of the material, should pore pressures exceed the tensile resistance of the rock. To characterise the behaviour of the Callovo-Oxfordian claystone (COx) under effective tension and to quantify the tensile failure criterion, a laboratory program is carried out in this work. THM loading paths which correspond to the expected in situ conditions are recreated in the laboratory. To this end, a special triaxial system was developed, which allows the independent control of radial and axial stresses, as well as of pore pressure and temperature of rock specimens. More importantly, the device allows one to maintain axial effective tension on a specimen. Saturated cylindrical claystone specimens were tested in undrained conditions under constrained lateral deformation and under nearly constant axial stress. The specimens were heated until the induced pore pressures created effective tensile stresses and ultimately fractured the material. The failure happened at average axial effective tensile stresses around 3.0 MPa. Fracturing under different lateral total stresses allows one to describe the failure with a Hoek-Brown or Fairhurst's generalized Griffith criterion. Measured axial extension strains are analysed based on a transversely isotropic thermo-poroelastic constitutive model, which is able to satisfactorily reproduce the observed behaviour.

physics.geo-ph↗

Transversely isotropic poroelastic behaviour of the Callovo-Oxfordian claystone: A set of stress-dependent parameters

In the framework of a deep geological radioactive waste disposal in France, the hydromechanical properties of the designated host rock, the Callovo-Oxfordian claystone (COx), are investigated in laboratory tests. Experiments presented in this study are carried out to determine several coefficients required within a transversely isotropic material model. They include isotropic compression tests, pore pressure tests, and deviatoric loading tests parallel and perpendicular to the bedding plane. We emphasize the adapted experimental devices and testing procedures, necessary to detect small strains under high pressures, on a material, which is sensitive to water and has a very low permeability. In particular, we discovered a significant decrease of elastic stiffness with decreasing effective stress, which was observed to be reversible. In both isotropic and deviatoric tests, a notable anisotropic strain response was found. The Young modulus parallel to bedding was about 1.8 times higher than the one perpendicular to the bedding plane. A notably low Poisson ratio perpendicular to the bedding plane with values between 0.1 and 0.2 was evidenced. While the anisotropy of the back-calculated Biot coefficient was found to be low, a significant anisotropy of the Skempton coefficient was computed. The performed experiments provide an overdetermined set of material parameters at different stress levels. Using all determined parameters in a least square error regression scheme, seven independent elastic coefficients and their effective stress dependency are characterized. Parameters measured under isotropic loading are well represented by this set of coefficients, while the poroelastic framework with isotropic stress dependency is not sufficient to describe laboratory findings from triaxial loading.

physics.geo-ph↗