arXiv subjects

Stefan Streif

Publications and source records attributed to Stefan Streif.

At least 19 recordsLinked to original sources

arXiv2026

Global Parameter Identification and Uncertainty Quantification of reduced-order ADM1 using Maximum Likelihood Estimation and Bayesian Inference

Anaerobic digestion (AD) models can be challenging to calibrate against real data due to limited practical identifiability, data scarcity, and model complexity. Weighted least squares objective functions and gradient-based solvers using finite differences are often used in literature, but result in suboptimal parameter estimates and large uncertainty bands. This paper identifies the parameters of a reduced-order ADM1 by comparing the frameworks of maximum likelihood estimation (MLE) and Bayesian inference (BI), and quantifies uncertainties of parameters and outputs. Multirate experimental data are taken from a lab-scale AD reactor fed with agricultural substrates and operated at organic loading rates of 3$\,$g VS $\mathrm{m^{-3}d^{-1}}$. Global optima are found via global and gradient-based local search algorithms using forward sensitivities. Enhanced scatter search provides the best global search results. These are refined by the Gauss-Newton algorithm as the best local search, which delivers $R^2$ values of 0.95 for acetic acid and 0.77 for biogas production. BI yields substantially narrower uncertainty bands than MLE and avoids the need for a global search by incorporating prior knowledge about parameter distributions. The search space is captured efficiently by log10 scaling of parameters. Algorithmic details on its implications are provided. Despite a high-resolution lab-scale dataset, the ADM1-specific inhibition parameter $K_\mathrm{I,nh3}$ is practically not identifiable with MLE, and shows a low output sensitivity, whereas a parameter for the effective ion concentration shows superb practical identifiabilty at high confidence with both MLE and BI. The present work lays a scalable base for calibration of nonlinear AD models by providing reliable simulations. It thus advances model-based monitoring and control applications of multirate processes such as agricultural AD plants.

eess.SY↗

arXiv2026

Metabolic heat and moisture reuse with climate-adaptive control for energy-efficient black soldier fly bioconversion in modular container farms

Black soldier fly larvae (BSFL, Hermetia illucens) convert organic residues into feed ingredients and fertiliser. Climate control is a major contributor to the energy demand of container-based bioconversion. We developed a control-oriented dynamic model linking larval growth, substrate dynamics and container climate to heating, ventilation and air conditioning (HVAC). A two-level Model Predictive Control (MPC) strategy planned climate trajectories and tracked them through HVAC actuation. Four simulation studies examined controller selection, HVAC configuration, larval age pairing and inter-container coupling, using subsets of eight climate scenarios. Across the four scenarios tested for controller selection, dynamic MPC reduced specific energy consumption (SEC) by 31 to 61% and increased predicted dry biomass at harvest by up to 27.5% relative to single fixed setpoints. Under the tested controller settings, active cooling was required in the two hot scenarios, whereas dehumidification provided no additional operational benefit. Pairing larval ages four days apart within one container reduced SEC by up to 33% in the tested non-hot scenarios. In the Cooldry scenario, two age-separated containers connected by an actuated air duct produced 9.0% more biomass and achieved 3.9% lower SEC than two independent containers with mixed ages, despite using 4.6% more total HVAC energy. The simulations suggest that dynamic climate control and metabolic heat and moisture reuse can improve the energy intensity of BSFL bioconversion. The quantitative estimates and hardware recommendations require experimental validation before application to industrial facilities.

eess.SY↗

arXiv2026

Ground-Truth-First Benchmarking of Reinforcement Learning via Converse Optimality: From Smooth, Fully Observed Systems to Non-Smooth or Partially Observed Tasks

Benchmarking in reinforcement learning is usually relative: algorithms are ranked by returns on environments with unknown optima. Distance to optimality remains unobservable, while conclusions may depend on reward design, stochasticity, hyperparameters, environment selection, and simulator details. We develop a ground-truth-first framework based on converse optimality, constructing each task with a certified optimal value function and policy withheld from learners and used only for evaluation. The framework unifies two modes: sensitivity benchmarking samples certified environments from continuous-time generators to assess robustness to task variation, while oracle-referenced comparison uses native discrete-time generators to evaluate policies via optimality gap, regret, and policy error. Continuous-time models support physically interpretable sensitivity studies but introduce dependence on the simulator step ($Δt$) and numerical scheme. Native discrete-time models align the environment, oracle, and learner on the same transition law, eliminating external integration choices as a confounder. We reproduce quantitative results covering optimizer sensitivity and oracle-referenced comparisons on serial planar arms, dynamically extended nonholonomic vehicles, and quadrotor-inspired tasks. The methodology extends beyond smooth affine Gaussian systems: virtual-input pullback handles non-affine raw-action interfaces and finite-covariance non-Gaussian disturbances. A non-smooth converse optimality formulation enables certified benchmarks with kinked value functions and switching surfaces. For partially observed evaluation, an information-state formulation reduces benchmarking to converse optimality on a sufficient statistic and provides an information-penalty reference. Code, fixtures, and diagnostics are available on the public project page.

cs.LG↗

arXiv2026

Structural Baselines Matter for Agent Failure Detection and Attribution

An LLM agent using tools can fail silently. It stops before the task is done, raises no error, and answers fluently. Two kinds of monitor address this, one deciding whether a run failed and the other naming the step where failure became unavoidable. Much of the reported performance on both tasks comes from regularities that need no model. Failing runs are longer, and the step labelled decisive is usually the last. A rule that always names the last step is correct $67\%$ to $96\%$ of the time here, without reading the run at all. That ceiling reflects how the labels were written, not how agents break. On failures whose decisive step replay can confirm, it falls to near chance. Reporting gain over that rule therefore changes what a score means. Under that correction, methods tested here gain nothing on give-up failures, while several published systems keep a clear advantage on other splits. For detection, the agent's internal states beat transcript length and text similarity on the agent benchmark, and hold up where the text baseline does not. Precision stays low when failures are rare, so such a monitor should rank runs for review, not replace it.

cs.AI↗

arXiv2026

Adaptive dynamic programming using Lyapunov function constraints

This work is concerned with a stabilizing adaptive dynamic programming (ADP) approach to approximate solution of a given infinite-horizon optimal control problem. Since the latter problem cannot, in general, be solved exactly, a parametrized function approximator for the infinite-horizon cost function is introduced in ADP (so called ``critic''). This critic is used to adapt the parameters of the function approximator. The so called ``actor'' in turn derives the optimal input of the system. It is a notoriously hard problem to guarantee closed-loop stability of ADP due to the use of approximation structures in the control scheme. Since at least stabilizability is always assumed in the analyses of ADP, it is justified to invoke a respective Lyapunov function. The proposed ADP scheme explicitly uses the said Lyapunov function to simultaneously optimize the critic and guarantee closed-loop stability. A Hessian-free optimization routine is utilized for the actor and critic optimization problems. Convergence to prescribed vicinities of the optima is shown. A computational study showed significant performance improvement for the critic-based approach compared a nominal stabilizing controller for a range of initial conditions.

math.OC↗

arXiv2026

Real-Valued Hyperdimensional Sequence Representations with Hadamard Product Binding and Shift Equivariance

Encoding temporal order is a fundamental requirement for sequence representations in Hyperdimensional Computing. Fractional Power Encoding provides similarity-preserving position vectors whose inner products approximate shift-invariant kernels, and it supports shift-equivariant transformations of encoded sequence representations. However, standard formulations of Fractional Power Encoding are primarily designed for binding operations such as circular convolution or complex-valued multiplication, which limits their compatibility with Hadamard product binding of real-valued vectors. This paper develops real-valued position encodings motivated by Random Fourier Features, aiming to retain the desirable properties of Fractional Power Encoding while supporting Hadamard-based operations. We propose three real-valued position-encoding variants: a real-valued baseline based on the inverse Fourier transform, and Sinusoid and Cosine-only representations derived from Random Fourier Features. Among them, the Sinusoid variant provides an explicit algebraic shift operator, allowing temporal shifts to be applied directly to the vector-encoded sequence representation without re-encoding the shifted sequence. Experiments on time-series classification datasets show that the proposed real-valued representations achieve performance comparable to standard Fractional Power Encoding while enabling computationally efficient Hadamard product binding. The Sinusoid variant offers the most favorable trade-off, combining efficient real-valued implementation with exact shift-equivariant transformations.

cs.AI↗

arXiv2026

A constraint dissolving inexact penalty method for optimization problems with geometric constraints

Optimization problems with geometric constraints have a broad range of applications, including machine learning, finance, and control. A powerful algorithmic tool to resolve these geometric constraints are constraint dissolving methods. To this end, we propose a framework for constraint dissolving mappings for nonconvex geometric constraints. Leveraging these, we develop a constraint dissolving inexact penalty method to solve optimization problems with general set-membership constraints and possibly nonconvex geometric constraints. We establish the convergence of the proposed algorithm and prove that every feasible accumulation point is Mordukhovich stationary. Notably, we rely only on mild asymptotic Mordukhovich regularity, which is significantly weaker than the constraint qualifications adopted in the existing literature on constraint dissolving methods. Numerical experiments addressing classical equality-, complementarity-, sparsity-, and low-rank constrained optimization problems demonstrate that the proposed method is competitive with the safeguarded augmented Lagrangian method in terms of solution quality and significantly outperforms the penalty decomposition method.

math.OC↗

arXiv2026

Polytopic Inner Approximation of Admissible Sets for Linear Systems

This paper presents a method for computing inner polytopic approximations of admissible sets for continuous-time linear control systems subject to multiple affine state constraints, with a particular concern on computational tractability for large dimensional problems. In place of globally computing the admissible set and the part of its boundary called the barrier, we compute the so-called individual admissible sets and the corresponding barriers for each single constraint. We then use the exact sampling of linear systems and generate polytopes in half-space representation that provide an approximation of the individual admissible sets, to finally intersect them. We provide a complexity analysis of the whole procedure to evaluate its efficiency. The approach is illustrated by two examples -a triple integrator and a mass-spring-damper chain considered in 4, 6, 8, and 10 dimensions- with corresponding runtimes evaluated for both.

math.OC↗

arXiv2026

On the Boundary of the Robust Admissible Set in State and Input Constrained Nonlinear Systems

In this paper, we consider nonlinear control systems subject to bounded disturbances and to both state and input constraints. We introduce the definition of robust admissible set - the set of all initial states from which the state and input constraints can be satisfied for all times against all admissible disturbances. We focus on its boundary that can be decomposed into the usable part on the state constraint boundary and the barrier, interior to the state constraints. We show that, at the intersection of these two components, the boundary of the robust admissible set must be tangent to the state constraint set and separate the interior of the robust admissible set and its complement, a property that we call the ultimate locally separating hyperplane condition. Moreover, we prove that the barrier must satisfy a saddle-point principle on a Hamiltonian, based on Pontryagin's maximum principle, whose final condition is precisely the ultimate locally separating condition, thus providing a set of differential equations made of the system and its adjoint for a direct construction of the barrier. Lastly, we illustrate our results by calculating the robust admissible set for an adaptive cruise control example.

math.OC↗

arXiv2026

Hierarchical Causal Abduction: A Foundation Framework for Explainable Model Predictive Control

Model Predictive Control (MPC) is widely used to operate safety-critical infrastructure by predicting future trajectories and optimizing control actions. However, nonlinear dynamics, hard safety constraints, and numerical optimization often render individual control moves opaque to human operators, undermining trust and hindering deployment. This paper presents Hierarchical Causal Abduction (HCA), which combines (i) physics-informed reasoning via domain knowledge graphs, (ii) optimization evidence from Karush--Kuhn--Tucker (KKT) multipliers, and (iii) temporal causal discovery via the PCMCI algorithm to generate faithful, human-interpretable explanations for control actions computed by nonlinear MPC. Across three diverse control applications (greenhouse climate, building HVAC, chemical process engineering) with expert validation, HCA improves explanation accuracy by 53\% over LIME (0.478 vs. 0.311) using a single set of cross-domain parameters without per-domain tuning; domain-specific KKT-threshold calibration over 2--3 days further increases accuracy to 0.88. Ablation studies confirm that each evidence source is essential, with 32--37\% accuracy degradation when any component is removed, and HCA's ranking-and-validation methodology generalizes beyond MPC to other prediction-based decision systems, including learning-based control and trajectory planning.

cs.AI↗

arXiv2026

Time-varying optimal control under measurement errors

Solving optimal control problems to determine a stabilizing controller involves a significant computational effort. Time-varying optimal control provides a remedy by designing a tracking system, given as an ordinary differential equation, to track the solution of the optimal control problem. To improve the applicability of the method, measurement errors are considered in this paper and it is described how these errors influence a control Lyapunov function-based decay condition. As a result of these investigations, input-affine constraints that meet the standard formulation and that describe the set of admissible controls are obtained. The paper also derives a requirement on the necessary measurement accuracy as well as a triggering condition for taking a new measurement. The main theorem combines these results into a robustly stabilizing control algorithm, meaning that all closed-loop trajectories starting in a vicinity around the true state converge to zero. Additionally, the tracking system ensures that the optimal control is tracked at the end of each sampling period. The effectiveness of this approach is demonstrated using a train acceleration model and the well-known predator-prey model.

eess.SY↗

arXiv2026

A Tutorial to Multirate Extended Kalman Filter Design for Monitoring of Agricultural Anaerobic Digestion Plants

In many applications of biotechnology, measurements are available at different sampling rates, e.g., due to online sensors and offline lab analysis. Offline measurements typically involve time delays that may be unknown a priori due to the underlying laboratory procedures. This multirate (MR) setting poses a challenge to Kalman filtering, where conventionally measurement data is assumed to be available on an equidistant time grid and without delays. This tutorial paper derives the MR version of an extended Kalman filter (EKF) based on sample state augmentation, and applies it to the anaerobic digestion (AD) process in a simulative agricultural setting. The performance of the MR-EKF is investigated for various scenarios including varying delay lengths, measurement noise levels, plant-model mismatch (PMM), and initial state error. Provided with an adequate tuning, the MR-EKF can reliably estimate the process state and, thus, appropriately fuse the delayed offline measurements and smooth the noisy online measurements. Because of the sample state augmentation approach, the delay length of offline measurements does not critically effect the performance of the state estimation, provided that observability is not lost during the delays. Poor state initialization and PMM affect convergence more than measurement noise levels. Furthermore, selecting an appropriate tuning was found to be critically important for successful application of the MR-EKF for which a systematic approach is presented. This tutorial provides implementation guidance for practitioners seeking to successfully apply state estimation for multirate systems. Thus, it contributes to the development of demand-driven operation of biogas plants, which may aid in stabilizing a renewable electricity grid.

eess.SP↗

arXiv2026

Benchmarking Reinforcement Learning via Stochastic Converse Optimality: Generating Systems with Known Optimal Policies

The objective comparison of Reinforcement Learning (RL) algorithms is notoriously complex as outcomes and benchmarking of performances of different RL approaches are critically sensitive to environmental design, reward structures, and stochasticity inherent in both algorithmic learning and environmental dynamics. To manage this complexity, we introduce a rigorous benchmarking framework by extending converse optimality to discrete-time, control-affine, nonlinear systems with noise. Our framework provides necessary and sufficient conditions, under which a prescribed value function and policy are optimal for constructed systems, enabling the systematic generation of benchmark families via homotopy variations and randomized parameters. We validate it by automatically constructing diverse environments, demonstrating our framework's capacity for a controlled and comprehensive evaluation across algorithms. By assessing standard methods against a ground-truth optimum, our work delivers a reproducible foundation for precise and rigorous RL benchmarking.

cs.LG↗

arXiv2025

Strong nonlinear detectability and moving horizon estimation for nonlinear systems with unknown inputs

This paper considers state estimation for general nonlinear discrete-time systems subject to measurement noise and possibly unbounded unknown inputs. To approach this problem, we first propose the concept of strong nonlinear detectability. This condition is sufficient and necessary for the existence of unknown input state estimators (UISEs), which reconstruct states from noisy sampled measurements and yield bounded estimation error even for unbounded unknown inputs. Based on the proposed detectability notion, a UISE is designed via a moving horizon estimation strategy using a full-order model as well as past and current measurements. Next, we tighten this detectability notion to design a two-stage MHE-based UISE, which is computationally more efficient than the MHE-based UISE using full-order models. In a simulation example with a plant growth process, both variants of MHE-based UISEs are compared with a conventional MHE to illustrate the merits of the developed methods.

eess.SY↗

arXiv2025

MHE in Output Feedback Control of Uncertain Nonlinear Systems via IQCs

We propose a moving horizon estimation (MHE) scheme for general nonlinear constrained systems with parametric or static nonlinear uncertainties and a predetermined state feedback controller that is assumed to robustly stabilize the system in the absence of estimation errors. Leveraging integral quadratic constraints (IQCs), we introduce a new notion of detectability that is robust to possibly non-parametric uncertainties and verifiable in practice. Assuming that the uncertain system driven by the controller satisfies this notion of detectability, we provide an MHE formulation such that the closed-loop system formed of the uncertain system, the controller and MHE is input-to-state stable w.r.t. exogenous disturbances.

eess.SY↗

arXiv2025

Generalized Super-Twisting Observer for a class of interconnected nonlinear systems with uncertainties

The Generalized Super-Twisting Observer (GSTO) is extended for a strongly observable class of nonlinearly interconnected systems with bounded uncertainties/perturbations. A nonsmooth strong Lyapunov function is used to prove the finite-time convergence of the proposed observer to the true system's trajectories, in the presence of the uncertainties. A case study on the interaction between two food production systems is presented, comparing the proposed observer with the High Gain observer. The results emphasize the critical role of the GSTO's discontinuous term in achieving exact estimation.

eess.SY↗

arXiv2025

Some remarks on robustness of sample-and-hold stabilization

This work studies robustness to system disturbance and measurement noise of some popular general practical stabilization techniques, namely, Dini aiming, optimization-based stabilization and inf-convolution stabilization. Common to all these techniques is the explicit usage of a (general nonsmooth) control Lyapunov function, thus allowing to see them as a kind of generalization to the celebrated Sontag's formula. It turns out that certain details of the above described robustness properties have not yet received the attention in literature they deserved. We provide new remarks, formalized in mathematical propositions, on robustness of selected popular stabilization techniques along with an extensive statistical case study on a robot parking problem.

eess.SY↗

arXiv2025

Some remarks on practical stabilization via CLF-based control under measurement noise

Practical stabilization of input-affine systems in the presence of measurement errors and input constraints is considered in this brief note. Assuming that a Lyapunov function and a stabilizing control exist for an input-affine system, the required measurement accuracy at each point of the state space is computed. This is done via the Lyapunov function-based decay condition, which describes along with the input constraints a set of admissible controls. Afterwards, the measurement time points are computed based on the system dynamics. It is shown that between these self-triggered measurement time points, the system evolves and converges into the so-called target ball, i.e. a vicinity of the origin, where it remains. Furthermore, it is shown that the approach ensures the existence of a control law, which is admissible for all possible states and it introduces a connection between measurement time points, measurement accuracy, target ball, and decay. The results of the approach are shown in three examples.

eess.SY↗