arXiv subjects

Ismail Huseynov

Publications and source records attributed to Ismail Huseynov.

6 recordsLinked to original sources

arXiv2026

Uncertainty calibration in Bayesian M/EEG source imaging

M/EEG source imaging requires accurate localization and reliable uncertainty estimates, yet posterior credible regions are rarely assessed for empirical calibration. We present a simulation-based framework for uncertainty quantification and calibration of empirical Bayesian inverse methods with closed-form conditional Gaussian posterior summaries. We compare Bayesian minimum norm (BMN) with sLORETA depth weighting and sparse Bayesian learning (SBL) with sparse basis field expansions (S-FLEX). S-FLEX allows retained coefficients to contribute nonzero marginal posterior variance at locations where voxel-wise SBL yields degenerate variances. For BMN, we derive joint source- and noise-variance updates through evidence maximization. We test whether adaptive noise learning yields near-calibrated uncertainties. Both methods retain residual miscalibration, motivating post-hoc isotonic recalibration of credible-region levels using empirical coverage. Simulations assess fixed- and free-orientation models across signal-to-noise ratios (SNR), source sparsity levels, and subject-specific head models, using oracle, baseline-estimated, and adaptively learned noise. Before recalibration, SBL+S-FLEX yields lower Wasserstein localization error, smaller posterior uncertainty, and coverage closer to nominal credibility than BMN+sLORETA. Isotonic recalibration improves both methods, with larger gains for conservative BMN+sLORETA posteriors; transfer across mismatched SNR, sparsity, and head models remains condition dependent. Noise specifications yield broadly consistent reconstruction and uncertainty trends within each estimator. In real auditory MEG data, SBL+S-FLEX provides more focal localization and tighter uncertainties than BMN+sLORETA, suggesting greater statistical power for identifying bilateral auditory sources.

cs.LG↗

arXiv2026

Exact Spectral Uncertainty Decomposition for Linear-Gaussian Bayesian M/EEG Inverse Problems

Distributed magneto- and electroencephalographic (M/EEG) source reconstruction is a severely underdetermined linear inverse problem. Bayesian source imaging regularizes inversion through source-prior and sensor-noise covariances, but the posterior covariance does not directly distinguish uncertainty constrained by the measurements from uncertainty unobservable under the sensing geometry. We study this distinction for linear-Gaussian M/EEG models with diagonal source-prior and sensor-noise covariances, covering Type-I inference and Type-II inference conditional on learned covariance hyperparameters. After restricting the analysis to the prior-supported source space, standardizing the prior, and whitening the sensor noise, the complete singular spectrum of the forward operator separates likelihood-visible and likelihood-null directions. This yields an additive uncertainty decomposition of the conditional posterior covariance: uncertainty in likelihood-visible directions is reduced according to spectral information content, whereas likelihood-null uncertainty remains unchanged from the prior. The spectral representation also yields a prior-minus-reduction identity, showing that covariance reduction is confined to the likelihood-visible subspace. Spectral markers quantify likelihood information and prior-variance retention and reduction. Fixed-orientation MEG simulations with adaptive noise learning illustrate the framework. Dense Bayesian minimum-norm inference retains a large likelihood-null component, whereas sparse $γ$-MAP strongly reduces the fitted prior support. Within that support, the markers distinguish strongly informed directions from a weakly constrained direction. Thus, prior-support selection determines which source coordinates remain in the fitted model, while the spectral decomposition quantifies how strongly the retained directions are constrained by the measurements.

cs.LG↗

arXiv2026

Structure-Preserving Correction Learning for Sparse Bayesian Inference in Brain Source Imaging

Classical sparse Type-II Bayesian methods for M/EEG brain imaging support joint estimation of source and noise hyperparameters, but rely on fixed iterative update rules. Although these updates are principled and interpretable, their dynamics are not data-driven. We propose to learn the update mechanism itself while preserving the underlying Bayesian structure by unfolding a classical joint hyperparameter-learning solver into a trainable neural network architecture whose layers mirror the original iterations. The resulting framework is initialized to recover the classical solver exactly before training and is enriched through progressively more expressive residual correction learning mechanisms, ranging from learnable biases to adaptive multilayer perceptron and attention-based contextual refinements. In this way, training does not replace Bayesian inference with a black-box predictor, but instead learns structured correction terms while retaining the interpretability and model-based character of the original update dynamics. Structured correction learning therefore aims to improve empirical reconstruction performance without replacing the original model-based inference mechanism. Experimental results show that the learned correction variants improve reconstruction performance and convergence behavior over the baseline unfolded solver while preserving its algorithmic transparency.

cs.LG↗

arXiv2026

Learning from the Descent Direction: Adaptive Gradient Descent under One-Sided Hölder Regularity

We study adaptive gradient descent for continuously differentiable, possibly nonconvex objectives under one-sided Hölder regularity. Unlike classical Hölder- or Lipschitz-gradient assumptions, which control the full gradient variation, our condition bounds only the directional term appearing in the descent inequality. This can allow less conservative step sizes when large gradient changes are orthogonal to, or favorable along, the update direction. We propose an adaptive scalar-step method based on an estimate of positive one-sided Hölder curvature, combined with a simple sufficient-decrease safeguard. For nonconvex objectives on a convex region containing the accepted update segments, we prove an explicit best-iterate stationarity bound with a rate determined by the Hölder exponent. Unlike predetermined diminishing step-size schemes, the method adapts to the local descent geometry. We evaluate the approach on two full-batch benchmarks designed to separate directional curvature from full gradient variation. On a binary classification problem, the method achieves the lowest final cross-entropy, objective value, and gradient norm, together with the largest classification margin among the compared scalar gradient methods. On a nonconvex Hölder regression problem, it attains the lowest final objective gap and gradient norm. These results indicate that one-sided Hölder curvature is an effective adaptive step-size signal when full-gradient variation is inflated by directions that do not hinder descent.

cs.LG↗

arXiv2026

Reliable Error Estimation for PINNs: Lower and Upper A Posteriori Bounds

Physics-informed neural networks (PINNs) combine machine learning with physical laws to solve differential equations. While existing results provide rigorous \emph{a posteriori} upper bounds for PINN prediction errors, complete certification also requires complementary lower information in order to obtain computable two-sided error enclosures. In this paper, we derive computable \emph{a posteriori} lower bounds for PINN errors in ordinary differential equations on suitable certified state-space domains under a localized strong monotonicity condition. We combine these estimates with complementary localized upper bounds under a one-sided Lipschitz condition, which is weaker than the global Lipschitz assumption used in previous work and can yield sharper upper error bands. The resulting bounds depend only on the neural-network approximation, the ODE residual, and local monotonicity and growth constants, and therefore do not require access to the exact solution. For linear time-invariant and time-varying systems, we further derive explicit formulas in terms of the minimal and maximal eigenvalues of the symmetric part of the system matrix. We also discuss the distinction between soft and hard enforcement of initial conditions in PINNs and explain why exact enforcement can make the scalar lower certificate uninformative. To recover nontrivial lower information in the linear setting, we use a signed-residual finite-probe certificate based on coordinate unit vectors. We also formulate a certificate-informed training strategy in which the propagated upper certificate is used as an auxiliary regularizer, while lower certificates remain post-training diagnostics. Altogether, the proposed framework provides rigorous and practically computable error certificates for PINN approximations of ODEs, while making explicit the domains and model classes for which the assumptions can be verified.

cs.LG↗

arXiv2026

Partially Exact Controllability of Semilinear Heat Exchanger Systems

In this paper, we study two semilinear systems describing a monotubular and a two-stream heat exchanger. Neither system is exactly controllable; however, for each we specify a subspace of the state space with respect to which the system is exactly controllable, thus establishing partial exact controllability.

math.OC↗