arXiv Science⌕ Search

arXiv subjects

Masoud Ataei

Publications and source records attributed to Masoud Ataei.

At least 19 recordsLinked to original sources

Conic Certification of Transformer Attention

Attention is the computational core of large language models, yet the verifiers that bound how far an attention head's output can move under input perturbations give no guarantee on how loose their bounds are. A weak certificate therefore cannot be told apart from a fragile model. We develop a conic programming theory of attention certification that supplies this guarantee. We prove that the difficulty lies not in the softmax but in the bilinear interaction of a varying query with the keys. This interaction makes certification NP-hard over boxes and inapproximable once the attention logits can move by a constant amount. A fixed query or listed token substitutions, by contrast, make the exact worst case efficiently computable. An exponential cone moment relaxation then certifies a head with an error bounded quadratically in the perturbation radius by computable quantities, an order that cannot be improved. We also show that relaxations that treat a network one operation at a time, linear bound propagation among them, pay on second-order terms a sum of per-operation maxima instead of one coupled maximum. Computational results on GPT-2 indicate that the theory carries over to a trained model. Against exact worst cases with the query fixed, the certificate attains the predicted second-order accuracy. It is tighter than linear bound propagation on every head, and the looseness of bound propagation tracks the predicted per-operation excess.

cs.LG↗

Entropic Column Generation and Lehmer Branch-and-Price for Bin Packing Problem

We introduce Lehmer branch-and-price, an exact algorithm for bin packing and cutting stock problems built on the Lehmer transform, the ratio of Mellin transforms of item weights at consecutive orders. The transform maps each bin, a finite multiset of item weights, to a smooth increasing curve, and so gives the discrete problem a continuous representation on which the tools of analysis, such as convexity, exponential families and smoothing, can act. Read along this curve, the problem yields an explicit dual solution, a monotone representation of the dominance order, a family of constructive heuristics with first fit decreasing as its limit, and an integer identity that tells when the linear relaxation can decide an instance and when only a perfect packing can improve the best solution known. Lifted from items to patterns, the transform gives entropic column generation, a new form of column generation that bounds the relaxation from both sides at every iteration without solving the pricing problem exactly, maximizes a smoothed dual at an explicit rate, and measures by an entropy how much the relaxation leaves undecided. We show that the proposed algorithm outperforms the state-of-the-art methods on the standard benchmark in both the number of instances solved and the computational time.

math.OC↗

ForVis: An In-Field Dataset and Benchmark for VIO Using Under-Canopy UAV Flights in Forests

Visual-inertial Simultaneous Localization and Mapping (VI-SLAM) for UAVs remains difficult to evaluate in real forest environments, where motion, illumination changes, repetitive vegetation, and vibration can all affect estimation. We present ForVis, an in-field dataset and benchmark for evaluating VI-SLAM during UAV flight in forest environments. The dataset contains twelve flights across open meadow, above-canopy, and under-canopy conditions in each environment. In total, it provides 563.8s of flight over 1096.8m of trajectory, recorded simultaneously with an Intel RealSense D435i and an OAK-D Pro Wide together with inertial and flight-controller data. We benchmark seven open-source VI-SLAM systems over 504 runs. The results show that sensor choice has a larger effect on trajectory error than the spread between algorithms: all seven methods achieve lower median error on the OAK-D Pro than on the D435i. ForVis is intended to support evaluation of speed, accuracy and robustness for VI-SLAM in challenging forest flight.

cs.RO↗

SE(3) Neural Potential Fields for 6-DoF Trajectory Planning Directly from Images Without Explicit 3D Reconstruction

Reaching a 6-DoF grasp pose in clutter requires a collision-free trajectory, conventionally obtained by reconstructing the scene in 3D and planning inside that reconstruction, at the cost of its accuracy and compute. Potential fields learned directly from images remove that dependency but inherit the classical weakness of artificial potential fields: where attractive and repulsive gradients cancel, the descent grazes the obstacle instead of going around it, and can stall short of the goal. We present an SE(3) neural potential field learned from posed RGB images and supervised with a navigation function, the geodesic distance to the grasp through free space recovered from those same images during training, which removes both failures. On two tabletop scenes, from obstacle-blocked starts executed on a UR10, the field converges within 3 cm of the grasp from every start and every path it executes is collision-free against the ground-truth geometry, against 25% and 0% under image supervision alone; mean clearance rises from under a centimeter to 8.6-8.8 cm and arm-link contacts fall from 20.6-50.4% to 2.7-5.5% of executed configurations. Executed grasp success is 90.0% and 40.0% on the two scenes, the residual failures being refusals of the Cartesian executor rather than of the field. Planning takes about 2 s against 67-133 s for RRT* on a reconstruction of the same images, though under a common offline harness the two are comparable: the deployed margin is the cost of collision-checking a dense reconstruction, not planner complexity.

cs.RO↗

Engagement-Aware Agentic Pursuit-Evasion

This paper presents a hierarchical multi-agent architecture in which independent large language model (LLM) planners perform strategic role assignment for attacking and defending robot teams, decoupled from low-level control execution. At each planning cycle, each team's LLM planner observes its own team in full but the opposing team only within its robots' combined field of view, then assigns each robot a tactical role - e.g., hold a perimeter, neutralize an intruder on contact, or converge with teammates for capture - together with a natural-language justification. Each robot independently executes its assigned role through a receding-horizon model predictive control (MPC) controller, followed by a discrete-time control barrier function (CBF) filter for safety and role-dependent engagement constraints. Differentiated capture and neutralization incentives require the defending planner to balance threat resolution against resource allocation under partial observability. We evaluate the framework across variable-sized adversary teams using both state-based tactical reasoning and image-based contact classification. Results show that collective team behavior can be adapted through high-level LLM role assignment while retaining the same underlying low-level control architecture.

eess.SY↗

Draining Fictitious Knots: Restoring Distance-Awareness Guarantees for High-Dimensional Spline Networks

Kolmogorov-Arnold Networks (KANs) with spline activations have recently shown promise for interpretable function approximation. Distance-Aware Error for Kolmogorov Networks (DAREK) introduces a computationally efficient bottom-up approach to uncertainty quantification by equipping KANs with distance-aware error bounds; yet, in high-dimensional settings, the theoretical guarantees can be weakened by the emergence of fictitious knots. Inspired by the Kolmogorov-Arnold representation theorem, DAREK adopts a componentwise formulation in which each input dimension is treated separately; as a result, induced knot locations may appear in the combined input space without corresponding to actual training data. These fictitious knots mislead the DAREK uncertainty estimator into reporting low uncertainty far from any real observation, violating the distance-awareness guarantee. We identify this failure mode precisely, characterize its geometric structure, and propose a drainage uncertainty mechanism that restores distance-awareness by constructing a monotonically decreasing uncertainty path from any fictitious knot region toward the nearest real knot. The proposed drainage method provides a practical heuristic correction that mitigates the fictitious-knot failure mode while restoring theoretical distance-awareness in high-dimensional settings. Experiments on a 2D synthetic benchmark and a 100-dimensional face dataset show that drainage raises sampled distance-awareness (SDA) from 85% to 98-99%, matching Gaussian processes at lower computational cost.

cs.LG↗

Lehmer-Lambert Distribution

The Lehmer transform of a positive signal is the ratio of its power sums at consecutive orders, read as a function of the order, and it is a strictly increasing analytic curve from the smallest observation to the largest. Composing this curve with a map whose inverse is the Lambert function turns it into a probability law on the real line, the Lehmer-Lambert distribution, which we introduce and study. Its distribution, density and quantile functions are closed-form, its random variates are exact, and the law is invariant under changes of gain and of power-law calibration of the signal. Its modes lie at orders at which the signal changes scale, and for a sample its tails are exponential with rates equal to the two extreme logarithmic gaps of the sample. We derive moments, generating functions and limit theorems, and we investigate applications of the Lehmer-Lambert distribution in the analysis of electroencephalograms of patients with major depressive disorder.

math.PR↗

Lehmer Transform

The Lehmer transform encodes a positive dataset as a single analytic curve, the ratio of its power sums at consecutive orders read as a function of the order. As the order sweeps the real line the curve generates every location statistic between the sample extremes, and its logarithm is the unit increment of the free energy of an exponentially tilted ensemble; the statistical theory of the curve flows from that identity. The slope of the curve is a Jeffreys divergence, the arithmetic-geometric gap is a relative entropy, and multiplicativity over independent factors makes deconvolution of multiplicative noise a pointwise division. A quantitative rigidity theorem locates the frontier of identifiability at geometric growth of the curve, with resonant log-periodic families of distinct laws sharing one curve beyond it. The empirical curve is an exact re-coordinatization of the order statistic, hence minimal sufficient, and its influence function, exact leading bias and limit theory are developed in full. At heavy tails the curve undergoes a phase transition whose two knees, one unit apart, sit at the tail index and its unit shift, a whole-sample diagnostic complementing threshold-based estimators.

math.ST↗

Fractality of the Schrödinger Density for Rough Data

The observable of the Talbot effect is the intensity behind the grating: the density of the evolving field, not the field itself. Its fractality was previously known only for step data with rational jumps. We prove the general case. For arbitrary real data of bounded variation with at least one jump, the density of the free Schrödinger evolution on the torus is fractal at almost every time, with graph of upper box dimension exactly three halves. Its critical Sobolev mass diverges logarithmically, at a rate given in closed form by Wiener's jump statistic of the datum and independent of the positions and phases of the jumps. The same rate is halved along time traces and doubled for the Airy flow, so the critical mass probes the dispersion relation. Transported by the rank calculus of derangetropy operators, the theory equips every probability law with a quantum carpet: Gauss-sum revivals on quantile cells at rational times, a universal fractal at almost every other. The spectral growth rate of a single measured intensity profile returns the jump content of the grating, a prediction open to test in optical and matter-wave interferometry.

math-ph↗

Worst-Case Distance-Aware Error Bounds for Neural Networks

Safety-critical applications of machine learning require uncertainty estimates that support reliable worst-case analysis. Neural networks (NNs) provide expressive function approximation, while Gaussian processes (GPs) offer principled probabilistic uncertainty, but both face limitations in this setting: most modern neural architectures lack tractable worst-case error bounds, and Gaussian processes become computationally expensive at scale. For uncertainty to be interpretable, a central requirement is distance-awareness: that is, uncertainty increases with the distance between a test input and the nearest relevant training data. We present a general framework for worst-case distance-aware error bounds for NNs that combine dense layers with spline-based components. Our approach establishes error bounds that are both distance-aware, reflecting proximity of a test point to its nearest training data, and worst-case, providing deterministic guarantees under known Lipschitz constraints rather than probabilistic assumptions. Our algorithm, K-DAREK (Distance-Aware Error for Kurkova-Kolmogorov Networks), provides efficient and interpretable uncertainty quantification for NNs. K-DAREK is about four times faster and ten times more computationally efficient than an ensemble of KANs, 8.6 times more scalable than GP, eliminates up to 8.2% error-bound violation rate observed in DAREK, and reduces the average collision rate from 1.8% to 1.1% in the multi-agent safe control experiment. On high-dimensional real-world regression tasks (e.g., Real Estate Valuation), K-DAREK preserves distance-aware error bounds and achieves zero coverage violations, addressing the overgeneralization and inducing-point-coverage limitations exhibited by SNGP and DUE, respectively.

cs.LG↗

Derangetropy Operators

A derangetropy operator reweighs a probability density by a fixed profile of its own cumulative distribution function, acting through ranks alone. We prove that these operators are precisely the transformations of absolutely continuous laws equivariant under monotone changes of variable, and that they compose through interval maps, making their dynamics exactly solvable: iteration condenses every law onto its median with a universal Koenigs limit law, the continuous flow is solvable in closed form with the Cauchy family as invariant hyperbolic manifold, and balanced against diffusion the distribution function obeys an overdamped sine-Gordon equation whose unique steady law, the hyperbolic secant, is a globally stable kink. A variational principle selects the canonical kernel, the squared ground state of the Dirichlet Laplacian on the unit interval, whose update is a Bayesian posterior costing exactly one bit for every law, and a unitary lift equips each law with an isospectral Sturm-Liouville system and a quantum carpet: a strong law of large numbers for the critical Sobolev mass, with sharp constant given by Wiener's jump statistic, proves the fractality of the Schrödinger density for arbitrary real bounded-variation data with a jump, previously known only for rational step data. A lift to the dual of the Virasoro algebra, at central charge one, a normalization, identifies laws with disconjugate Hill potentials, tails with conformal weights, and the Cauchy family with the exceptional orbit. Randomized phases yield an exact sampler and a multiplicative chaos, log-correlated in the weakly tempered regime; in several dimensions, dependence stratifies into a conserved interaction, a torsion driven by maximal correlation, and a flat Sinkhorn transport.

math.PR↗

Distance-Aware Error for Spline Networks: A Bottom-Up Approach to Uncertainty

We develop a new class of distance-aware error bounds that tightly characterize the approximation error of spline neural networks. Our bottom-up approach analyzes the error bound of each neuron (a spline) and then extends it to the full network. We begin with error bounds for Newton's polynomial, generalize them to arbitrary splines under higher-order Lipschitz continuity, and extend the result to function compositions, the core of deep networks such as Kolmogorov-Arnold networks. By analyzing error propagation through composed spline layers, we obtain error bounds for the entire network. These bounds are deterministic, do not rely on sampling or probabilistic assumptions, and hold under mild regularity conditions. We evaluate our method on object shape estimation from sparse laser scans and safe navigation in unstructured environments. Our method is faster than the Gaussian process and Monte Carlo approaches, and our bounds reliably enclose the true error. We also develop a metric for the distance-awareness of an uncertainty estimator and show that distance-aware uncertainty for Kolmogorov networks (DAREK) is distance-aware in more regions than the baselines.

eess.SP↗

Statistical Geometry and Information Dynamics on Hyperspherical Surfaces

We study the statistical geometry of random chords on n-dimensional spheres by deriving explicit analytical expressions for the chord length distribution and its associated structural properties. A critical threshold emerges at dimension 19, marking the transition from curvature-dominated variability to high-dimensional concentration, where interpoint distances become nearly deterministic and probabilistic diversity collapses into geometric uniformity. We further derive a closed-form expression for the Fisher information, showing that it is inversely proportional to the square of the radius and varies non-monotonically with dimension. Notably, it attains a minimum at dimension 7, coinciding with the dimension at which the volume of the unit sphere is maximized. This reflects a unique regime of maximal spatial diffuseness and minimal inferential sensitivity, arising from the interplay between weakening curvature and still-latent concentration. The alignment between volumetric and statistical extrema reveals a deeper duality between geometry and information. We also analyze the characteristic function, which exhibits a dichotomy: in even dimensions, it takes rational-exponential form, while in odd dimensions it involves Bessel and Struve functions. This distinction reflects differences in harmonic structure and boundary regularity across dimensions. Together, these findings show how curvature and dimension jointly regulate statistical efficiency on hyperspherical domains, with implications for geometric inference and high-dimensional learning.

math.PR↗

Inferring Grain Size Distributions from Magnetic Hysteresis in M-type Hexaferrites

We develop a stochastic-dynamic framework to infer latent grain size distribution from magnetic hysteresis data in M-type hexaferrite materials, offering an alternative to imaging-based characterization. A stochastic nucleation-growth process yields a Modified Lognormal Power-law grain size distribution. This is combined with Brown's relation to obtain a coercivity probability distribution, which is embedded within a dynamic magnetization model. A key feature is the joint estimation of microstructural parameters, including the critical grain radius, through inverse optimization of full hysteresis loops. Experimental validation on hydrothermally synthesized strontium hexaferrite subjected to nitrogen treatment and recalcination reveals interpretable trajectories of nucleation, growth, and structural memory encoded in the magnetic response.

cond-mat.mtrl-sci↗

Multiscale Causal Analysis of Market Efficiency via News Uncertainty Networks and the Financial Chaos Index

This study evaluates the scale-dependent informational efficiency of stock markets using the Financial Chaos Index, a tensor-eigenvalue-based measure of realized volatility. Incorporating Granger causality and network-theoretic analysis across a range of economic, policy, and news-based uncertainty indices, we assess whether public information is efficiently incorporated into asset price fluctuations. Based on a 34-year time period from 1990 to 2023, at the daily frequency, the semi-strong form of the Efficient Market Hypothesis is rejected at the 1\% level of significance, indicating that asset price changes respond predictably to lagged news-based uncertainty. In contrast, at the monthly frequency, such predictive structure largely vanishes, supporting informational efficiency at coarser temporal resolutions. A structural analysis of the Granger causality network reveals that fiscal and monetary policy uncertainties act as core initiators of systemic volatility, while peripheral indices, such as those related to healthcare and consumer prices, serve as latent bridges that become activated under crisis conditions. These findings underscore the role of time-scale decomposition and structural asymmetries in diagnosing market inefficiencies and mapping the propagation of macro-financial uncertainty.

q-fin.ST↗

Modeling Regime Structure and Informational Drivers of Stock Market Volatility via the Financial Chaos Index

This paper investigates the structural dynamics of stock market volatility through the Financial Chaos Index, a tensor- and eigenvalue-based measure designed to capture realized volatility via mutual fluctuations among asset prices. Motivated by empirical evidence of regime-dependent volatility behavior and perceptual time dilation during financial crises, we develop a regime-switching framework based on the Modified Lognormal Power-Law distribution. Analysis of the FCIX from January 1990 to December 2023 identifies three distinct market regimes, low-chaos, intermediate-chaos, and high-chaos, each characterized by differing levels of systemic stress, statistical dispersion and persistence characteristics. Building upon the segmented regime structure, we further examine the informational forces that shape forward-looking market expectations. Using sentiment-based predictors derived from the Equity Market Volatility tracker, we employ an elastic net regression model to forecast implied volatility, as proxied by the VIX index. Our findings indicate that shifts in macroeconomic, financial, policy, and geopolitical uncertainty exhibit strong predictive power for volatility dynamics across regimes. Together, these results offer a unified empirical perspective on how systemic uncertainty governs both the realized evolution of financial markets and the anticipatory behavior embedded in implied volatility measures.

q-fin.ST↗

Generalized Derangetropy Functionals for Modeling Cyclical Information Flow

This paper introduces a framework for modeling cyclical and feedback-driven information flow through a generalized family of entropy-modulated transformations called derangetropy functionals. Unlike scalar and static entropy measures such as Shannon entropy, these functionals act directly on probability densities and provide a topographical representation of information structure across the support of the distribution. The framework captures periodic and self-referential aspects of information distribution and encodes them through functional operators governed by nonlinear differential equations. When applied recursively, these operators induce a spectral diffusion process governed by the heat equation, leading to convergence toward a Gaussian characteristic function. This convergence theorem provides a unified analytical foundation for describing the long-term dynamics of information under cyclic modulation. The proposed framework offers new tools for analyzing the temporal evolution of information in systems characterized by periodic structure, stochastic feedback, and delayed interaction, with applications in artificial neural networks, communication theory, and non-equilibrium statistical mechanics.

cs.IT↗

Mathematical Programming Models for Exact and Interpretable Formulation of Neural Networks

This paper presents a unified mixed-integer programming framework for training sparse and interpretable neural networks. We develop exact formulations for both fully connected and convolutional architectures by modeling nonlinearities such as ReLU activations through binary variables and encoding structural sparsity via filter- and layer-level pruning constraints. The resulting models integrate parameter learning, architecture selection, and structural regularization within a single optimization problem, yielding globally optimal solutions with respect to a composite objective that balances prediction accuracy, weight sparsity, and architectural compactness. The mixed-integer programming formulation accommodates piecewise-linear operations, including max pooling and activation gating, and permits precise enforcement of logic-based or domain-specific constraints. By incorporating considerations of interpretability, sparsity, and verifiability directly into the training process, the proposed framework bridges a range of research areas including explainable artificial intelligence, symbolic reasoning, and formal verification.

cs.AI↗