arXiv Science⌕ Search

arXiv subjects

Wassim Tenachi

Publications and source records attributed to Wassim Tenachi.

13 recordsLinked to original sources
arXiv2026

Do Tabular Foundation Models Know Physics? Contamination, Units, and the Deterministic Limit

Tabular foundation models (TFMs) learn to fill in tables the way language models fill in text, and tables are arguably the format in which most physical measurement arrives. Did they learn any physics in the process? They are Bayesian by construction, so the question is what their prior contains. We probe it directly, evaluating four of them (TabPFN-3, TabICLv2, TabDPT and Real-TabPFN-2.5) against six baselines on datasets sampled from 316 physical equations, in and out of domain. TFMs dominate, out of the box and after tuning. But we show that their prior can represent neither a noiseless mechanism nor physical units, which is why they interpolate physics without yet being able to act as physical models.

cs.LG↗
arXiv2026

NestyNet. III. Symbolic Regression from Analytic Neural Surrogates

Many physical laws are simple only after the right representation, decomposition or internal coordinate has been found, but discovering that structure from data is combinatorially hard. This task is symbolic regression (SR), the search for closed-form expressions that fit data without assuming a fixed model class. Here we present NestyNet-SR. A neural surrogate with analytic derivatives is used to detect separability, recursively reducing multivariate problems to simpler neural atoms. These atoms are distilled into closed form by a tiered symbolic-search stack, whose final tier is a novel factorized symbolic search that separates structure from calibration. Composing candidate internal coordinates freely, it scores each coordinate by how well calibrated functions of it (e.g., polynomials, power laws, sinusoids) fit the data, so the constants of those calibrated maps, however deeply nested in the final expression, are fitted rather than searched. The method supports multi-dataset regression, automated feature discovery, and dimensional-analysis pruning. On the SRBench AI~Feynman benchmark, NestyNet-SR achieves exact symbolic recovery of all 120 noiseless equations, the first such result, and under noise a statistical audit certifies which structures survive. As a real-data vignette, given only the separate mass-model components of SPARC-survey galaxies, the algorithm discovers the baryonic acceleration coordinate, reproduces the established mass-to-light and acceleration scales and the non-unique form of the radial acceleration relation, and adds held-out-galaxy generalization, a calibrated symmetry abstention, and a posterior for the local slope of the law. Analytic derivatives thus provide a practical route from neural surrogates to interpretable closed-form empirical laws.

astro-ph.IM↗
arXiv2026

NestyNet. IV. Laws Chosen by Nothing in Advance

Differential-equation (DE) discovery tends to break down precisely where much of physics begins. Fields are coupled, governing laws are nonlinear in the state, amplitudes, coordinates, or operators of interest, yet derivatives must remain consistent across fields, channels, and differentiation orders. NestyNet-DE addresses this via two complementary DE search strategies, both employing analytic derivatives from segmented neural surrogates: a sparse-library route linear in the outer coefficients, and a new operator-factorized route that searches directly over equation structure rather than a fixed library, recovering compositional laws the sparse route misses. The recovered laws can be strongly nonlinear in states, fields, coordinates, and their couplings. The framework also handles multi-dataset shared-support discovery, complex and vector laws, and Hamiltonian discovery from phase-space trajectories. Beyond a law's form, the same data yield its geometry, the Lie point symmetries of the recovered equation. We apply the pipeline to 30 years of daily ephemerides of $308$ main-belt asteroids and recover the reduced-Kepler hierarchy (areal law, inverse-square force, and reduced Hamiltonian), where a discovered rotational symmetry fixes the centrifugal coefficient rather than fitting it. We also present a benchmark of 57 real-valued ODEs and 26 complex-valued systems, including the Schr\"odinger and Dirac equations, with Maxwell's equations as a coupled vector-PDE case study. Here, discovery is not shackled to a fixed library, nor does it end at the equation. It composes laws that no dictionary anticipated, and closes the loop from data, to a law chosen by nothing in advance, to the geometry that explains and integrates it.

astro-ph.IM↗
arXiv2026

NestyNet. I. Physics Functions Are Hard to Fit with Neural Networks: A Framework for Accurate Surrogates and Analytic Derivatives

Many of the smooth functions that matter most in physics are precisely the ones that standard neural network methods struggle to fit accurately. Here we present NestyNet, a coupled model-and-optimizer framework capable of fitting such targets to high accuracy while also delivering their gradients, Hessians, Laplacians, and antiderivatives analytically and at low cost. This makes it a natural substrate for scientific machine learning tasks. The model is a deterministic segmented analytic surrogate, and its optimizer is a second-order Levenberg--Marquardt scheme whose damping and linear solves are tailored to the stiff, strongly correlated parameter geometries induced by multiscale and sharply structured targets typical in physics and other scientific applications. On the AI Feynman benchmark of 120 physics equations, NestyNet achieves median improvement factors of $2\,100\times$ for function values, $1\,400\times$ for first derivatives, and $780\times$ for second derivatives relative to standard neural networks trained with first-order optimization (Adam). Even after refining those fits with quasi-Newton (L-BFGS) optimization, the corresponding improvements are $540\times$, $450\times$, and $250\times$. Owing to the analytic design it is up to $\approx 44\times$ faster than vectorized automatic-differentiation (autograd) baselines, with a margin growing with model size. The same analytic-derivative framework also supports vector- and complex-valued targets, measurement uncertainties in both inputs and outputs, and constraints, and its modules can be composed flexibly to build scientifically useful model architectures, all without reverting to autograd. Together, these components provide a practical modular framework for fitting difficult scientific surrogates while delivering accurate differential operators for subsequent analysis.

astro-ph.IM↗
arXiv2026

NestyNet. II. Coherent Function-Space Posteriors from Scientific Neural Surrogates (or How to Avoid Expensive MCMC)

Scientific analyses increasingly use flexible neural networks, but their thousands of correlated parameters make it challenging to interpret the associated uncertainties. Here we develop a low-dimensional posterior for the fitted function itself, for scientific neural surrogates trained with second-order optimization. Linearizing the fitting procedure with respect to the randomized residual rows gives a measurement-to-function transport, the linear map, assembled from the converged Jacobians and Gauss--Newton curvature, that carries measurement perturbations into the function perturbations that refitting would produce. Its leading singular functions define coherent deformation modes. Independent Gaussian coefficients then generate smooth function draws, so that any derived quantity, including those requiring derivatives or integrals of the draw, inherits the posterior. The construction distinguishes repeated-experiment covariance from the local Gauss--Newton/Laplace posterior and propagates both to correlated quantities of scientific interest. The result is conditional on the fit's declared choices (architecture, hyperparameters, active set, and optimization branch), and every fit is certified as converged by checking that a further optimization step would change the fitted predictions by less than a chosen small fraction of the measurement errors. Our primary example is an 800-parameter phase-space distribution function fit for a mock stellar disk. Four uncertainty coordinates, two orders of magnitude fewer than the fitted parameters and stable under refinement of the force basis, capture 99\% of the vertical-force posterior variance, and 4000 coherent draws propagate through the force, total-density, surface-density, and frequency calculations in 0.8s. The method provides a highly efficient route to uncertainty propagation for derivative-dependent scientific inference.

astro-ph.IM↗
arXiv2024

Generalizing the SINDy approach with nested neural networks

Symbolic Regression (SR) is a widely studied field of research that aims to infer symbolic expressions from data. A popular approach for SR is the Sparse Identification of Nonlinear Dynamical Systems (SINDy) framework, which uses sparse regression to identify governing equations from data. This study introduces an enhanced method, Nested SINDy, that aims to increase the expressivity of the SINDy approach thanks to a nested structure. Indeed, traditional symbolic regression and system identification methods often fail with complex systems that cannot be easily described analytically. Nested SINDy builds on the SINDy framework by introducing additional layers before and after the core SINDy layer. This allows the method to identify symbolic representations for a wider range of systems, including those with compositions and products of functions. We demonstrate the ability of the Nested SINDy approach to accurately find symbolic expressions for simple systems, such as basic trigonometric functions, and sparse (false but accurate) analytical representations for more complex systems. Our results highlight Nested SINDy's potential as a tool for symbolic regression, surpassing the traditional SINDy approach in terms of expressivity. However, we also note the challenges in the optimization process for Nested SINDy and suggest future research directions, including the designing of a more robust methodology for the optimization process. This study proves that Nested SINDy can effectively discover symbolic representations of dynamical systems from data, offering new opportunities for understanding complex systems through data-driven methods.

math.NA↗
arXiv2023

Physical Symbolic Optimization

We present a framework for constraining the automatic sequential generation of equations to obey the rules of dimensional analysis by construction. Combining this approach with reinforcement learning, we built $\Phi$-SO, a Physical Symbolic Optimization method for recovering analytical functions from physical data leveraging units constraints. Our symbolic regression algorithm achieves state-of-the-art results in contexts in which variables and constants have known physical units, outperforming all other methods on SRBench's Feynman benchmark in the presence of noise (exceeding 0.1%) and showing resilience even in the presence of significant (10%) levels of noise.

cs.LG↗
arXiv2023

Class Symbolic Regression: Gotta Fit 'Em All

We introduce 'Class Symbolic Regression' (Class SR) a first framework for automatically finding a single analytical functional form that accurately fits multiple datasets - each realization being governed by its own (possibly) unique set of fitting parameters. This hierarchical framework leverages the common constraint that all the members of a single class of physical phenomena follow a common governing law. Our approach extends the capabilities of our earlier Physical Symbolic Optimization ($\Phi$-SO) framework for Symbolic Regression, which integrates dimensional analysis constraints and deep reinforcement learning for unsupervised symbolic analytical function discovery from data. Additionally, we introduce the first Class SR benchmark, comprising a series of synthetic physical challenges specifically designed to evaluate such algorithms. We demonstrate the efficacy of our novel approach by applying it to these benchmark challenges and showcase its practical utility for astrophysics by successfully extracting an analytic galaxy potential from a set of simulated orbits approximating stellar streams.

cs.LG↗
arXiv2023

Charting the Galactic acceleration field II. A global mass model of the Milky Way from the STREAMFINDER Atlas of Stellar Streams detected in Gaia DR3

We present an atlas and follow-up spectroscopic observations of 87 thin stream-like structures detected with the STREAMFINDER algorithm in Gaia DR3, of which 29 are new discoveries. Here we focus on using these streams to refine mass models of the Galaxy. Fits with a double power law halo with the outer power law slope set to $-\beta_h=3$ yield an inner power law slope $-\gamma_h=0.97^{+0.17}_{-0.21}$, a scale radius of $r_{0, h}=14.7^{+4.7}_{-1.0}$ kpc, a halo density flattening $q_{m, h}=0.75\pm0.03$, and a local dark matter density of $\rho_{h, \odot}=0.0114\pm0.0007 {\rm M_\odot pc^{-3}}$. Freeing $\beta$ yields $\beta=2.53^{+0.42}_{-0.16}$, but this value is heavily influenced by our chosen virial mass limit. The stellar disks are found to have a combined mass of $4.20^{+0.44}_{-0.53}\times10^{10} {\rm M_\odot}$, with the thick disk contributing $12.4\pm0.7$\% to the local stellar surface density. The scale length of the thin and thick disks are $2.17^{+0.18}_{-0.08}$ kpc and $1.62^{+0.72}_{-0.13}$ kpc, respectively, while their scale heights are $0.347^{+0.007}_{-0.010}$ kpc and $0.86^{+0.03}_{-0.02}$ kpc, respectively. The virial mass of the favored model is $M_{200}=1.09^{+0.19}_{-0.14}\times 10^{12} {\rm M_\odot}$, while the mass inside of 50 kpc is $M_{R<50}=0.46\pm0.03\times 10^{12} {\rm M_\odot}$. We introduce the Large Magellanic Cloud (LMC) into the derived potential models, and fit the "Orphan" stream therein, finding a mass for the LMC that is consistent with recent estimates. Some highlights of the atlas include the nearby trailing arm of $\omega$-Cen, and a nearby very metal-poor stream that was once a satellite of the Sagittarius dwarf galaxy. Finally, we unambiguously detect a hot component around the GD-1 stream, consistent with it having been tidally pre-processed within its own DM subhalo.

astro-ph.GA↗
arXiv2023

An end-to-end strategy for recovering a free-form potential from a snapshot of stellar coordinates

New large observational surveys such as Gaia are leading us into an era of data abundance, offering unprecedented opportunities to discover new physical laws through the power of machine learning. Here we present an end-to-end strategy for recovering a free-form analytical potential from a mere snapshot of stellar positions and velocities. First we show how auto-differentiation can be used to capture an agnostic map of the gravitational potential and its underlying dark matter distribution in the form of a neural network. However, in the context of physics, neural networks are both a plague and a blessing as they are extremely flexible for modeling physical systems but largely consist in non-interpretable black boxes. Therefore, in addition, we show how a complementary symbolic regression approach can be used to open up this neural network into a physically meaningful expression. We demonstrate our strategy by recovering the potential of a toy isochrone system.

astro-ph.GA↗
arXiv2023

Deep symbolic regression for physics guided by units constraints: toward the automated discovery of physical laws

Symbolic Regression is the study of algorithms that automate the search for analytic expressions that fit data. While recent advances in deep learning have generated renewed interest in such approaches, the development of symbolic regression methods has not been focused on physics, where we have important additional constraints due to the units associated with our data. Here we present $\Phi$-SO, a Physical Symbolic Optimization framework for recovering analytical symbolic expressions from physics data using deep reinforcement learning techniques by learning units constraints. Our system is built, from the ground up, to propose solutions where the physical units are consistent by construction. This is useful not only in eliminating physically impossible solutions, but because the "grammatical" rules of dimensional analysis restrict enormously the freedom of the equation generator, thus vastly improving performance. The algorithm can be used to fit noiseless data, which can be useful for instance when attempting to derive an analytical property of a physical model, and it can also be used to obtain analytical approximations to noisy data. We test our machinery on a standard benchmark of equations from the Feynman Lectures on Physics and other physics textbooks, achieving state-of-the-art performance in the presence of noise (exceeding 0.1%) and show that it is robust even in the presence of substantial (10%) noise. We showcase its abilities on a panel of examples from astrophysics.

astro-ph.IM↗
arXiv2022

Antaeus: a retrograde group of tidal debris in the Milky Way's disk plane

We present the discovery of a wide retrograde moving group in the disk plane of the Milky Way using action-angle coordinates derived from the \textit{Gaia} DR3 catalog. The structure is identified from a sample of its members that are currently almost at the pericenter of their orbit and are passing through the Solar neighborhood. The motions of the stars in this group are highly correlated, indicating that the system is probably not phase mixed. With a width of at least 1.5 kpc and with a probable intrinsic spread in metallicity, this structure is most likely the wide remnant of a tidal stream of a disrupted ancient dwarf galaxy (age $\sim 12$ Gyr, $\langle {\rm [Fe/H]} \rangle \sim -1.74$). The structure presents many similarities (e.g. in energy, angular momentum, metallicity, and eccentricity) with the Sequoia merging event. However, it possesses extremely low vertical action $J_z$ which makes it unique even amongst Sequoia dynamical groups. As the low $J_z$ may be attributable to dynamical friction, we speculate that the these stars may be the remnants of the dense core of the Sequoia progenitor.

astro-ph.GA↗
arXiv2022

Typhon: a polar stream from the outer halo raining through the Solar neighborhood

We report on the discovery in the Gaia DR3 astrometric and spectroscopic catalog of a new polar stream that is found as an over-density in action space. This structure is unique as it has an extremely large apocenter distance, reaching beyond 100 kpc, and yet is detected as a coherent moving structure in the Solar neighborhood with a width of $\sim 4$ kpc. A sub-sample of these stars that was fortuitously observed by LAMOST has a mean spectroscopic metallicity of $\langle {\rm [Fe/H]}\rangle = -1.60^{+0.15}_{-0.16}$ dex and possesses a resolved metallicity dispersion of $\sigma({\rm [Fe/H]}) = 0.32^{+0.17}_{-0.06}$ dex. The physical width of the stream, the metallicity dispersion and the vertical action spread indicate that the progenitor was a dwarf galaxy. The existence of such a coherent and highly radial structure at their pericenters in the vicinity of the Sun suggests that many other dwarf galaxy fragments may be lurking in the outer halo.

astro-ph.GA↗