arXiv ScienceSearch

arXiv subjects

Flaviano Morone

Publications and source records attributed to Flaviano Morone.

At least 19 recordsLinked to original sources

Prospective Coding Improves Learning in Deep Continuous-Time Recurrent Networks

Temporal integration gives continuous-time recurrent networks memory, but in deep stacks it also delays bottom-up signals and attenuates top-down errors. We develop Recursive Quadrature Filters (RQFs), biologically motivated complex-valued temporal filters that are a special case of diagonal state-space models (SSMs), and ask whether this failure mode can be addressed by making each layer's bottom-up input prospective. Starting from an energy model, we derive the RQF dynamics and show that each RQF is a band-pass filter whose learnable parameters control its tuning frequency and bandwidth. We then make each layer's bottom-up input prospective using a parameter-free two-tap update that leaves the recurrent transition and parallel scan unchanged. We extend this correction to general diagonal SSMs and show that it mitigates depth-dependent gradient attenuation when temporal gradients are truncated, i.e., spatial-only backpropagation. We evaluate the intervention in RQFs, S5, and ORGaNICs (a nonlinear gated RNN) trained using full backpropagation through time (BPTT) and spatial-only backpropagation. Under full BPTT, prospective variants match or outperform their non-prospective controls in every model and configuration. A non-residual width-32 six-layer RQF reaches 96.09% accuracy on raw-audio Speech Commands with 31.9k parameters; a width-64 six-layer RQF reaches 83.56% on the 16,384-step Path-X task. These results identify RQFs as a parameter-efficient recurrent substrate and prospective-input coding as an input-side correction for deep continuous-time recurrent networks.

cs.LG

A minimal mechanism to generate long timescales without fine tuning

Long timescales in brain dynamics give rise to power law correlations measured in experiments. A simple linear recurrent neural network model can reproduce this power law behavior, but the recurrent interaction strength needs to be fine tuned in order to sit at the edge of stability. We show that by adding a dynamical recurrent feedback gain to the simple linear model removes the need for fine tuning, because the gain self-organizes so that the spectrum of the effective recurrent matrix is always gapless with the top eigenvalue landing on the stability edge for any recurrent strength. As a consequence, long timescales and scale free correlations arise generically, as we demonstrate both analytically and numerically.

cond-mat.dis-nn

Absence of quantum advantage for approximate spin glass optimization

We perform a semiclassical, large-spin S, analysis of the quantum approximate optimization algorithm (QAOA) on the Sherrington-Kirkpatrick (SK) model, using the truncated Wigner approximation. Fixing the QAOA angles to their previously determined optimal S=1/2 values, we observe a non-monotonic dependence of the final energy on the spin. At small S the semiclassics is dominated by noise, while the large-S limit is constrained by the exponential growth of the initial fluctuations. For a depth-p QAOA one achieves the optimal balance at S of order p, resulting in a convergence of the final energy to the Parisi value like log(p)/p. We find that the semiclassics slightly outperforms the true spin-1/2 QAOA, and thus suggest they both converge to the Parisi value in the same way. Finally, removing all the initial noise, and re-optimizing the parameters to account for that change, results in superior performance with 1/p convergence.

quant-ph

Fundamental Limits of Stability Inference in High-Dimensional Complex Systems

Many complex systems, including ecosystems, neural circuits, and financial markets, are inferred to operate close to a threshold of instability, at which a small perturbation can propagate across the entire system. This proximity is often interpreted as functionally advantageous, yet it poses a question common to all these fields: from a finite, noisy recording, how precisely can the distance of a system from that threshold be estimated? Using the multivariate Ornstein-Uhlenbeck process as the canonical linear model of relaxation near a stable fixed point, we show that the attainable precision is governed by three factors: an effective measurement budget, set by the number of samples relative to the system dimension and the sampling interval; the signal-to-noise ratio, given by the magnitude of deterministic interactions relative to stochastic forcing; and the distance to criticality, which simultaneously sets the system's correlation times and degrades both of the preceding factors. As the slowest dynamical mode softens near the threshold, the curvature of the log-likelihood flattens along the direction that determines stability, so that the relative uncertainty on the estimated distance diverges as that distance vanishes. Critically, temporal correlations near instability reduce the effective number of independent observations far below the nominal sample count, and inference breaks down when this effective count falls below the system dimension, even when the raw data volume appears sufficient. A direct consequence is the existence of an optimal sampling interval that diverges as the system approaches criticality, with practical implications for experimental design.

cond-mat.dis-nn

Exact Variance and Fano Factor for Arbitrary Level Crossings in Stationary Gaussian Processes

Understanding the statistics of level crossings in stochastic processes is crucial across many scientific disciplines. The traditional Kac-Rice formula gives the mean rate of level crossings and has found broad use. However, that mean rate captures only a coarse summary of the crossing process. It depends entirely on local properties of the stochastic process at a given instant and is therefore blind to the correlation structure of the process over time. To understand whether crossing events, such as neuronal spikes, tend to cluster in time, spread apart, or exhibit more complex temporal organization, one must go beyond the mean rate and study higher-order crossing statistics. Here we go beyond the mean by deriving the exact analytical formulae for the variance and Fano factor of arbitrary level crossings in smooth stationary Gaussian processes. Our exact solution reveals how the full temporal correlation structure dictates whether crossings cluster or become regular. In systems with oscillatory correlations, such as a stochastic damped harmonic oscillator, a recent crossing suppresses an immediate subsequent one, producing sub-Poissonian statistics. However, as damping increases and oscillations disappear, a large and slow excursion above the threshold can produce multiple closely spaced crossings, yielding super-Poissonian statistics. In purely relaxational, non-oscillatory systems, such as a mean-reverting process driven by Ornstein-Uhlenbeck noise, the competition between the timescales of the driving noise and system relaxation produces a richer landscape, including reentrant transitions between sub- and super-Poissonian statistics as the threshold level is varied. Taken together, the exact variance and Fano factor derived here complement the Kac-Rice mean rate, enabling more robust parameter estimation and model selection across any setting where Gaussian processes are used.

math.PR

Variational Iterative Rotation Algorithm: Combinatorial Optimization with Classical Kicked Tops

We investigate a classical formulation of the Quantum Approximate Optimization Algorithm (QAOA), realized as a Hamiltonian dynamical system of classical kicked tops, which we call the Variational Iterative Rotation Algorithm (VIRAL). The variational parameters are the transverse and longitudinal rotation angles at each of the p layers of the circuit. We find that VIRAL outperforms QAOA on the canonical Sherrington-Kirkpatrick spin-glass benchmark at all circuit depths, with the energy density converging to the ground state value linearly in 1/p. For large circuit depths, the optimized dynamics follows a Floquet protocol in which a pitchfork bifurcation destabilizes the equatorial fixed point and drives the spins toward polar Ising configurations. Our results demonstrate that the effectiveness of QAOA-like protocols derives primarily from their underlying iterative rotation structure, and that a classical implementation of it outperforms its quantum counterpart. We further elucidate its efficiency by reducing the many-body classical evolution to an effective Landau-Lifshitz dynamics for a single spin in a stochastic magnetic field. In this picture, the covariance matrix of the effective field reveals a nearly rank-one structure in which a single mode dominates the stochastic dynamics. In contrast, quantum fluctuations make the noise covariance of the effective quantum model of higher rank, hampering the control of the system. We propose nanometer-scale magnetic tunnel junctions as a natural physical platform for implementing VIRAL, where spin rotations can be realized using magnetic fields and spin torques.

cond-mat.dis-nn

Probabilistic approximate optimization using single-photon avalanche diode arrays

Combinatorial optimization problems are central to science and engineering and specialized hardware from quantum annealers to classical Ising machines are being actively developed to address them. These systems typically sample from a fixed energy landscape defined by the problem Hamiltonian encoding the discrete optimization problem. The recently introduced Probabilistic Approximate Optimization Algorithm (PAOA) takes a different approach: it treats the optimization landscape itself as variational, iteratively learning circuit parameters from samples. Here, we demonstrate PAOA on a 64$\times$64 perimeter-gated single-photon avalanche diode (pgSPAD) array fabricated in 0.35 $μ$m CMOS, the first realization of the algorithm using intrinsically stochastic nanodevices. Each p-bit exhibits a device-specific, asymmetric (Gompertz-type) activation function due to dark-count variability. Rather than calibrating devices to enforce a uniform symmetric (logistic/tanh) activation, PAOA learns around device variations, absorbing residual activation and other mismatches into the variational parameters. On canonical 26-spin Sherrington-Kirkpatrick instances, PAOA achieves high approximation ratios with $2p$ parameters ($p$ up to 17 layers), and pgSPAD-based inference closely tracks CPU simulations. These results show that variational learning can accommodate the non-idealities inherent to nanoscale devices, suggesting a practical path toward larger-scale, CMOS-compatible probabilistic computers.

cs.ET

Switching Characteristics of Electrically Connected Stochastically Actuated Magnetic Tunnel Junction Nanopillars

We investigate the stochastic dynamics of nanoscale perpendicular magnetic tunnel junctions (pMTJs) and the correlations that arise when they are electrically coupled. Individual junctions exhibit thermally activated spin-transfer torque switching with transition probabilities that are well described by a Poisson process. When two junctions are connected in parallel, circuit-mediated redistribution of voltages that occurs in real time as the junction resistances change leads to correlated switching behavior. A minimal stochastic model based on single-junction statistical switching properties and Kirchhoff's laws captures the coupled switching probabilities, while a Markov-chain formalism describes nonequilibrium steady states under multi-pulse driving. Further, these circuit-mediated interactions can be mapped onto the parameters of an Ising Hamiltonian, providing an interpretation in terms of effective spin-spin interactions. Our results demonstrate how simple electrical connections can generate Ising-like couplings and tunable stochastic dynamics in nanoscale magnets.

cond-mat.mes-hall

Generalized Probabilistic Approximate Optimization Algorithm

We introduce a generalized \textit{Probabilistic Approximate Optimization Algorithm (PAOA)}, a classical variational Monte Carlo framework that extends and formalizes prior work by Weitz \textit{et al.}~\cite{Combes_2023}, enabling parameterized and fast sampling on present-day Ising machines and probabilistic computers. PAOA operates by iteratively modifying the couplings of a network of binary stochastic units, guided by cost evaluations from independent samples. We establish a direct correspondence between derivative-free updates and the gradient of the full Markov flow over the exponentially large state space, showing that PAOA admits a principled variational formulation. Simulated annealing emerges as a limiting case under constrained parameterizations, and we implement this regime on an FPGA-based probabilistic computer with on-chip annealing to solve large 3D spin-glass problems. Benchmarking PAOA against QAOA on the canonical 26-spin Sherrington-Kirkpatrick model with matched parameters reveals superior performance for PAOA. We show that PAOA naturally extends simulated annealing by optimizing multiple temperature profiles, leading to improved performance over SA on heavy-tailed problems such as SK-Lévy.

cond-mat.dis-nn

How low-cost AI universal approximators reshape market efficiency

The efficient market hypothesis (EMH) famously stated that prices fully reflect the information available to traders. This critically depends on the transfer of information into prices through trading strategies. Traders optimise their strategy with models of increasing complexity that identify the relationship between information and profitable trades more and more accurately. Under specific conditions, the increased availability of low-cost universal approximators, such as AI systems, should be naturally pushing towards more advanced trading strategies, potentially making it harder and harder for inefficient traders to profit. In this paper, we leverage on a generalised notion of market efficiency, based on the definition of an equilibrium price process, that allows us to distinguish different levels of model complexity through investors' beliefs, and trading strategies optimisation, and discuss the relationship between AI-powered trading and the time-evolution of market efficiency. Finally, we outline the need for and the challenge of describing out-of-equilibrium market dynamics in an adaptive multi-agent environment.

q-fin.MF

A Toffoli Gadget for Magnetic Tunnel Junctions Boltzmann Machines

Magnetic Tunnel Junctions (MTJs) are of great interest for non-conventional computing applications. The Toffoli gate is a universal reversible logic gate, enabling the construction of arbitrary boolean circuits. Here, we present a proof-of-concept construction of a gadget which encodes the Toffoli gate's truth table into the ground state of coupled uniaxial nanomagnets that could form the free layers of perpendicularly magnetized MTJs. This construction has three input bits, three output bits, and one ancilla bit. We numerically simulate the seven macrospins evolving under the stochastic Landau-Lifshitz-Gilbert (s-LLG) equation. We investigate the effect of the anisotropy-to-exchange-coupling strength ratio $H_A/H_\text{ex}$ on the working of the gadget. We find that for $H_A/H_\text{ex} \lesssim 0.93$, the spins evolve to the Toffoli gate truth table configurations under LLG dynamics alone, while higher $H_A/H_\text{ex}$ ratios require thermal annealing due to suboptimal metastable states. Under our chosen annealing procedure, the s-LLG simulation with thermal annealing achieves a 100% success rate up to $H_A/H_\text{ex}\simeq3.0$. The feasibility of constructing MTJ-free-layer-based Toffoli gates highlights their potential in designing new types of MTJ-based circuits.

cond-mat.mes-hall

Re-entrant phase transitions induced by localization of zero-modes

Common wisdom dictates that physical systems become less ordered when heated to higher temperature. However, several systems display the opposite phenomenon and move to a more ordered state upon heating, e.g. at low temperature piezoelectric quartz is paraelectric and it only becomes piezoelectric when heated to sufficiently high temperature. The presence, or better, the re-entrance of unordered phases at low temperature is more prevalent than one might think. Although specific models have been developed to understand the phenomenon in specific systems, a universal explanation is lacking. Here we propose a universal simple microscopic theory which predicts the existence of two critical temperatures in inhomogeneous systems, where the lower one marks the re-entrance into the less ordered phase. We show that the re-entrant phase transition is caused by disorder-induced spatial localization of the zero-mode on a finite, i.e. sub-extensive, region of the system. Specifically, this trapping of the zero-mode disconnects the fluctuations of the order parameter in distant regions of the system, thus triggering the loss of long-range order and the re-entrance into the disordered phase. This makes the phenomenon quite universal and robust to the underlying details of the model, and explains its ubiquitous observation.

cond-mat.dis-nn

Predicting public market behavior from private equity deals

We process private equity transactions to predict public market behavior with a logit model. Specifically, we estimate our model to predict quarterly returns for both the broad market and for individual sectors. Our hypothesis is that private equity investments (in aggregate) carry predictive signal about publicly traded securities. The key source of such predictive signal is the fact that, during their diligence process, private equity fund managers are privy to valuable company information that may not yet be reflected in the public markets at the time of their investment. Thus, we posit that we can discover investors' collective near-term insight via detailed analysis of the timing and nature of the deals they execute. We evaluate the accuracy of the estimated model by applying it to test data where we know the correct output value. Remarkably, our model performs consistently better than a null model simply based on return statistics, while showing a predictive accuracy of up to 70% in sectors such as Consumer Services, Communications, and Non Energy Minerals.

q-fin.CP

Solving combinatorial optimization problems through stochastic Landau-Lifshitz-Gilbert dynamical systems

We present a method to approximately solve general instances of combinatorial optimization problems using the physical dynamics of 3d rotors obeying Landau-Lifshitz-Gilbert dynamics. Conventional techniques to solve discrete optimization problems that use simple continuous relaxation of the objective function followed by gradient descent minimization are inherently unable to avoid local optima, thus producing poor-quality solutions. Our method considers the physical dynamics of macrospins capable of escaping from local minima, thus facilitating the discovery of high-quality, nearly optimal solutions, as supported by extensive numerical simulations on a prototypical quadratic unconstrained binary optimization (QUBO) problem. Our method produces solutions that compare favorably with those obtained using state-of-the-art minimization algorithms (such as simulated annealing) while offering the advantage of being physically realizable by means of arrays of stochastic magnetic tunnel junction devices.

cond-mat.dis-nn

Equivalence between the Fitness-Complexity and the Sinkhorn-Knopp algorithms

We uncover the connection between the Fitness-Complexity algorithm, developed in the economic complexity field, and the Sinkhorn-Knopp algorithm, widely used in diverse domains ranging from computer science and mathematics to economics. Despite minor formal differences between the two methods, both converge to the same fixed-point solution up to normalization. The discovered connection allows us to derive a rigorous interpretation of the Fitness and the Complexity metrics as the potentials of a suitable energy function. Under this interpretation, high-energy products are unfeasible for low-fitness countries, which explains why the algorithm is effective at displaying nested patterns in bipartite networks. We also show that the proposed interpretation reveals the scale invariance of the Fitness-Complexity algorithm, which has practical implications for the algorithm's implementation in different datasets. Further, analysis of empirical trade data under the new perspective reveals three categories of countries that might benefit from different development strategies.

econ.GN

Ranking species in complex ecosystems through nestedness maximization

Identifying the rank of species in a social or ecological network is a difficult task, since the rank of each species is invariably determined by complex interactions stipulated with other species. Simply put, the rank of a species is a function of the ranks of all other species through the adjacency matrix of the network. A common system of ranking is to order species in such a way that their neighbours form maximally nested sets, a problem called nested maximization problem (NMP). Here we show that the NMP can be formulated as an instance of the Quadratic Assignment Problem, one of the most important combinatorial optimization problem widely studied in computer science, economics, and operations research. We tackle the problem by Statistical Physics techniques: we derive a set of self-consistent nonlinear equations whose fixed point represents the optimal rankings of species in an arbitrary bipartite mutualistic network, which generalize the Fitness-Complexity equations widely used in the field of economic complexity. Furthermore, we present an efficient algorithm to solve the NMP that outperforms state-of-the-art network-based metrics and genetic algorithms. Eventually, our theoretical framework may be easily generalized to study the relationship between ranking and network structure beyond pairwise interactions, e.g. in higher-order networks.

cond-mat.stat-mech

Unveiling Order from Chaos by approximate 2-localization of random matrices

Quantum many-body systems are typically endowed with a tensor product structure. This structure is inherited from probability theory, where the probability of two independent events is the product of the probabilities. The tensor product structure of a Hamiltonian thus gives a natural decomposition of the system into independent smaller subsystems. Considering a particular Hamiltonian and a particular tensor product structure, one can ask: is there a basis in which this Hamiltonian has this desired tensor product structure? In particular, we ask: is there a basis in which an arbitrary Hamiltonian has a 2-local form, i.e. it contains only pairwise interactions? Here we show, using numerical and analytical arguments, that generic Hamiltonian (e.g. a large random matrix) can approximately be written as a linear combination of two-body interactions terms with high precision; that is the Hamiltonian is 2-local in a carefully chosen basis. We show that these Hamiltonians are robust to perturbations. Taken together, our results suggest a possible mechanism for the emergence of locality from chaos.

quant-ph

Clustering matrices through optimal permutations

Matrices are two-dimensional data structures allowing one to conceptually organize information. For example, adjacency matrices are useful to store the links of a network; correlation matrices are simple ways to arrange gene co-expression data or correlations of neuronal activities. Clustering matrix values into geometric patterns that are easy to interpret helps us to understand and explain the functional and structural organization of the system components described by matrix entries. Here we introduce a theoretical framework to cluster a matrix into a desired pattern by performing a similarity transformation obtained by solving a minimization problem named the optimal permutation problem. On the computational side, we present a fast clustering algorithm that can be applied to any type of matrix, including non-normal and singular matrices. We apply our algorithm to the neuronal correlation matrix and the synaptic adjacency matrix of the Caenorhabditis elegans nervous system by performing different types of clustering, including block-diagonal, nested, banded, and triangular patterns. Some of these clustering patterns show their biological significance in that they separate matrix entries into groups that match the experimentally known classification of C. elegans neurons into four broad categories, namely: interneurons, motor, sensory, and polymodal neurons.

cond-mat.dis-nn