arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · cond-mat/0109099

Hierarchical Self-Programming in Recurrent Neural Networks

T Uezu·A C C Coolen
View original source ↗Read source document ↗Export metadata ↓

Abstract

We study self-programming in recurrent neural networks where both neurons (the `processors') and synaptic interactions (`the programme') evolve in time simultaneously, according to specific coupled stochastic equations. The interactions are divided into a hierarchy of $L$ groups with adiabatically separated and monotonically increasing time-scales, representing sub-routines of the system programme of decreasing volatility. We solve this model in equilibrium, assuming ergodicity at every level, and find as our replica-symmetric solution a formalism with a structure similar but not identical to Parisi's $L$-step replica symmetry breaking scheme. Apart from differences in details of the equations (due to the fact that here interactions, rather than spins, are grouped into clusters with different time-scales), in the present model the block sizes $m_i$ of the emerging ultrametric solution are not restricted to the interval $[0,1]$, but are independent control parameters, defined in terms of the noise strengths of the various levels in the hierarchy, which can take any value in $[0,\infty\ket$. This is shown to lead to extremely rich phase diagrams, with an abundance of first-order transitions especially when the level of stochasticity in the interaction dynamics is chosen to be low.

Explore related subjects

cond-mat.stat-mechcond-mat.dis-nn

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

T Uezu, A C C Coolen. 2001-09-06. Hierarchical Self-Programming in Recurrent Neural Networks. https://doi.org/10.1088/0305-4470%2F35%2F12%2F306

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Breakdown of Adiabatic Scaling and Noise-induced Functional Synchronization in Deeply Quiescent Excitable Systems

Coherence resonance (CR) characterizes noise-induced regularity in excitable systems, yet its evaluation in quiescent biological media is often obscured by flattened energy landscapes and complex nonlinear dynamics. In this study, we investigate the stochastic dynamics of a 3D Sherman-Rinzel-Keizer (SRK) model driven by multiplicative Feller noise. We show that traditional extremal evaluations of CR encounter a "bathtub effect", a broad resonance valley that can lead to statistical inaccuracies. To address this, we propose a logarithmic centroid extraction method, which filters out stochastic jitter and recovers the underlying adiabatic Kramers scaling with high linearity. Furthermore, we identify the physical boundary where this adiabatic approximation breaks down under the strong-noise limit. Extending our analysis to gap-junction coupled systems, we observe a noise-induced transition from sub-threshold physiological shivering (characterized by statistical correlation but negligible functional output) to macroscopic functional synchronization. Our results provide a mathematical framework for extracting optimal noise intensities in broad energy valleys and offer insights into how quiescent biological systems utilize stochastic fluctuations for functional recovery.

cond-mat.stat-mech↗
arXiv2026

Quantum Stochastic Walks on the Permutation Group

How rapidly does order give way to randomness, and can quantum coherence accelerate this process? We address these questions through the paradigmatic problem of card shuffling, formulated as a random walk on the symmetric group $S_n$. We first recast the random-transposition walk studied by Diaconis and Shahshahani, as well as more general walks generated by conjugacy classes of $S_n$, in continuous time. We then identify the transition matrix of each classical walk with a permutation Hamiltonian generating a corresponding unitary quantum walk. Purely unitary evolution, however, does not generically converge to the uniform distribution in the classical sense of mixing: coherence preserves information rather than erasing it. We therefore embed the problem into a quantum stochastic walk, where coherent dynamics competes with the dissipative process responsible for classical mixing. In this setting, quantum coherence assists randomization. We prove that it can only decrease the distance from the uniform distribution in the computational basis and can therefore accelerate mixing. An analysis of the slowest mode yields a criterion for the coupling strength required to produce an appreciable speedup. Finally, numerical results reveal a scaling collapse of the ratio between quantum and classical mixing times onto a simple one-parameter form. Our results illustrate how coherence and dissipation can cooperate in the emergence of randomness in walks on permutation groups.

cond-mat.stat-mech↗
arXiv2026

Exact Nonperturbative Equilibrium Mode Statistics in Nonlinear Wave and Lattice Systems

We derive exact finite-size nonperturbative representations of equilibrium modal occupations and related statistics for three representative nonlinear systems: the Majda-McLaughlin-Tabak dispersive-wave model, the Fermi-Pasta-Ulam-Tsingou beta anharmonic chain, and the discrete nonlinear Schrodinger lattice field. Independent simulations confirm the predictions from weak to strong nonlinearity. For DNLS, the theory remains accurate across the weak-coupling quasicondensation crossover, where large low-mode occupations and long-range coherence amplify interaction effects even when the bare nonlinear coefficient is small. The finite-ring DNLS occupations are further resolved into a positive sum of Rayleigh-Jeans channels with distinct correlation lengths, explaining when a single Rayleigh-Jeans law applies and why it fails near quasicondensation. In MMT and DNLS, the exact occupations also determine the mean modal frequencies even when the dynamical spectra broaden or split. The nonperturbative results allow a direct assessment of two representative perturbative approaches. Treating the mean interaction appropriately yields accurate low-order approximations, including at strong nonlinearity. At higher orders, however, the corrections cease to decrease and successive approximations oscillate with increasing amplitude; both finite-order approaches also fail near weak-coupling quasicondensation. Thus neither low-order agreement nor a small bare coupling guarantees a reliable perturbative description. The results establish nonperturbative equilibrium theory for widely used nonlinear wave and lattice models and provide a quantitative basis for modal distributions of energy, particles, and optical power in nonlinear optics, dispersive waves, anharmonic lattices, and cold-atom systems.

cond-mat.stat-mech↗