arXiv ScienceSearch

arXiv · cond-mat/0202252

Responses of Ensemble Neurons to Spike-Train Signals with Independent Noises: Stochastic Resonance and Spike Variability

Abstract

Responses have been numerically studied of an ensemble of $N$ (=1, 10, and 100) Hodgkin-Huxley (HH) neurons to coherent spike-train inputs applied with independent Poisson spike-train (ST) noise and Gaussian white noise. Three interrelated issues have been investigated: (1) the difference and the similarity between the effects of the two noises, (2) the size effect of a neuron ensemble on the signal-to-noise ratio (SNR), and (3) the compatibility of a large firing variability with fairly good information transmission. (1) The property of stochastic resonance (SR) for ST noise is shown to be rather different from that for white noise. When SNR for sub-threshold inputs obtained in our simulation is analyzed by the expression given by $SNR=10 {\rm log_{10}} [(A/X^α) {\rm exp}(-B/X)]$ where $X$ expresses the noise intensity and $A$ and $B$ are constants, the index $α$ is $α=3$ for the ST noise and $α=2$ for the white noise: the former is different from the conventional value of $α=2$ realized in many non-linear systems. ST noise works less effectively for SR than white noise. (2) The transmission fidelity evaluated by SNR is much improved by increasing $N$, the size of ensemble neurons. In a large-scale neuron ensemble, SNR for supra-threshold inputs is shown to be not significantly degraded by weak noises responsible to SR for sub-threshold inputs. (3) Interspike intervals (ISIs) of output spikes for sub-threshold inputs have a large variability ($c_{v} \siml 0.8$), which is comparable to the data observed in cortical neurons. Despite variable firings of individual neurons, output signals summed over an ensemble may carry information with a fairly good SNR by the aid of SR and a pooling effect.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Hideo Hasegawa. 2002-02-15. Responses of Ensemble Neurons to Spike-Train Signals with Independent Noises: Stochastic Resonance and Spike Variability. https://arxiv.org/abs/cond-mat/0202252

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

The critical slowing down in training diffusion models

Computational sampling has been central to the sciences since the mid-20th century. While machine-learning-based approaches have recently enabled major advances, their behavior remains poorly understood, with limited theoretical control over when and why they succeed. Here we provide such insight for diffusion models---a class of generative schemes highly effective in practice---by analyzing their application to the $O(n)$ model of statistical field theory in the Gaussian limit $n \to \infty$. In this analytically tractable setting, we show that training a score model with a one-layer network architecture matching the exact solution exhibits a form of critical slowing down in parameter learning. This slowing down also impacts the generation process, indicating that the well-known difficulties of sampling near criticality persist even for learned generative models. To overcome this bottleneck, we consider the power of architectural depth. We find that using a two-layer architecture drastically reduces the critical slowing down, with the training time scaling logarithmically rather than quadratically with system size. Using a Fourier implementation of the architecture, we further show that this acceleration in training time can be achieved without drastically increasing operational complexity. Taken together, these results demonstrate that diffusion models can overcome the critical slowing down through appropriate architectural design, and establish a controlled framework for understanding and improving learned sampling methods in statistical physics and beyond.

cond-mat.dis-nn

Switching diffusivity selects Pareto tail exponent in random growth with redistribution

Random multiplicative growth with redistribution generates stationary Pareto wealth tails in the Bouchaud-Mézard model, but assumes a fixed multiplicative noise intensity. This is restrictive for physical and financial growth processes, where volatility (diffusivity) is often fluctuating. We replace the constant noise intensity by a switching diffusivity and ask how these fluctuations select the Pareto stationary tail. For a geometric Brownian motion with switching diffusivity, the long-time Gaussian limit holds when the redraw law has finite mean and variance. The asymptotic variance retains a contribution from diffusivity persistence. With redistribution and a general redraw law, the stationary large-wealth problem is characterized by a spectral condition for admissible algebraic modes. For a two-state diffusivity, an exact tail analysis gives a Pareto exponent interpolating between the high-diffusivity slow-refresh limit and the mean-diffusivity fast-refresh Bouchaud-Mézard limit.

cond-mat.dis-nn

Signatures of Nonergodicity in Sparse Random Matrices

The prevalence of sparsity in the Fock space graph of interacting many-body systems motivates an investigation into the spectral statistics of sparse random matrices with on-site disorder. We numerically determine the delocalization-localization transition in the ground state as a function of the sparsity. The short-range energy correlation in the bulk indicates that the Anderson transition at infinite temperature occurs at the critical percolation limit of the sparse graph. By analytically deriving the energy moments and calculating the shifted kurtosis, we show that the critical sparsity threshold matches the Anderson transition. Furthermore, long-range energy correlations in the bulk spectrum reveal a Thouless energy scale, suggesting a broad nonergodic regime within the delocalized phase.

cond-mat.dis-nn