arXiv ScienceSearch

arXiv · cond-mat/0701589

Markov vs. nonMarkovian processes A comment on the paper Stochastic feedback, nonlinear families of Markov processes, and nonlinear Fokker-Planck equations by T.D. Frank

Abstract

The purpose of this comment is to correct mistaken assumptions and claims made in the paper Stochastic feedback, nonlinear families of Markov processes, and nonlinear Fokker-Planck equations by T. D. Frank. Our comment centers on the claims of a nonlinear Markov process and a nonlinear Fokker-Planck equation. First, memory in transition densities is misidentified as a Markov process. Second, Frank assumes that one can derive a Fokker-Planck equation from a Chapman-Kolmogorov equation, but no proof was given that a Chapman-Kolmogorov equation exists for memory-dependent processes. A nonlinear Markov process is claimed on the basis of a nonlinear diffusion pde for a 1-point probability density. We show that, regardless of which initial value problem one may solve for the 1-point density, the resulting stochastic process, defined necessarily by the transition probabilities, is either an ordinary linearly generated Markovian one, or else is a linearly generated nonMarkovian process with memory. We provide explicit examples of diffusion coefficients that reflect both the Markovian and the memory-dependent cases. So there is neither a nonlinear Markov process nor nonlinear Fokker-Planck equation for a transition density. The confusion rampant in the literature arises in part from labeling a nonlinear diffusion equation for a 1-point probability density as nonlinear Fokker-Planck, whereas neither a 1-point density nor an equation of motion for a 1-point density defines a stochastic process, and Borland misidentified a translation invariant 1-point density derived from a nonlinear diffusion equation as a conditional probability density. In the Appendix we derive Fokker-Planck pdes and Chapman-Kolmogorov eqns. for stochastic processes with finite memory.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Joseph L. McCauley. 2007-03-13. Markov vs. nonMarkovian processes A comment on the paper Stochastic feedback, nonlinear families of Markov processes, and nonlinear Fokker-Planck equations by T.D. Frank. https://doi.org/10.1016/j.physa.2007.03.020

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Universal sampling of spin systems across quenched disorder

Statistical physics extracts macroscopic laws by averaging over the many microscopic degrees of freedom of a system. Disordered systems demand a second and far harder average, one over the quenched randomness itself. The classic analytical routes, the replica and cavity methods, become uncontrolled outside mean-field or tree-like limits, and conventional numerical algorithms like parallel tempering require expensive, independent equilibration for every disorder realization. In this work, we introduce a universal neural variational framework that amortizes inference across the disorder ensemble, eliminating both the need for per-instance Markov chain equilibration and the cost of retraining instance-specific variational ansatzes. Built on an encoder-decoder Transformer architecture, after training once, it produces an explicit approximation to the Boltzmann distribution given previously unseen disorder realizations without further optimization. We validate this framework on 2D Edwards-Anderson models, and apply it to the random-bond Ising model, successfully capturing the Binder cumulant crossings near the Nishimori multicritical point. These results shift the object of variational inference from the single instance to the disorder ensemble, opening a route to frustrated many-body systems where instance-by-instance computation is prohibitive.

cond-mat.stat-mech

Information-Theoretic Characterization of Macroscopic Chaos Emerging from the Chemical Master Equation

Open chemical reaction networks exhibit stochastic concentration dynamics at finite system sizes, whereas their macroscopic limit is governed by deterministic rate equations that can display chaos. In this Letter, we show theoretically that a rate of information loss constructed from two-time mutual information recovers the Kolmogorov-Sinai entropy in the deterministic limit. We verify this result through numerical simulations of a Markov jump process for a three-species system involving seven reactions.

cond-mat.stat-mech

Orientational order on non-orientable domains

We study the statistical properties of passive and active many-body systems with orientational degrees of freedom on non-orientable domains. By rephrasing topological constraints as non-local symmetry relations on an orientable double-cover, we show that non-orientability eliminates global rotational soft modes without acting like an external field. In a passive XY model, this results in topological caging, where orientational fluctuations that exhibit conventional diffusive behavior on a torus saturate on a Klein bottle to a finite value that we compute exactly in the thermodynamic limit. In models of active self-propelled particles with orientational degrees of freedom, topological caging persists despite continuously changing interaction neighborhoods. In an active Ising spin model, non-orientability enforces the coexistence of ordered anti-parallel domains with vanishing global polar order, a state that is absent on orientable domains.

cond-mat.stat-mech