arXiv · 1206.4812
A biological gradient descent for prediction through a combination of STDP and homeostatic plasticity
Abstract
Identifying, formalizing and combining biological mechanisms which implement known brain functions, such as prediction, is a main aspect of current research in theoretical neuroscience. In this letter, the mechanisms of Spike Timing Dependent Plasticity (STDP) and homeostatic plasticity, combined in an original mathematical formalism, are shown to shape recurrent neural networks into predictors. Following a rigorous mathematical treatment, we prove that they implement the online gradient descent of a distance between the network activity and its stimuli. The convergence to an equilibrium, where the network can spontaneously reproduce or predict its stimuli, does not suffer from bifurcation issues usually encountered in learning in recurrent neural networks.
Explore related subjects
Keep this discovery
Mathieu Galtier, Gilles Wainrib. 2012-06-21. A biological gradient descent for prediction through a combination of STDP and homeostatic plasticity. https://arxiv.org/abs/1206.4812
Cite the original work for its findings. Save a collection to share your selection of sources.