arXiv subjects

Gabriele Scheler

Publications and source records attributed to Gabriele Scheler.

14 recordsLinked to original sources

arXiv2026

Non-standard memory models with indexed retrieval

The standard memory models for neural networks are variants of the Hopfield network, where feature representations are stored as vectors in a matrix. Retrieval happens based on similarity between an input vector and the set of stored vectors in a content-addressable manner such that the network evolves towards the closest stored attractor. In other words, the useful property of addressing items in memory directly by index is lost in Hopfield-style neural network models ("associative memory"). In this extended abstract, we present a new model which is extremely simple, derived from biological observation, yet introduces a significant conceptual advance and technical benefits. The goal is to establish adaptivity based on the neuron-centric hypothesis: Plasticity is organized by the neuron which regulates its own synapses. Accordingly we implemented a localist, neuron-centric one-shot learning method and applied it to a simple pattern classification problem (MNIST). We were looking for the existence of high information neurons, to act as indices into the representations. The idea was that we would be able to restore full patterns by indexed retrieval, instead of associative vector retrieval from attractors.

q-bio.NC↗

arXiv2022

Sketch of a novel approach to a neural model

We present an account of neuroplasticity with respect to cell-internal processing pathways in relation to membrane and synaptic plasticity. We think traditional synapse-centric, weight-based models of memorization are not sufficient or adequate to capture the complexity of neuroplasticity. In these accounts, the model is a network of neurons connected by adaptive transmission links. The adaptation of the transmission links relies on weight changes according to use of the transmission link (short-term and long-term potentiation/depression). In contrast, we propose a paradigm switch from a synapse-centric model (each synapse learns independently, based on its history of use) to a neuron-centric model (each neuron uses signal selection for intracellular pathways to express plasticity at the membrane). A neural model consists of (a) expression of parameters at the membrane, in particular dendritic synapses or spines, and axonal boutons (b) internal parameters in the sub-membrane zone and the cytoplasm with its protein signaling network and (c) core parameters in the nucleus for genetic and epigenetic information. In a neuron-centric model, each node (=neuron) in the network has its own internal memory. Neural transmission and information storage are separated, not automatically combined by coupling strength. There is filtering and selection of signals for storage. Not every transmission event leaves a trace. This represents an important conceptual advance over synaptic weight models. We present the neuron as a self-programming device, rather than as passively determined by ongoing input. We believe a new approach to neural modeling is necessary, because the experimental evidence is not well captured by traditional synapse-centric models. Ultimately, we are interested in the possibilities of a flexible memory system that processes external signals according to its inherent structure.

q-bio.NC↗

arXiv2019

Neuromodulation Influences Synchronization and Intrinsic Read-out

Background: The roles of neuromodulation in a neural network, such as in a cortical microcolumn, are still incompletely understood. Neuromodulation influences neural processing by presynaptic and postsynaptic regulation of synaptic efficacy. Neuromodulation also affects ion channels and intrinsic excitability. Methods: Synaptic efficacy modulation is an effective way to rapidly alter network density and topology. We alter network topology and density to measure the effect on spike synchronization. We also operate with differently parameterized neuron models which alter the neurons intrinsic excitability, i.e., activation function. Results: We find that (a) fast synaptic efficacy modulation influences the amount of correlated spiking in a network. Also, (b) synchronization in a network influences the read-out of intrinsic properties. Highly synchronous input drives neurons, such that differences in intrinsic properties disappear, while asynchronous input lets intrinsic properties determine output behavior. Thus, altering network topology can alter the balance between intrinsically vs. synaptically driven network activity. Conclusion: We conclude that neuromodulation may allow a network to shift between a more synchronized transmission mode and a more asynchronous intrinsic read-out mode. This has significant implications for our understanding of the flexibility of cortical computations.

q-bio.NC↗

arXiv2017

Logarithmic distributions prove that intrinsic learning is Hebbian

In this paper, we present data for the lognormal distributions of spike rates, synaptic weights and intrinsic excitability (gain) for neurons in various brain areas, such as auditory or visual cortex, hippocampus, cerebellum, striatum, midbrain nuclei. We find a remarkable consistency of heavy-tailed, specifically lognormal, distributions for rates, weights and gains in all brain areas examined. The difference between strongly recurrent and feed-forward connectivity (cortex vs. striatum and cerebellum), neurotransmitter (GABA (striatum) or glutamate (cortex)) or the level of activation (low in cortex, high in Purkinje cells and midbrain nuclei) turns out to be irrelevant for this feature. Logarithmic scale distribution of weights and gains appears to be a general, functional property in all cases analyzed. We then created a generic neural model to investigate adaptive learning rules that create and maintain lognormal distributions. We conclusively demonstrate that not only weights, but also intrinsic gains, need to have strong Hebbian learning in order to produce and maintain the experimentally attested distributions. This provides a solution to the long-standing question about the type of plasticity exhibited by intrinsic excitability.

q-bio.NC↗

arXiv2016

Dopamine modulation of prefrontal delay activity-reverberatory activity and sharpness of tuning curves

Recent electrophysiological experiments have shown that dopamine (D1) modulation of pyramidal cells in prefrontal cortex reduces spike frequency adaptation and enhances NMDA transmission. Using four models, from multicompartmental to integrate and fire, we examine the effects of these modulations on sustained (delay) activity in a reverberatory network. We find that D1 modulation may enable robust network bistability yielding selective reverberation among cells that code for a particular item or location. We further show that the tuning curve of such cells is sharpened, and that signal-to-noise ratio is increased. We postulate that D1 modulation affects the tuning of "memory fields" and yield efficient distributed dynamic representations.

q-bio.NC↗

arXiv2013

Transfer Functions for Protein Signal Transduction: Application to a Model of Striatal Neural Plasticity

We present a novel formulation for biochemical reaction networks in the context of signal transduction. The model consists of input-output transfer functions, which are derived from differential equations, using stable equilibria. We select a set of 'source' species, which receive input signals. Signals are transmitted to all other species in the system (the 'target' species) with a specific delay and transmission strength. The delay is computed as the maximal reaction time until a stable equilibrium for the target species is reached, in the context of all other reactions in the system. The transmission strength is the concentration change of the target species. The computed input-output transfer functions can be stored in a matrix, fitted with parameters, and recalled to build discrete dynamical models. By separating reaction time and concentration we can greatly simplify the model, circumventing typical problems of complex dynamical systems. The transfer function transformation can be applied to mass-action kinetic models of signal transduction. The paper shows that this approach yields significant insight, while remaining an executable dynamical model for signal transduction. In particular we can deconstruct the complex system into local transfer functions between individual species. As an example, we examine modularity and signal integration using a published model of striatal neural plasticity. The modules that emerge correspond to a known biological distinction between calcium-dependent and cAMP-dependent pathways. We also found that overall interconnectedness depends on the magnitude of input, with high connectivity at low input and less connectivity at moderate to high input. This general result, which directly follows from the properties of individual transfer functions, contradicts notions of ubiquitous complexity by showing input-dependent signal transmission inactivation.

q-bio.MN↗

arXiv2013

Self-organization of signal transduction

We propose a model of parameter learning for signal transduction, where the objective function is defined by signal transmission efficiency. We apply this to learn kinetic rates as a form of evolutionary learning, and look for parameters which satisfy the objective. This is a novel approach compared to the usual technique of adjusting parameters only on the basis of experimental data. The resulting model is self-organizing, i.e. perturbations in protein concentrations or changes in extracellular signaling will automatically lead to adaptation. We systematically perturb protein concentrations and observe the response of the system. We find compensatory or co-regulation of protein expression levels. In a novel experiment, we alter the distribution of extracellular signaling, and observe adaptation based on optimizing signal transmission. We also discuss the relationship between signaling with and without transients. Signaling by transients may involve maximization of signal transmission efficiency for the peak response, but a minimization in steady-state responses. With an appropriate objective function, this can also be achieved by concentration adjustment. Self-organizing systems may be predictive of unwanted drug interference effects, since they aim to mimic complex cellular adaptation in a unified way.

q-bio.MN↗

arXiv2012

Learning intrinsic excitability in medium spiny neurons

We present an unsupervised, local activation-dependent learning rule for intrinsic plasticity (IP) which affects the composition of ion channel conductances for single neurons in a use-dependent way. We use a single-compartment conductance-based model for medium spiny striatal neurons in order to show the effects of parametrization of individual ion channels on the neuronal activation function. We show that parameter changes within the physiological ranges are sufficient to create an ensemble of neurons with significantly different activation functions. We emphasize that the effects of intrinsic neuronal variability on spiking behavior require a distributed mode of synaptic input and can be eliminated by strongly correlated input. We show how variability and adaptivity in ion channel conductances can be utilized to store patterns without an additional contribution by synaptic plasticity (SP). The adaptation of the spike response may result in either "positive" or "negative" pattern learning. However, read-out of stored information depends on a distributed pattern of synaptic activity to let intrinsic variability determine spike response. We briefly discuss the implications of this conditional memory on learning and addiction.

q-bio.NC↗

arXiv2006

Dynamic re-wiring of protein interaction: The case of transactivation

We are looking at local protein interaction networks from the perspective of directed, labeled graphs with quantitative values for monotonic changes in concentrations. These systems can be used to perform stability analysis for a stable attractor, given initial values. They can also show re-configuration of whole system states by dynamic insertion of links, given specific patterns of input. The latter issue seems particularly relevant for the concept of multistability in cellular memory. We attempt to show that this level of analysis is well-suited for a number of relevant biological subsystems, such as transactivation in cardiac myocytes or G-protein coupling to adrenergic receptors. In particular, we analyse the 'motif' of an "overflow gate" as a concentration-dependent system reconfiguration.

q-bio.MN↗

arXiv2005

Extracellular-to-intracellular signal transfer via G-proteins

We look at the problem of signal transduction by extracellular agonist binding to a receptor protein at the membrane (sensor) via binding of G-proteins (effectors) to a highly integrative target molecule, such as the second messenger cAMP (target). We explore the effects of binding times, effector assignment and effector pool size on the shape of the output signal under different input scenarios. We conclude that low rates of information transfer may sometimes coincide with a high probability or efficiency of plasticity induction.

q-bio.MN↗

arXiv2004

Memorization in a neural network with adjustable transfer function and conditional gating

The main problem about replacing LTP as a memory mechanism has been to find other highly abstract, easily understandable principles for induced plasticity. In this paper we attempt to lay out such a basic mechanism, namely intrinsic plasticity. Important empirical observations with theoretical significance are time-layering of neural plasticity mediated by additional constraints to enter into later stages, various manifestations of intrinsic neural properties, and conditional gating of synaptic connections. An important consequence of the proposed mechanism is that it can explain the usually latent nature of memories.

q-bio.NC↗

arXiv2004

Regulation of Neuromodulator Receptor Efficacy - Implications for Whole-Neuron and Synaptic Plasticity

Membrane receptors for neuromodulators (NM) are highly regulated in their distribution and efficacy - a phenomenon which influences the individual cell's response to central signals of NM release. Even though NM receptor regulation is implicated in the pharmacological action of many drugs, and is also known to be influenced by various environmental factors, its functional consequences and modes of action are not well understood. In this paper we summarize relevant experimental evidence on NM receptor regulation (specifically dopamine D1 and D2 receptors) in order to explore its significance for neural and synaptic plasticity. We identify the relevant components of NM receptor regulation (receptor phosphorylation, receptor trafficking and sensitization of second-messenger pathways) gained from studies on cultured cells. Key principles in the regulation and control of short-term plasticity (sensitization) are identified, and a model is presented which employs direct and indirect feedback regulation of receptor efficacy. We also discuss long-term plasticity which involves shifts in receptor sensitivity and loss of responsivity to NM signals. Finally, we discuss the implications of NM receptor regulation for models of brain plasticity and memorization. We emphasize that a realistic model of brain plasticity will have to go beyond Hebbian models of long-term potentiation and depression. Plasticity in the distribution and efficacy of NM receptors may provide another important source of functional plasticity with implications for learning and memory.

q-bio.MN↗

arXiv2004

Presynaptic modulation as fast synaptic switching: state-dependent modulation of task performance

Neuromodulatory receptors in presynaptic position have the ability to suppress synaptic transmission for seconds to minutes when fully engaged. This effectively alters the synaptic strength of a connection. Much work on neuromodulation has rested on the assumption that these effects are uniform at every neuron. However, there is considerable evidence to suggest that presynaptic regulation may be in effect synapse-specific. This would define a second "weight modulation" matrix, which reflects presynaptic receptor efficacy at a given site. Here we explore functional consequences of this hypothesis. By analyzing and comparing the weight matrices of networks trained on different aspects of a task, we identify the potential for a low complexity "modulation matrix", which allows to switch between differently trained subtasks while retaining general performance characteristics for the task. This means that a given network can adapt itself to different task demands by regulating its release of neuromodulators. Specifically, we suggest that (a) a network can provide optimized responses for related classification tasks without the need to train entirely separate networks and (b) a network can blend a "memory mode" which aims at reproducing memorized patterns and a "novelty mode" which aims to facilitate classification of new patterns. We relate this work to the known effects of neuromodulators on brain-state dependent processing.

cs.NE↗

arXiv1996

With raised eyebrows or the eyebrows raised ? A Neural Network Approach to Grammar Checking for Definiteness

In this paper, we use a feature model of the semantics of plural determiners to present an approach to grammar checking for definiteness. Using neural network techniques, a semantics -- morphological category mapping was learned. We then applied a textual encoding technique to the 125 occurences of the relevant category in a 10 000 word narrative text and learned a surface -- semantics mapping. By applying the learned generation function to the newly generated representations, we achieved a correct category assignment in many cases (87 %). These results are considerably better than a direct surface categorization approach (54 %), with a baseline (always guessing the dominant category) of 60 %. It is discussed, how these results could be used in multilingual NLP applications.

cmp-lg↗