arXiv · 2408.17245
TMN: A Lightweight Neuron Model for Efficient Nonlinear Spike Representation
Abstract
Spike trains serve as the primary medium for information transmission in Spiking Neural Networks, playing a crucial role in determining system efficiency. Existing encoding schemes based on spike counts or timing often face severe limitations under low-timestep constraints, while more expressive alternatives typically involve complex neuronal dynamics or system designs, which hinder scalability and practical deployment. To address these challenges, we propose the Ternary Momentum Neuron (TMN), a novel neuron model featuring two key innovations: (1) a lightweight momentum mechanism that realizes exponential input weighting by doubling the membrane potential before integration, and (2) a ternary predictive spiking scheme which employs symmetric sub-thresholds $\pm\frac{1}{2}v_{th}$ to enable early spiking and correct over-firing. Extensive experiments across diverse tasks and network architectures demonstrate that the proposed approach achieves high-precision encoding with significantly fewer timesteps, providing a scalable and hardware-aware solution for next-generation SNN computing.
Explore related subjects
Keep this discovery
Yiwen Gu, Junchuan Gu, Haibin Shen, Kejie Huang. 2024-08-30. TMN: A Lightweight Neuron Model for Efficient Nonlinear Spike Representation. https://arxiv.org/abs/2408.17245
Cite the original work for its findings. Save a collection to share your selection of sources.