ArXiv TLDR

General aspects of internal noise in spiking neural networks

🐦 Tweet
2604.13612

I. D. Kolesnikov, D. A. Maksimov, V. M. Moskvitin, N. Semenova

cs.NEnlin.AOphysics.data-an

TLDR

This study identifies critical noise mechanisms in SNNs, showing multiplicative membrane noise is most detrimental and proposing pre-filtering for robustness.

Key contributions

  • Multiplicative noise on membrane potential is most detrimental to SNN performance.
  • This noise suppresses membrane potentials, effectively silencing neuronal activity.
  • Sigmoid-based input pre-filtering effectively mitigates noise impact.
  • SNNs are more robust to common noise across neuron populations.

Why it matters

This paper identifies critical noise mechanisms and locations severely impacting SNN accuracy. Implementing proposed pre-filtering strategies is crucial for designing more robust and reliable spiking neural networks, enhancing their practical utility.

Original Abstract

This study examines the impact of additive and multiplicative noise on both a single leaky integrate-and-fire (LIF) neuron and a trained spiking neural network (SNN). Noise was introduced at different stages of neural processing, including the input current, membrane potential, and output spike generation. The results show that multiplicative noise applied to the membrane potential has the most detrimental effect on network performance, leading to a significant degradation in accuracy. This is primarily due to its tendency to suppress membrane potentials toward large negative values, effectively silencing neuronal activity. To address this issue, input pre-filtering strategies were evaluated, with a sigmoid-based filter demonstrating the best performance by shifting inputs to a strictly positive range. Under these conditions, additive noise in the input current becomes the dominant source of performance degradation, while other noise configurations reduce accuracy by no more than 1\%, even at high noise intensity. Additionally, the study compares the effects of common and uncommon noise across neuron populations in hidden layer, revealing that SNNs exhibit greater robustness to common noise. Overall, the findings identify the most critical noise mechanisms affecting SNNs and provide practical approaches for improving their robustness.

📬 Weekly AI Paper Digest

Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.