This repo collects papers, docs, codes about spiking neural networks for anyone who wants to do research on it. We are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo. Special thanks to Dayong Ren, Qianpeng Li, and all researchers who have contributed to this project!
Our survey paper Direct Learning-Based Deep Spiking Neural Networks: A Review (Frontiers in Neuroscience) is a comprehensive survey of recent progress in directly training spiking neural networks. For details, please refer to:
Direct Learning-Based Deep Spiking Neural Networks: A Review [Paper]
Yufei Guo, Xuhui Huang, and Zhe Ma.
Bibtex
@article{guo2023direct,
title={Direct learning-based deep spiking neural networks: a review},
author={Guo, Yufei and Huang, Xuhui and Ma, Zhe},
journal={Frontiers in Neuroscience},
volume={17},
pages={1209795},
year={2023},
publisher={Frontiers}
}The survey paper
- [IJCAI] Apprenticeship-Inspired Elegance: Synergistic Knowledge Distillation Empowers Spiking Neural Networks for Efficient Single-Eye Emotion Recognition
- [IJCAI] One-step Spiking Transformer with a Linear Complexity
- [IJCAI] TIM: An Efficient Temporal Interaction Module for Spiking Transformer
- [IJCAI] Learning a Spiking Neural Network for Efficient Image Deraining
- [IJCAI] LitE-SNN: Designing Lightweight and Efficient Spiking Neural Network through Spatial-Temporal Compressive Network Search and Joint Optimization
- [IJCAI] EC-SNN: Splitting Deep Spiking Neural Networks for Edge Devices [code]
- [ICML] Temporal Spiking Neural Networks with Synaptic Delay for Graph Reasoning
- [ICML] Towards efficient deep spiking neural networks construction with spiking activity based pruning
- [ICML] Efficient and Effective Time-Series Forecasting with Spiking Neural Networks
- [ICML] Autaptic Synaptic Circuit Enhances Spatio-temporal Predictive Learning of Spiking Neural Networks
- [ICML] Robust Stable Spiking Neural Networks
- [ICML] CLIF: Complementary Leaky Integrate-and-Fire Neuron for Spiking Neural Networks [code]
- [ICML] NDOT: Neuronal Dynamics-based Online Training for Spiking Neural Networks
- [ICML] High-Performance Temporal Reversible Spiking Neural Networks with
$\mathcal{O}(L)$ Training Memory and$\mathcal{O}(1)$ Inference Cost - [ICML] Towards Efficient Spiking Transformer: a Token Sparsification Framework for Training and Inference Acceleration
- [ICML] SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms
- [ICML] Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Network
- [ICML] Enhancing Adversarial Robustness in SNNs with Sparse Gradients
- [ICML] SpikeZIP-TF: Conversion is All You Need for Transformer-based SNN
- [CVPR] SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networks [code]
- [CVPR] Are Conventional SNNs Really Efficient? A Perspective from Network Quantization
- [AAAI] Ternary Spike: Learning Ternary Spikes for Spiking Neural Networks [code]
- [AAAI] Memory-Efficient Reversible Spiking Neural Networks [code]
- [AAAI] Gated Attention Coding for Training High-performance and Efficient Spiking Neural Networks [code]
- [AAAI] SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation [code]
- [AAAI] TC-LIF: A Two-Compartment Spiking Neuron Model for Long-term Sequential Modelling [code]
- [AAAI] Spiking NeRF: Representing the Real-World Geometry by a Discontinuous Representation [code]
- [AAAI] An Efficient Knowledge Transfer Strategy for Spiking Neural Networks from Static to Event Domain [code]
- [AAAI] Shrinking Your TimeStep: Towards Low-Latency Neuromorphic Object Recognition with Spiking Neural Networks
- [AAAI] Dynamic Spiking Graph Neural Networks
- [AAAI] Dynamic Reactive Spiking Graph Neural Network [code]
- [AAAI] Enhancing Representation of Spiking Neural Networks via Similarity-Sensitive Contrastive Learning
- [AAAI] Efficient Spiking Neural Networks with Sparse Selective Activation for Continual Learning
- [AAAI] Enhancing Training of Spiking Neural Network with Stochastic Latency [code]
- [AAAI] Enhancing the robustness of spiking neural networks with stochastic gating mechanisms [code]
- [ICLR] Towards Energy Efficient Spiking Neural Networks: An Unstructured Pruning Framework [code]
- [ICLR] Online Stabilization of Spiking Neural Networks
- [ICLR] SpikePoint: An Efficient Point-based Spiking Neural Network for Event Cameras Action Recognition
- [ICLR] Spatio-Temporal Approximation: A Training-Free SNN Conversion for Transformers
- [ICLR] Sparse Spiking Neural Network: Exploiting Heterogeneity in Timescales for Pruning Recurrent SNN
- [ICLR] Learning Delays in Spiking Neural Networks using Dilated Convolutions with Learnable Spacings
- [ICLR] Threaten Spiking Neural Networks through Combining Rate and Temporal Information
- [ICLR] TAB: Temporal Accumulated Batch Normalization in Spiking Neural Networks
- [ICLR] Certified Adversarial Robustness for Rate Encoded Spiking Neural Networks
- [ICLR] Bayesian Bi-clustering of Neural Spiking Activity with Latent Structures
- [ICLR] Adaptive deep spiking neural network with global-local learning via balanced excitatory and inhibitory mechanism
- [ICLR] Hebbian Learning based Orthogonal Projection for Continual Learning of Spiking Neural Networks
- [ICLR] A Progressive Training Framework for Spiking Neural Networks with Learnable Multi-hierarchical Model
- [ICLR] LMUFormer: Low Complexity Yet Powerful Spiking Model With Legendre Memory Units
- [ICLR] Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chips [code]
- [ICLR] Bridging the Gap between Binary Neural Networks and Spiking Neural Networks for Efficient Computer Vision
- [ICLR] A Graph is Worth 1-bit Spikes: When Graph Contrastive Learning Meets Spiking Neural Networks
- [NeurIPS] Spiking PointNet: Spiking Neural Networks for Point Clouds [code]
- [NeurIPS] Spike-driven Transformer [code]
- [NeurIPS] Evolving Connectivity for Recurrent Spiking Neural Networks [code]
- [NeurIPS] Exploring Loss Functions for Time-based Training Strategy in Spiking Neural Networks [code]
- [NeurIPS] EICIL: Joint Excitatory Inhibitory Cycle Iteration Learning for Deep Spiking Neural Networks
- [NeurIPS] Addressing the speed-accuracy simulation trade-off for adaptive spiking neurons [code]
- [NeurIPS] Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term Dependencies [code]
- [NeurIPS] Unsupervised Optical Flow Estimation with Dynamic Timing Representation for Spike Camera [code]
- [NeurIPS] Meta-learning families of plasticity rules in recurrent spiking networks using simulation-based inference
- [NeurIPS] Temporal Conditioning Spiking Latent Variable Models of the Neural Response to Natural Visual Scenes
- [NeurIPS] Enhancing Adaptive History Reserving by Spiking Convolutional Block Attention Module in Recurrent Neural Networks
- [NeurIPS] Trial matching: capturing variability with data-constrained spiking neural networks [code]
- [NeurIPS] SparseProp: Efficient Event-Based Simulation and Training of Sparse Recurrent Spiking Neural Networks
- [NeurIPS] SEENN: Towards Temporal Spiking Early-Exit Neural Networks [code]
- [ACMMM] Resource Constrained Model Compression via Minimax Optimization for Spiking Neural Networks [code]
- [ICCV] Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks [code]
- [ICCV] Deep Directly-Trained Spiking Neural Networks for Object Detection [code]
- [ICCV] Inherent Redundancy in Spiking Neural Networks [code]
- [ICCV] RMP-Loss: Regularizing Membrane Potential Distribution for Spiking Neural Networks
- [ICCV] Membrane Potential Batch Normalization for Spiking Neural Networks [code]
- [ICCV] Masked Spiking Transformer [code]
- [ICML] Adaptive Smoothing Gradient Learning for Spiking Neural Networks [code]
- [ICML] Surrogate Module Learning: Reduce the Gradient Error Accumulation in Training Spiking Neural Networks [code]
- [CVPR] Rate Gradient Approximation Attack Threats Deep Spiking Neural Networks [code]
- [CVPR] 1000 FPS HDR Video with a Spike-RGB Hybrid Camera
- [CVPR] Constructing Deep Spiking Neural Networks from Artificial Neural Networks with Knowledge Distillation
- [ICLR] Bridging the Gap between ANNs and SNNs by Calibrating Offset Spikes [code]
- [ICLR] A Unified Framework for Soft Threshold Pruning [code]
- [ICLR] Heterogeneous Neuronal and Synaptic Dynamics for Spike-Efficient Unsupervised Learning: Theory and Design Principles
- [ICLR] Spiking Convolutional Neural Networks for Text Classification [code]
- [ICLR] Spikformer: When Spiking Neural Network Meets Transformer [code]
- [PR] Joint A-SNN: Joint Training of Artificial and Spiking Neural Networks via Self-Distillation and Weight Factorization [code]
- [AAAI] Reducing ANN-SNN Conversion Error through Residual Membrane Potential [code]
- [AAAI] Exploring Temporal Information Dynamics in Spiking Neural Networks [code]
- [AAAI] Deep Spiking Neural Networks with High Representation Similarity Model Visual Pathways of Macaque and Mouse [code]
- [IJCAI] A Low Latency Adaptive Coding Spiking Framework for Deep Reinforcement Learning
- [IJCAI] Enhancing Efficient Continual Learning with Dynamic Structure Development of Spiking Neural Networks [code]
- [ICASSP] Adaptive Axonal Delays in feedforward spiking neural networks for accurate spoken word recognition
- [ICASSP] Joint ANN-SNN Co-training for Object Localization and Image Segmentation
- [ICASSP] Leveraging Sparsity with Spiking Recurrent Neural Networks for Energy-Efficient Keyword Spotting
- [ICASSP] Training Robust Spiking Neural Networks on Neuromorphic Data with Spatiotemporal Fragments
- [ICASSP] Training Stronger Spiking Neural Networks with Biomimetic Adaptive Internal Association Neurons
- [ICASSP] In-Sensor & Neuromorphic Computing Are all You Need for Energy Efficient Computer Vision
- [NeurIPS] GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networks [code]
- [NeurIPS] Biologically Inspired Dynamic Thresholds for Spiking Neural Networks
- [NeurIPS] Online Training Through Time for Spiking Neural Networks [code]
- [NeurIPS] Mesoscopic modeling of hidden spiking neurons
- [NeurIPS] Temporal Effective Batch Normalization in Spiking Neural Networks [code]
- [NeurIPS] Differentiable hierarchical and surrogate gradient search for spiking neural networks [code]
- [NeurIPS] LTMD: Learning Improvement of Spiking Neural Networks with Learnable Thresholding Neurons and Moderate Dropout [code]
- [NeurIPS] Theoretically Provable Spiking Neural Networks
- [NeurIPS] Natural gradient enables fast sampling in spiking neural networks
- [NeurIPS] Biologically plausible solutions for spiking networks with efficient coding
- [NeurIPS] Toward Robust Spiking Neural Network Against Adversarial Perturbation
- [NeurIPS] SNN-RAT: Robustness-enhanced Spiking Neural Network through Regularized Adversarial Training
- [NeurIPS] Emergence of Hierarchical Layers in a Single Sheet of Self-Organizing Spiking Neurons
- [NeurIPS] Training Spiking Neural Networks with Event-driven Backpropagation
- [NeurIPS] IM-Loss: Information Maximization Loss for Spiking Neural Networks
- [NeurIPS] The computational and learning benefits of Daleian neural networks
- [NeurIPS] Dance of SNN and ANN: Solving binding problem by combining spike timing and reconstructive attention
- [NeurIPS] Learning Optical Flow from Continuous Spike Streams [code]
- [NeurIPS] STNDT: Modeling Neural Population Activity with Spatiotemporal Transformers
- [AAAI] Optimized Potential Initialization for Low-latency Spiking Neural Networks
- [AAAI] PrivateSNN: Privacy-Preserving Spiking Neural Networks
- [AAAI] SpikeConverter: An Efficient Conversion Framework Zipping the Gap between Artificial Neural Networks and Spiking Neural Networks
- [AAAI] Multi-sacle Dynamic Coding improved Spiking Actor Network for Reinforcement Learning
- [AAAI] Fully Spiking Variational Autoencoder [code]
- [AAAI] Spiking Neural Networks with Improved Inherent Recurrence Dynamics for Sequential Learning
- [AAAI] Spatio-Temporal Recurrent Networks for Event-Based Optical Flow Estimation [code]
- [IJCAI] Efficient and Accurate Conversion of Spiking Neural Network with Burst Spikes [code]
- [IJCAI] Spiking Graph Convolutional Networks [code]
- [IJCAI] Signed Neuron with Memory: Towards Simple, Accurate and High-Effcient ANN-SNN Conversion [code]
- [IJCAI] Self-Supervised Mutual Learning for Dynamic Scene Reconstruction of Spiking Camera
- [IJCAI] Multi-Level Firing with Spiking DS-ResNet: Enabling Better and Deeper Directly-Trained Spiking Neural Networks [code]
- [ICML] State Transition of Dendritic Spines Improves Learning of Sparse Spiking Neural Networks
- [ICML] AutoSNN: Towards Energy-Efficient Spiking Neural Networks
- [ICML] Scalable Spike-and-Slab
- [ICML] Neural Network Poisson Models for Behavioural and Neural Spike Train Data
- [CVPR] Brain-inspired Multilayer Perceptron with Spiking Neurons [code]
- [CVPR] Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representation [code]
- [CVPR] Event-based Video Reconstruction via Potential-assisted Spiking Neural Network [code]
- [CVPR] RecDis-SNN: Rectifying Membrane Potential Distribution for Directly Training Spiking Neural Networks
- [CVPR] Spiking Transformers for Event-Based Single Object Tracking [code]
- [CVPR] Optical Flow Estimation for Spiking Camera [code]
- [ECCV] Exploring Lottery Ticket Hypothesis in Spiking Neural Networks [code]
- [ECCV] Neuromorphic Data Augmentation for Training Spiking Neural Networks [code]
- [ECCV] Neural Architecture Search for Spiking Neural Networks [code]
- [ECCV] Real Spike: Learning Real-valued Spikes for Spiking Neural Networks [code]
- [ECCV] Reducing Information Loss for Spiking Neural Networks [code]
- [ICLR] Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks [code]
- [ICLR] Spike-inspired rank coding for fast and accurate recurrent neural networks
- [ICLR] Sequence Approximation using Feedforward Spiking Neural Network for Spatiotemporal Learning: Theory and Optimization Methods
- [ICLR] Temporal Efficient Training of Spiking Neural Network via Gradient Re-weighting [code]
- [NeurIPS] Training Feedback Spiking Neural Networks by Implicit Differentiation on the Equilibrium State
- [NeurIPS] Fitting summary statistics of neural data with a differentiable spiking network simulator
- [NeurIPS] Sparse Spiking Gradient Descent
- [NeurIPS] Differentiable Spike: Rethinking Gradient-Descent for Training Spiking Neural Networks
- [NeurIPS] Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural Networks
- [NeurIPS] Deep Residual Learning in Spiking Neural Networks
- [NeurIPS] Learning to Time-Decode in Spiking Neural Networks Through the Information Bottleneck
- [ICLR] Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networks
- [ICLR] Efficient Inference of Flexible Interaction in Spiking-neuron Networks
Our team .
