تقرير
Direct Training High-Performance Deep Spiking Neural Networks: A Review of Theories and Methods
| العنوان: | Direct Training High-Performance Deep Spiking Neural Networks: A Review of Theories and Methods |
|---|---|
| المؤلفون: | Zhou, Chenlin, Zhang, Han, Yu, Liutao, Ye, Yumin, Zhou, Zhaokun, Huang, Liwei, Ma, Zhengyu, Fan, Xiaopeng, Zhou, Huihui, Tian, Yonghong |
| سنة النشر: | 2024 |
| المجموعة: | Computer Science |
| مصطلحات موضوعية: | Computer Science - Neural and Evolutionary Computing |
| الوصف: | Spiking neural networks (SNNs) offer a promising energy-efficient alternative to artificial neural networks (ANNs), in virtue of their high biological plausibility, rich spatial-temporal dynamics, and event-driven computation. The direct training algorithms based on the surrogate gradient method provide sufficient flexibility to design novel SNN architectures and explore the spatial-temporal dynamics of SNNs. According to previous studies, the performance of models is highly dependent on their sizes. Recently, direct training deep SNNs have achieved great progress on both neuromorphic datasets and large-scale static datasets. Notably, transformer-based SNNs show comparable performance with their ANN counterparts. In this paper, we provide a new perspective to summarize the theories and methods for training deep SNNs with high performance in a systematic and comprehensive way, including theory fundamentals, spiking neuron models, advanced SNN models and residual architectures, software frameworks and neuromorphic hardware, applications, and future trends. The reviewed papers are collected at https://github.com/zhouchenlin2096/Awesome-Spiking-Neural-Networks Comment: Accepted by Frontiers in Neuroscience |
| نوع الوثيقة: | Working Paper |
| URL الوصول: | http://arxiv.org/abs/2405.04289 |
| رقم الأكسشن: | edsarx.2405.04289 |
| قاعدة البيانات: | arXiv |
| الوصف غير متاح. |