패턴 기반 정렬을 활용한 고속-에너지 효율적인 컨볼루션 스파이킹 신경망 하드웨어 가속기의 모델 기반 동적 가지치기|RISS 상세보기

다국어 초록 (Multilingual Abstract)

Spiking neural network (SNN) is a structure that mimics biological neurons and processes through time-dependent signals called spikes. It resembles the functions of a biologꠓical brain, enabling energy-efficient and real-time processing. Despite being hardware-friendly, SNNs still require considerable computational resources. In this paper, we propose a Convolutional Spiking Neural Network (CSNN) architecture that leverages a preprocessed dataset for hardware accelerator-based pruning to reduce latency and power consumption. The dataset is encoded as binary data and preprocessed on the front-end by sorting it based on patterns. Once the dataset is input into the hardware accelerator, the system identifies data that does not require convolution operations. This allows the removal of inactive neurons at the Register Transfer Level (RTL). Since the neurons to be removed follow a similar pattern to the pruned neurons in the previous time step, the cost of removal is almost negligible. By pruning neurons dynamically for each input image, a more efficient, high-speed, low-power hardware accelerator can be achieved. The pattern-based dataset classification was implemented in Python, while the hardware accelerator was developed using Verilog and synthesized on an FPGA. This approach reduces power consumption by 80.02%, while also requiring 7.27% fewer gates and achieving a 90.1% improvement compared to traditional convolutional spiking neural networks and conventional CNNs. The accuracy reaches 90.56% and each input is calculated in 8955 clock cycles, which takes 0.53s for 60000 images in 100MHz board. This approach demonstrates the potential for enabling real-time learning on NPUs by integrating learning accelerators in future applications.

번역하기

참고문헌 (Reference)

1 J. K. Eshraghian, "Training Spiking Neural Networks Using Lessons from Deep Learning" 111 (111): 1016-1054, 2023

2 I. B. Levitan, "The Neuron : Cell and Molecular Biology" Oxford University Press 2015

3 L. Deng, "The Mnist Database of Handwritten Digit Images for Machine Learning Research" 29 (29): 141-142, 2012

4 M. Bouvier, "Spiking Neural Networks Hardware Im plementations and Challenges : A Survey" 15 (15): 1-35, 2019

5 S. A. Prescott, "Spike-rate Coding and Spike-time Coding are Affected Oppositely by Different Adaptation Mechanisms" 28 (28): 13649-13661, 2008

6 F. Cai, "Power-efficient Combinatorial Optimiza tion Using Intrinsic Noise in Memristor Hopfield Neural Networks" 3 (3): 409-418, 2020

7 J. H. eJ, "Neuroscience Online: An Electronic Textbook for the Neurosciences"

8 B. Dai, "Multivariate Bernoulli Distribution" 19 (19): 1465-1483, 2013

9 L. Xie, "Genetic cnn" 1379-1388, 2017

10 R. Vaila, "Feature Extraction Using Spiking Convolutional Neural Networks" 1-8, 2019