Dinh, V.-N. and Bui, N.-M. and Nguyen, V.-T. and Duong, Q.-M. and Trinh, Q.-K. (2022) FBW-SNN: A Fully Binarized Weights-Spiking Neural Networks for Edge-AI Applications. In: Conference of 2022 IEEE International Conference on IC Design and Technology, ICICDT 2022, 21 September 2022 Through 23 September 2022, Hanoi.
Full text not available from this repository. (Upload)Abstract
This study proposes a Fully Binarized Weight Spiking Neuron Network (FBW-SNN). The core network is built based on XNOR arrays with binary weights where the weights of the first and the last layers are represented by a stochastic binary stream (stochastic numbers). We also introduced an algorithm that combines straight-through and surrogate gradients to train FBW-SNN. The evaluation results on the CIFAR-10 dataset show that the proposed FBW-SNN could achieve an accuracy of 82.68 with only 14-time steps, which is comparable to the accuracy of the Binarized SNN (with real weights at the first and the last layer) and conventional SNNs. By fully binarized, the proposed network model could be a promising candidate for Edge-AI applications implemented on low-power and resource-constrained devices. © 2022 IEEE.
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Divisions: | Faculties > Faculty of Radio-Electronic Engineering |
Identification Number: | 10.1109/ICICDT56182.2022.9933108 |
Uncontrolled Keywords: | Low power electronics; Stochastic systems, AI applications; Binary spiking neural network; Binary streams; Core networks; Edge-AI; In-memory computing; Neural-networks; Neuromorphic computing; Spiking neuron networks; Stochastics, Neural networks |
Additional Information: | Conference of 2022 IEEE International Conference on IC Design and Technology, ICICDT 2022 ; Conference Date: 21 September 2022 Through 23 September 2022; Conference Code:184070 |
URI: | http://eprints.lqdtu.edu.vn/id/eprint/10619 |