Open mi804 opened 2 years ago
Hello, during experiment, I found that the output of SEW block is not only 0 or 1 (i.e. pulse)
If you use ADD
, it is normal to appear int values.
Will the efficiency of SEW ResNet be improved after it is implemented on the actual neural chip
It depends on the chip. Loihi2 supports for graded spikes (I guess it is 8-bit).
Thank you for your answer. On such a chip, is the multiplication operation between the 8bit spike value and the weight acceptable? Can I take Sew Block as the baseline for structural design and compare it with other structures without considering the efficiency problem?
On such a chip, is the multiplication operation between the 8bit spike value and the weight acceptable?
I do not know much about it.
Can I take Sew Block as the baseline for structural design and compare it with other structures without considering the efficiency problem?
It depends on youself. Using ADD
will get higher accuracy, but may cause criticism.
You can use binary connect_f
to avoid the non-binary outputs caused by ADD
.
Ok. Thanks a lot!
Hello, during experiment, I found that the output of SEW block is not only 0 or 1 (i.e. pulse), but may appear positive integers, such as 2,3,4,5, etc. The discovery is indeed the meaning of the method itself, but these values will definitely be multiplied in the convolution calculation with the next layer. Does this violate the original intention of the spiking neural network, which computs information as pulse values? Will the efficiency of SEW ResNet be improved after it is implemented on the actual neural chip? May it be an ann instead of an snn?