search

ZouJiu1 / LSQplus

LSQ+ or LSQplus
57 stars 14 forks source link

Question about your code #3

Closed huanmei9 closed 2 years ago

huanmei9 commented 2 years ago

I'm wondering if there are some mistakes in this code. This function is to get the inital value about Scalebeta of activation_quantizer. Why need to get the gradiant about weight, and use it to update activation_quantizer's parameters. Is it more appropriate to change to weight = child.input ? Looking forward to your reply.

ZouJiu1 commented 2 years ago

I will check

ZouJiu1 commented 2 years ago

对于单层神经网络而言，权重和输入都是可以求梯度的，梯度和损失函数相关联不和权重关联 image image 单层感知机可见：https://github.com/ZouJiu1/deep-learning 可以我的知乎或者客