ZouJiu1 / LSQplus

LSQ+ or LSQplus
57 stars 14 forks source link

Questions about step size training in LSQ and LSQ+. #12

Open EthanLeong opened 1 year ago

EthanLeong commented 1 year ago

Thank you so much for your open source work!! This project really help me out a lot. I just have one question regarding LSQ and LSQ+. I hope I am not misunderstanding anything, but as far as I concern, the learned step size should be a scale value. However, during training, I noticed that there were times where the step size will become negative and the quantized performance of the model will become really bad. Is this some kinds of bug from the original paper or is it me who is making a huge mistake. Any help from you is appreciated, thank you!