search

Jittor / jittor

Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.
https://cg.cs.tsinghua.edu.cn/jittor/
Apache License 2.0
3.08k stars 311 forks source link

无法反馈，cannot bp #173

Open chic66 opened 3 years ago

chic66 commented 3 years ago

Hi I am using jittor for a training task and when I run the optimizer.step() it keeps pops out the following warnings

"'model.31.bias' doesn't have gradient. It will be set to zero: "

Could you please help me figure out why?

cjld commented 3 years ago

Thanks for your feedback, several reasons will cause no grad:

  1. model.31.bias doesn't use during forward, so gradient cannot backpropagate to it too.
  2. model.31.bias is stop grad
  3. model is in eval mode.

you can check your code for the above reasons, if the problem still not solved, you can give us the model source and train source. you can join our QQ group too: 761222083.

OrangeSodahub commented 2 years ago

@chic66 Hello, have you solved this problem?

chic66 commented 2 years ago

您的邮件已收到