Closed ZhuangLii closed 2 months ago
Great work, but when i try to use fp16 to train the model, it appears
ValueError: Attempting to unscale FP16 gradients
bug, could u help me to solve the bug.
Sorry, It's really hard to help you to solve this problem. You know, This error may happen in various ways and in some lines of your code.
Did you train using fp16? I only modified the input data part, which shouldn't cause that bug.
Did you train using fp16? I only modified the input data part, which shouldn't cause that bug.
Oh, I get your means. The training code hasn't been adapted for fp16 training. I thought you had adapted the code by yourself. Besides, I have no spare time to update it. Maybe you can do it yourself.
Okay, thank you for your reply.
Great work, but when i try to use fp16 to train the model, it appears
ValueError: Attempting to unscale FP16 gradients
bug, could u help me to solve the bug.