Closed antoniogois closed 5 years ago
gradient accumulation doesn't make sense here, although the code was working. Without grad accumulation, the learning rate was too low, so I also fixed that
gradient accumulation doesn't make sense here, although the code was working. Without grad accumulation, the learning rate was too low, so I also fixed that