search

FourthBrain / Building-with-Instruction-Tuned-LLMs-A-Step-by-Step-Guide

Resources relating to the DLAI event: https://www.youtube.com/watch?v=eTieetk2dSw
178 stars 43 forks source link

Getting issue while running the training cell in this notebook: BLOOMz-LoRA Unsupervised Fine-tuning Notebook #3

Closed Wangsherpa closed 1 year ago

Wangsherpa commented 1 year ago

RuntimeError: unscale_() has already been called on this optimizer since the last update().

Wangsherpa commented 1 year ago

One of the solutions mentioned here worked.